== parallel-scale test fio: fio ========================== 13:34:11 (1790962451) stripe_count: 1 stripe_size: 4194304 pattern: stripe_offset: -1 oleg324-client.virtnet: [global] oleg324-client.virtnet: rw=randwrite oleg324-client.virtnet: size=128m oleg324-client.virtnet: time_based=1 oleg324-client.virtnet: runtime=60 oleg324-client.virtnet: filename=/mnt/lustre/d0.fio/fio_oleg324-client.virtnet oleg324-client.virtnet: oleg324-client.virtnet: [job1] oleg324-client.virtnet: bs=1m oleg324-client.virtnet: oleg324-client.virtnet: [job2] oleg324-client.virtnet: bs=2m oleg324-client.virtnet: oleg324-client.virtnet: [job3] oleg324-client.virtnet: bs=3m oleg324-client.virtnet: oleg324-client.virtnet: [job4] oleg324-client.virtnet: bs=4m + /usr/bin/fio /tmp/fiojobfile.1790962452 clients: oleg324-client.virtnet /usr/bin/fio /tmp/fiojobfile.1790962452 oleg324-client.virtnet: job1: (g=0): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1 oleg324-client.virtnet: job2: (g=0): rw=randwrite, bs=(R) 2048KiB-2048KiB, (W) 2048KiB-2048KiB, (T) 2048KiB-2048KiB, ioengine=psync, iodepth=1 oleg324-client.virtnet: job3: (g=0): rw=randwrite, bs=(R) 3072KiB-3072KiB, (W) 3072KiB-3072KiB, (T) 3072KiB-3072KiB, ioengine=psync, iodepth=1 oleg324-client.virtnet: job4: (g=0): rw=randwrite, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1 oleg324-client.virtnet: fio-3.19 oleg324-client.virtnet: Starting 4 processes oleg324-client.virtnet: job1: Laying out IO file (1 file / 128MiB) oleg324-client.virtnet: oleg324-client.virtnet: job1: (groupid=0, jobs=1): err= 0: pid=15674: Fri Oct 2 13:35:16 2026 oleg324-client.virtnet: write: IOPS=48, BW=48.4MiB/s (50.8MB/s)(2909MiB/60081msec); 0 zone resets oleg324-client.virtnet: clat (msec): min=5, max=216, avg=20.31, stdev=21.75 oleg324-client.virtnet: lat (msec): min=5, max=216, avg=20.41, stdev=21.76 oleg324-client.virtnet: clat percentiles (msec): oleg324-client.virtnet: | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], oleg324-client.virtnet: | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 16], oleg324-client.virtnet: | 70.00th=[ 18], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 70], oleg324-client.virtnet: | 99.00th=[ 123], 99.50th=[ 140], 99.90th=[ 199], 99.95th=[ 207], oleg324-client.virtnet: | 99.99th=[ 218] oleg324-client.virtnet: bw ( KiB/s): min=24576, max=81756, per=38.06%, avg=49634.25, stdev=11791.20, samples=119 oleg324-client.virtnet: iops : min= 24, max= 79, avg=48.09, stdev=11.49, samples=119 oleg324-client.virtnet: lat (msec) : 10=15.40%, 20=62.26%, 50=15.92%, 100=4.06%, 250=2.37% oleg324-client.virtnet: cpu : usr=0.44%, sys=46.37%, ctx=4964, majf=0, minf=9 oleg324-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg324-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: issued rwts: total=0,2909,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg324-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg324-client.virtnet: job2: (groupid=0, jobs=1): err= 0: pid=15675: Fri Oct 2 13:35:16 2026 oleg324-client.virtnet: write: IOPS=9, BW=18.6MiB/s (19.5MB/s)(1118MiB/60062msec); 0 zone resets oleg324-client.virtnet: clat (msec): min=36, max=337, avg=106.54, stdev=35.84 oleg324-client.virtnet: lat (msec): min=36, max=337, avg=106.75, stdev=35.86 oleg324-client.virtnet: clat percentiles (msec): oleg324-client.virtnet: | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 81], oleg324-client.virtnet: | 30.00th=[ 88], 40.00th=[ 94], 50.00th=[ 101], 60.00th=[ 110], oleg324-client.virtnet: | 70.00th=[ 117], 80.00th=[ 128], 90.00th=[ 148], 95.00th=[ 165], oleg324-client.virtnet: | 99.00th=[ 239], 99.50th=[ 262], 99.90th=[ 338], 99.95th=[ 338], oleg324-client.virtnet: | 99.99th=[ 338] oleg324-client.virtnet: bw ( KiB/s): min= 7585, max=28672, per=14.62%, avg=19059.76, stdev=4214.22, samples=119 oleg324-client.virtnet: iops : min= 3, max= 14, avg= 8.85, stdev= 2.15, samples=119 oleg324-client.virtnet: lat (msec) : 50=1.61%, 100=48.30%, 250=49.37%, 500=0.72% oleg324-client.virtnet: cpu : usr=0.13%, sys=1.69%, ctx=903, majf=0, minf=8 oleg324-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg324-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: issued rwts: total=0,559,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg324-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg324-client.virtnet: job3: (groupid=0, jobs=1): err= 0: pid=15676: Fri Oct 2 13:35:16 2026 oleg324-client.virtnet: write: IOPS=8, BW=26.4MiB/s (27.7MB/s)(1587MiB/60061msec); 0 zone resets oleg324-client.virtnet: clat (msec): min=45, max=288, avg=112.39, stdev=32.78 oleg324-client.virtnet: lat (msec): min=45, max=288, avg=112.71, stdev=32.82 oleg324-client.virtnet: clat percentiles (msec): oleg324-client.virtnet: | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 88], oleg324-client.virtnet: | 30.00th=[ 94], 40.00th=[ 101], 50.00th=[ 106], 60.00th=[ 115], oleg324-client.virtnet: | 70.00th=[ 124], 80.00th=[ 133], 90.00th=[ 155], 95.00th=[ 176], oleg324-client.virtnet: | 99.00th=[ 215], 99.50th=[ 247], 99.90th=[ 288], 99.95th=[ 288], oleg324-client.virtnet: | 99.99th=[ 288] oleg324-client.virtnet: bw ( KiB/s): min=12263, max=36864, per=20.74%, avg=27042.55, stdev=5638.93, samples=119 oleg324-client.virtnet: iops : min= 3, max= 12, avg= 8.34, stdev= 2.00, samples=119 oleg324-client.virtnet: lat (msec) : 50=0.38%, 100=38.75%, 250=60.49%, 500=0.38% oleg324-client.virtnet: cpu : usr=0.20%, sys=2.23%, ctx=1021, majf=0, minf=9 oleg324-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg324-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: issued rwts: total=0,529,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg324-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg324-client.virtnet: job4: (groupid=0, jobs=1): err= 0: pid=15677: Fri Oct 2 13:35:16 2026 oleg324-client.virtnet: write: IOPS=8, BW=34.0MiB/s (35.7MB/s)(2048MiB/60163msec); 0 zone resets oleg324-client.virtnet: clat (msec): min=51, max=335, avg=116.08, stdev=31.98 oleg324-client.virtnet: lat (msec): min=51, max=335, avg=116.49, stdev=31.97 oleg324-client.virtnet: clat percentiles (msec): oleg324-client.virtnet: | 1.00th=[ 63], 5.00th=[ 75], 10.00th=[ 82], 20.00th=[ 92], oleg324-client.virtnet: | 30.00th=[ 100], 40.00th=[ 105], 50.00th=[ 110], 60.00th=[ 118], oleg324-client.virtnet: | 70.00th=[ 126], 80.00th=[ 138], 90.00th=[ 159], 95.00th=[ 174], oleg324-client.virtnet: | 99.00th=[ 220], 99.50th=[ 245], 99.90th=[ 334], 99.95th=[ 334], oleg324-client.virtnet: | 99.99th=[ 334] oleg324-client.virtnet: bw ( KiB/s): min=15312, max=57344, per=26.76%, avg=34892.55, stdev=6906.45, samples=119 oleg324-client.virtnet: iops : min= 3, max= 14, avg= 8.06, stdev= 1.80, samples=119 oleg324-client.virtnet: lat (msec) : 100=32.23%, 250=67.38%, 500=0.39% oleg324-client.virtnet: cpu : usr=0.26%, sys=2.49%, ctx=1046, majf=0, minf=9 oleg324-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg324-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg324-client.virtnet: issued rwts: total=0,512,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg324-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg324-client.virtnet: oleg324-client.virtnet: Run status group 0 (all jobs): oleg324-client.virtnet: WRITE: bw=127MiB/s (134MB/s), 18.6MiB/s-48.4MiB/s (19.5MB/s-50.8MB/s), io=7662MiB (8034MB), run=60061-60163msec