== parallel-scale test fio: fio ========================== 13:33:27 (1790962407) striped dir -i0 -c2 -H all_char /mnt/lustre/d0.fio stripe_count: 1 stripe_size: 4194304 pattern: stripe_offset: -1 oleg147-client.virtnet: [global] oleg147-client.virtnet: rw=randwrite oleg147-client.virtnet: size=128m oleg147-client.virtnet: time_based=1 oleg147-client.virtnet: runtime=60 oleg147-client.virtnet: filename=/mnt/lustre/d0.fio/fio_oleg147-client.virtnet oleg147-client.virtnet: oleg147-client.virtnet: [job1] oleg147-client.virtnet: bs=1m oleg147-client.virtnet: oleg147-client.virtnet: [job2] oleg147-client.virtnet: bs=2m oleg147-client.virtnet: oleg147-client.virtnet: [job3] oleg147-client.virtnet: bs=3m oleg147-client.virtnet: oleg147-client.virtnet: [job4] oleg147-client.virtnet: bs=4m + /usr/bin/fio /tmp/fiojobfile.1790962407 clients: oleg147-client.virtnet /usr/bin/fio /tmp/fiojobfile.1790962407 oleg147-client.virtnet: job1: (g=0): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1 oleg147-client.virtnet: job2: (g=0): rw=randwrite, bs=(R) 2048KiB-2048KiB, (W) 2048KiB-2048KiB, (T) 2048KiB-2048KiB, ioengine=psync, iodepth=1 oleg147-client.virtnet: job3: (g=0): rw=randwrite, bs=(R) 3072KiB-3072KiB, (W) 3072KiB-3072KiB, (T) 3072KiB-3072KiB, ioengine=psync, iodepth=1 oleg147-client.virtnet: job4: (g=0): rw=randwrite, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1 oleg147-client.virtnet: fio-3.19 oleg147-client.virtnet: Starting 4 processes oleg147-client.virtnet: job1: Laying out IO file (1 file / 128MiB) oleg147-client.virtnet: oleg147-client.virtnet: job1: (groupid=0, jobs=1): err= 0: pid=16552: Fri Oct 2 13:34:31 2026 oleg147-client.virtnet: write: IOPS=56, BW=56.5MiB/s (59.3MB/s)(3393MiB/60010msec); 0 zone resets oleg147-client.virtnet: clat (usec): min=7614, max=83161, avg=17515.31, stdev=7527.59 oleg147-client.virtnet: lat (usec): min=7680, max=83258, avg=17603.67, stdev=7528.58 oleg147-client.virtnet: clat percentiles (usec): oleg147-client.virtnet: | 1.00th=[ 9372], 5.00th=[10945], 10.00th=[11731], 20.00th=[13042], oleg147-client.virtnet: | 30.00th=[14091], 40.00th=[14877], 50.00th=[15664], 60.00th=[16712], oleg147-client.virtnet: | 70.00th=[17957], 80.00th=[19792], 90.00th=[23987], 95.00th=[32113], oleg147-client.virtnet: | 99.00th=[51119], 99.50th=[60031], 99.90th=[68682], 99.95th=[74974], oleg147-client.virtnet: | 99.99th=[83362] oleg147-client.virtnet: bw ( KiB/s): min=43008, max=69632, per=19.85%, avg=58022.55, stdev=5464.28, samples=119 oleg147-client.virtnet: iops : min= 42, max= 68, avg=56.48, stdev= 5.37, samples=119 oleg147-client.virtnet: lat (msec) : 10=1.95%, 20=79.28%, 50=17.65%, 100=1.12% oleg147-client.virtnet: cpu : usr=0.63%, sys=77.98%, ctx=5123, majf=0, minf=8 oleg147-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg147-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: issued rwts: total=0,3393,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg147-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg147-client.virtnet: job2: (groupid=0, jobs=1): err= 0: pid=16553: Fri Oct 2 13:34:31 2026 oleg147-client.virtnet: write: IOPS=30, BW=61.3MiB/s (64.2MB/s)(3678MiB/60026msec); 0 zone resets oleg147-client.virtnet: clat (msec): min=11, max=156, avg=32.26, stdev=14.74 oleg147-client.virtnet: lat (msec): min=12, max=156, avg=32.45, stdev=14.74 oleg147-client.virtnet: clat percentiles (msec): oleg147-client.virtnet: | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], oleg147-client.virtnet: | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], oleg147-client.virtnet: | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 63], oleg147-client.virtnet: | 99.00th=[ 79], 99.50th=[ 83], 99.90th=[ 102], 99.95th=[ 157], oleg147-client.virtnet: | 99.99th=[ 157] oleg147-client.virtnet: bw ( KiB/s): min=45056, max=86016, per=21.48%, avg=62791.61, stdev=8189.59, samples=119 oleg147-client.virtnet: iops : min= 22, max= 42, avg=30.46, stdev= 4.12, samples=119 oleg147-client.virtnet: lat (msec) : 20=18.76%, 50=68.52%, 100=12.62%, 250=0.11% oleg147-client.virtnet: cpu : usr=0.64%, sys=3.85%, ctx=3272, majf=0, minf=8 oleg147-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg147-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: issued rwts: total=0,1839,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg147-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg147-client.virtnet: job3: (groupid=0, jobs=1): err= 0: pid=16554: Fri Oct 2 13:34:31 2026 oleg147-client.virtnet: write: IOPS=25, BW=77.8MiB/s (81.6MB/s)(4671MiB/60002msec); 0 zone resets oleg147-client.virtnet: clat (msec): min=15, max=167, avg=37.96, stdev=15.29 oleg147-client.virtnet: lat (msec): min=16, max=167, avg=38.23, stdev=15.30 oleg147-client.virtnet: clat percentiles (msec): oleg147-client.virtnet: | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], oleg147-client.virtnet: | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 38], oleg147-client.virtnet: | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 60], 95.00th=[ 67], oleg147-client.virtnet: | 99.00th=[ 83], 99.50th=[ 90], 99.90th=[ 126], 99.95th=[ 167], oleg147-client.virtnet: | 99.99th=[ 167] oleg147-client.virtnet: bw ( KiB/s): min=49152, max=110592, per=27.31%, avg=79838.81, stdev=12124.44, samples=119 oleg147-client.virtnet: iops : min= 16, max= 36, avg=25.79, stdev= 4.05, samples=119 oleg147-client.virtnet: lat (msec) : 20=3.34%, 50=76.43%, 100=19.85%, 250=0.39% oleg147-client.virtnet: cpu : usr=0.71%, sys=4.73%, ctx=3059, majf=0, minf=8 oleg147-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg147-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: issued rwts: total=0,1557,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg147-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg147-client.virtnet: job4: (groupid=0, jobs=1): err= 0: pid=16555: Fri Oct 2 13:34:31 2026 oleg147-client.virtnet: write: IOPS=22, BW=89.9MiB/s (94.3MB/s)(5396MiB/60032msec); 0 zone resets oleg147-client.virtnet: clat (msec): min=19, max=170, avg=43.83, stdev=15.01 oleg147-client.virtnet: lat (msec): min=20, max=171, avg=44.18, stdev=15.02 oleg147-client.virtnet: clat percentiles (msec): oleg147-client.virtnet: | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 32], oleg147-client.virtnet: | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 45], oleg147-client.virtnet: | 70.00th=[ 50], 80.00th=[ 56], 90.00th=[ 65], 95.00th=[ 74], oleg147-client.virtnet: | 99.00th=[ 87], 99.50th=[ 92], 99.90th=[ 125], 99.95th=[ 171], oleg147-client.virtnet: | 99.99th=[ 171] oleg147-client.virtnet: bw ( KiB/s): min=61852, max=122880, per=31.53%, avg=92163.40, stdev=10878.83, samples=119 oleg147-client.virtnet: iops : min= 15, max= 30, avg=22.30, stdev= 2.70, samples=119 oleg147-client.virtnet: lat (msec) : 20=0.07%, 50=70.50%, 100=29.28%, 250=0.15% oleg147-client.virtnet: cpu : usr=0.80%, sys=5.14%, ctx=3414, majf=0, minf=8 oleg147-client.virtnet: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% oleg147-client.virtnet: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% oleg147-client.virtnet: issued rwts: total=0,1349,0,0 short=0,0,0,0 dropped=0,0,0,0 oleg147-client.virtnet: latency : target=0, window=0, percentile=100.00%, depth=1 oleg147-client.virtnet: oleg147-client.virtnet: Run status group 0 (all jobs): oleg147-client.virtnet: WRITE: bw=285MiB/s (299MB/s), 56.5MiB/s-89.9MiB/s (59.3MB/s-94.3MB/s), io=16.7GiB (17.0GB), run=60002-60032msec