== sanity test 398b: DIO and buffer IO race ============== 09:24:07 (1788355447) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.9392 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191849: Wed Sep 2 09:25:06 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(5992KiB/49365msec) clat (usec): min=31, max=534952, avg=17603.38, stdev=15748.82 lat (usec): min=31, max=534953, avg=17603.93, stdev=15748.83 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 7963], 10.00th=[ 9372], 20.00th=[ 11076], | 30.00th=[ 12518], 40.00th=[ 13829], 50.00th=[ 15664], 60.00th=[ 17957], | 70.00th=[ 20055], 80.00th=[ 22938], 90.00th=[ 27132], 95.00th=[ 31327], | 99.00th=[ 51119], 99.50th=[ 55837], 99.90th=[ 77071], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 63, max= 190, per=25.57%, avg=122.22, stdev=26.78, samples=97 iops : min= 15, max= 47, avg=30.20, stdev= 6.72, samples=97 write: IOPS=31, BW=128KiB/s (131kB/s)(6296KiB/49365msec); 0 zone resets clat (usec): min=781, max=89456, avg=14579.87, stdev=10301.43 lat (usec): min=782, max=89457, avg=14581.48, stdev=10300.65 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2999], 10.00th=[ 3458], 20.00th=[ 4293], | 30.00th=[ 7570], 40.00th=[10552], 50.00th=[12649], 60.00th=[15008], | 70.00th=[18220], 80.00th=[23200], 90.00th=[28967], 95.00th=[33424], | 99.00th=[44303], 99.50th=[48497], 99.90th=[62653], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 56, max= 208, per=25.71%, avg=128.55, stdev=29.95, samples=97 iops : min= 14, max= 52, avg=31.78, stdev= 7.51, samples=97 lat (usec) : 50=0.07%, 100=0.26%, 250=0.88%, 1000=0.26% lat (msec) : 2=0.72%, 4=7.98%, 10=15.40%, 20=46.09%, 50=27.64% lat (msec) : 100=0.68%, 750=0.03% cpu : usr=0.06%, sys=25.96%, ctx=9482, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191850: Wed Sep 2 09:25:06 2026 read: IOPS=29, BW=119KiB/s (121kB/s)(5940KiB/50082msec) clat (usec): min=61, max=573914, avg=18255.66, stdev=16856.96 lat (usec): min=62, max=573915, avg=18256.13, stdev=16856.98 clat percentiles (usec): | 1.00th=[ 124], 5.00th=[ 8160], 10.00th=[ 9503], 20.00th=[ 11076], | 30.00th=[ 12780], 40.00th=[ 14615], 50.00th=[ 16450], 60.00th=[ 18482], | 70.00th=[ 20579], 80.00th=[ 23200], 90.00th=[ 27657], 95.00th=[ 32637], | 99.00th=[ 49546], 99.50th=[ 56361], 99.90th=[ 79168], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 56, max= 182, per=24.91%, avg=119.07, stdev=23.80, samples=98 iops : min= 14, max= 45, avg=29.41, stdev= 5.93, samples=98 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/50082msec); 0 zone resets clat (usec): min=816, max=66223, avg=14455.45, stdev=10391.85 lat (usec): min=816, max=66223, avg=14456.50, stdev=10392.13 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2999], 10.00th=[ 3458], 20.00th=[ 4228], | 30.00th=[ 7111], 40.00th=[10421], 50.00th=[12518], 60.00th=[14615], | 70.00th=[17957], 80.00th=[22414], 90.00th=[28967], 95.00th=[34341], | 99.00th=[44827], 99.50th=[53740], 99.90th=[62653], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 79, max= 192, per=25.33%, avg=126.64, stdev=29.18, samples=98 iops : min= 19, max= 48, avg=31.31, stdev= 7.33, samples=98 lat (usec) : 100=0.16%, 250=0.55%, 750=0.03%, 1000=0.13% lat (msec) : 2=0.55%, 4=8.95%, 10=15.85%, 20=44.53%, 50=28.48% lat (msec) : 100=0.72%, 750=0.03% cpu : usr=0.08%, sys=26.01%, ctx=9455, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191851: Wed Sep 2 09:25:06 2026 read: IOPS=30, BW=120KiB/s (123kB/s)(6028KiB/50227msec) clat (usec): min=45, max=82240, avg=17646.27, stdev=8634.97 lat (usec): min=46, max=82241, avg=17646.81, stdev=8634.98 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 7963], 10.00th=[ 9372], 20.00th=[11207], | 30.00th=[12518], 40.00th=[14222], 50.00th=[16057], 60.00th=[17957], | 70.00th=[20317], 80.00th=[23462], 90.00th=[27657], 95.00th=[31851], | 99.00th=[50070], 99.50th=[54789], 99.90th=[70779], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 72, max= 176, per=25.28%, avg=120.85, stdev=23.95, samples=99 iops : min= 18, max= 44, avg=29.86, stdev= 6.04, samples=99 write: IOPS=31, BW=125KiB/s (128kB/s)(6260KiB/50227msec); 0 zone resets clat (usec): min=852, max=584877, avg=15078.91, stdev=17842.62 lat (usec): min=853, max=584878, avg=15079.56, stdev=17842.64 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 3097], 10.00th=[ 3490], 20.00th=[ 4424], | 30.00th=[ 7373], 40.00th=[ 10552], 50.00th=[ 12649], 60.00th=[ 15139], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 29492], 95.00th=[ 34341], | 99.00th=[ 45876], 99.50th=[ 56886], 99.90th=[ 72877], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 47, max= 198, per=25.09%, avg=125.45, stdev=29.71, samples=99 iops : min= 11, max= 49, avg=31.01, stdev= 7.45, samples=99 lat (usec) : 50=0.03%, 100=0.20%, 250=0.65%, 1000=0.29% lat (msec) : 2=0.59%, 4=7.65%, 10=16.57%, 20=44.47%, 50=28.71% lat (msec) : 100=0.81%, 750=0.03% cpu : usr=0.07%, sys=25.72%, ctx=9615, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191852: Wed Sep 2 09:25:06 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(6052KiB/49521msec) clat (usec): min=32, max=102005, avg=17417.82, stdev=8326.18 lat (usec): min=33, max=102006, avg=17418.35, stdev=8326.18 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 8356], 10.00th=[ 9503], 20.00th=[ 11207], | 30.00th=[ 12649], 40.00th=[ 13960], 50.00th=[ 15926], 60.00th=[ 17957], | 70.00th=[ 20055], 80.00th=[ 22938], 90.00th=[ 26870], 95.00th=[ 31589], | 99.00th=[ 45876], 99.50th=[ 51119], 99.90th=[ 56886], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 21, max= 184, per=25.63%, avg=122.52, stdev=27.10, samples=98 iops : min= 5, max= 46, avg=30.31, stdev= 6.76, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6236KiB/49521msec); 0 zone resets clat (usec): min=835, max=579666, avg=14833.04, stdev=17647.85 lat (usec): min=835, max=579667, avg=14833.75, stdev=17647.90 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 3130], 10.00th=[ 3490], 20.00th=[ 4424], | 30.00th=[ 7308], 40.00th=[ 10421], 50.00th=[ 12518], 60.00th=[ 14615], | 70.00th=[ 18220], 80.00th=[ 22938], 90.00th=[ 28967], 95.00th=[ 34341], | 99.00th=[ 45351], 99.50th=[ 56886], 99.90th=[ 64750], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 32, max= 199, per=25.16%, avg=125.81, stdev=29.91, samples=98 iops : min= 8, max= 49, avg=31.13, stdev= 7.43, samples=98 lat (usec) : 50=0.07%, 100=0.07%, 250=0.81%, 1000=0.16% lat (msec) : 2=0.52%, 4=7.75%, 10=15.89%, 20=46.71%, 50=27.31% lat (msec) : 100=0.65%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=26.12%, ctx=9686, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=478KiB/s (490kB/s), 119KiB/s-122KiB/s (121kB/s-125kB/s), io=23.4MiB (24.6MB), run=49365-50227msec WRITE: bw=501KiB/s (513kB/s), 125KiB/s-128KiB/s (128kB/s-131kB/s), io=24.6MiB (25.7MB), run=49365-50227msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191844: Wed Sep 2 09:25:14 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/58054msec) clat (msec): min=2, max=684, avg=17.43, stdev=21.44 lat (msec): min=2, max=684, avg=17.43, stdev=21.44 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 43], | 99.00th=[ 67], 99.50th=[ 73], 99.90th=[ 88], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 32, max= 320, per=25.15%, avg=103.61, stdev=63.03, samples=114 iops : min= 8, max= 80, avg=25.61, stdev=15.84, samples=114 write: IOPS=27, BW=108KiB/s (111kB/s)(6296KiB/58054msec); 0 zone resets clat (usec): min=5175, max=83680, avg=20171.15, stdev=12718.40 lat (usec): min=5176, max=83681, avg=20171.88, stdev=12718.41 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 6652], 10.00th=[ 7308], 20.00th=[ 8848], | 30.00th=[10945], 40.00th=[13698], 50.00th=[16319], 60.00th=[20579], | 70.00th=[25035], 80.00th=[30540], 90.00th=[38536], 95.00th=[44303], | 99.00th=[57934], 99.50th=[69731], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 24, max= 360, per=25.23%, avg=108.74, stdev=64.45, samples=114 iops : min= 6, max= 90, avg=26.89, stdev=16.19, samples=114 lat (msec) : 4=0.33%, 10=29.33%, 20=35.74%, 50=32.19%, 100=2.38% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=14.55%, ctx=6107, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191845: Wed Sep 2 09:25:14 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5940KiB/57939msec) clat (msec): min=3, max=722, avg=16.69, stdev=21.85 lat (msec): min=3, max=722, avg=16.69, stdev=21.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 42], | 99.00th=[ 56], 99.50th=[ 65], 99.90th=[ 88], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 16, max= 344, per=25.05%, avg=103.19, stdev=63.84, samples=114 iops : min= 4, max= 86, avg=25.51, stdev=16.04, samples=114 write: IOPS=27, BW=110KiB/s (112kB/s)(6348KiB/57939msec); 0 zone resets clat (msec): min=4, max=102, avg=20.77, stdev=13.88 lat (msec): min=4, max=102, avg=20.77, stdev=13.88 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 96], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 39, max= 344, per=25.54%, avg=110.06, stdev=64.03, samples=114 iops : min= 9, max= 86, avg=27.23, stdev=16.08, samples=114 lat (msec) : 4=0.49%, 10=30.86%, 20=34.41%, 50=31.67%, 100=2.51% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=14.56%, ctx=6194, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191846: Wed Sep 2 09:25:14 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6028KiB/58094msec) clat (msec): min=2, max=104, avg=16.80, stdev=12.92 lat (msec): min=2, max=104, avg=16.80, stdev=12.92 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 61], 99.50th=[ 69], 99.90th=[ 90], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 23, max= 352, per=25.25%, avg=104.03, stdev=65.81, samples=114 iops : min= 5, max= 88, avg=25.72, stdev=16.53, samples=114 write: IOPS=26, BW=108KiB/s (110kB/s)(6260KiB/58094msec); 0 zone resets clat (msec): min=4, max=728, avg=20.82, stdev=22.11 lat (msec): min=4, max=728, avg=20.83, stdev=22.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 45], | 99.00th=[ 66], 99.50th=[ 70], 99.90th=[ 100], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 32, max= 320, per=24.98%, avg=107.68, stdev=62.49, samples=114 iops : min= 8, max= 80, avg=26.63, stdev=15.70, samples=114 lat (msec) : 4=0.39%, 10=30.86%, 20=33.89%, 50=32.10%, 100=2.70% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=14.50%, ctx=6166, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191847: Wed Sep 2 09:25:14 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6052KiB/58203msec) clat (msec): min=2, max=104, avg=16.85, stdev=13.00 lat (msec): min=2, max=104, avg=16.85, stdev=13.00 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 61], 99.50th=[ 69], 99.90th=[ 85], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 23, max= 360, per=25.10%, avg=103.40, stdev=65.06, samples=114 iops : min= 5, max= 90, avg=25.56, stdev=16.36, samples=114 write: IOPS=26, BW=107KiB/s (110kB/s)(6236KiB/58203msec); 0 zone resets clat (msec): min=4, max=721, avg=20.85, stdev=22.41 lat (msec): min=4, max=721, avg=20.85, stdev=22.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 70], 99.50th=[ 78], 99.90th=[ 107], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 39, max= 336, per=24.71%, avg=106.49, stdev=64.17, samples=114 iops : min= 9, max= 84, avg=26.33, stdev=16.12, samples=114 lat (msec) : 4=0.65%, 10=31.12%, 20=33.98%, 50=31.38%, 100=2.77% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.07%, sys=14.30%, ctx=6172, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=413KiB/s (422kB/s), 103KiB/s-104KiB/s (105kB/s-106kB/s), io=23.4MiB (24.6MB), run=57939-58203msec WRITE: bw=432KiB/s (442kB/s), 107KiB/s-110KiB/s (110kB/s-112kB/s), io=24.6MiB (25.7MB), run=57939-58203msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191878: Wed Sep 2 09:25:35 2026 read: IOPS=25, BW=409KiB/s (419kB/s)(5920KiB/14458msec) clat (usec): min=95, max=60316, avg=19818.52, stdev=9747.60 lat (usec): min=96, max=60316, avg=19819.06, stdev=9747.60 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 6915], 10.00th=[10421], 20.00th=[12649], | 30.00th=[14222], 40.00th=[16188], 50.00th=[18744], 60.00th=[20841], | 70.00th=[23200], 80.00th=[26608], 90.00th=[32375], 95.00th=[35390], | 99.00th=[56886], 99.50th=[60031], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 285, max= 572, per=24.65%, avg=404.54, stdev=75.11, samples=28 iops : min= 17, max= 35, avg=24.68, stdev= 4.77, samples=28 write: IOPS=27, BW=440KiB/s (451kB/s)(6368KiB/14458msec); 0 zone resets clat (usec): min=1824, max=81440, avg=17829.48, stdev=11331.61 lat (usec): min=1825, max=81441, avg=17835.96, stdev=11326.42 clat percentiles (usec): | 1.00th=[ 3752], 5.00th=[ 4752], 10.00th=[ 5473], 20.00th=[ 6783], | 30.00th=[10028], 40.00th=[12911], 50.00th=[15270], 60.00th=[18744], | 70.00th=[22938], 80.00th=[27657], 90.00th=[32900], 95.00th=[39584], | 99.00th=[49546], 99.50th=[52691], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 221, max= 605, per=25.48%, avg=439.79, stdev=96.28, samples=28 iops : min= 13, max= 37, avg=26.89, stdev= 5.96, samples=28 lat (usec) : 100=0.13%, 250=1.95%, 500=0.13% lat (msec) : 2=0.26%, 4=0.39%, 10=16.93%, 20=39.71%, 50=39.45% lat (msec) : 100=1.04% cpu : usr=0.10%, sys=27.90%, ctx=2882, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191879: Wed Sep 2 09:25:35 2026 read: IOPS=25, BW=403KiB/s (412kB/s)(5744KiB/14260msec) clat (usec): min=32, max=59494, avg=19655.84, stdev=9957.94 lat (usec): min=33, max=59495, avg=19656.45, stdev=9957.93 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 139], 10.00th=[10159], 20.00th=[12387], | 30.00th=[14222], 40.00th=[16319], 50.00th=[18744], 60.00th=[20841], | 70.00th=[23462], 80.00th=[26084], 90.00th=[30540], 95.00th=[38011], | 99.00th=[51119], 99.50th=[59507], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 256, max= 608, per=24.56%, avg=403.00, stdev=86.07, samples=28 iops : min= 16, max= 38, avg=24.57, stdev= 5.37, samples=28 write: IOPS=28, BW=459KiB/s (470kB/s)(6544KiB/14260msec); 0 zone resets clat (usec): min=3796, max=74911, avg=17432.59, stdev=10638.98 lat (usec): min=3797, max=74912, avg=17433.71, stdev=10639.00 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 4948], 10.00th=[ 5538], 20.00th=[ 7242], | 30.00th=[10552], 40.00th=[12649], 50.00th=[15139], 60.00th=[18220], | 70.00th=[21627], 80.00th=[25822], 90.00th=[32900], 95.00th=[36439], | 99.00th=[46924], 99.50th=[52691], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 287, max= 704, per=26.61%, avg=459.21, stdev=112.15, samples=28 iops : min= 17, max= 44, avg=28.11, stdev= 7.01, samples=28 lat (usec) : 50=0.26%, 100=0.39%, 250=1.95% lat (msec) : 4=0.26%, 10=17.06%, 20=40.49%, 50=38.54%, 100=1.04% cpu : usr=0.07%, sys=28.98%, ctx=2974, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191880: Wed Sep 2 09:25:35 2026 read: IOPS=26, BW=429KiB/s (439kB/s)(6256KiB/14593msec) clat (usec): min=89, max=64032, avg=19237.02, stdev=9788.50 lat (usec): min=90, max=64033, avg=19237.67, stdev=9788.57 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 347], 10.00th=[ 9634], 20.00th=[11994], | 30.00th=[13829], 40.00th=[15795], 50.00th=[17957], 60.00th=[20317], | 70.00th=[23200], 80.00th=[25560], 90.00th=[30540], 95.00th=[36439], | 99.00th=[56886], 99.50th=[61604], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 256, max= 764, per=26.04%, avg=427.32, stdev=118.15, samples=28 iops : min= 16, max= 47, avg=26.14, stdev= 7.36, samples=28 write: IOPS=25, BW=413KiB/s (423kB/s)(6032KiB/14593msec); 0 zone resets clat (usec): min=2088, max=60144, avg=18519.41, stdev=11121.61 lat (usec): min=2090, max=60145, avg=18520.51, stdev=11121.60 clat percentiles (usec): | 1.00th=[ 3163], 5.00th=[ 4686], 10.00th=[ 5538], 20.00th=[ 7963], | 30.00th=[11863], 40.00th=[14222], 50.00th=[16909], 60.00th=[19792], | 70.00th=[22938], 80.00th=[26608], 90.00th=[33424], 95.00th=[40633], | 99.00th=[51643], 99.50th=[58983], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 255, max= 544, per=23.16%, avg=399.75, stdev=78.12, samples=28 iops : min= 15, max= 34, avg=24.39, stdev= 4.89, samples=28 lat (usec) : 100=0.26%, 250=2.08%, 500=0.26% lat (msec) : 4=1.04%, 10=14.06%, 20=42.06%, 50=38.93%, 100=1.30% cpu : usr=0.07%, sys=27.91%, ctx=2920, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191881: Wed Sep 2 09:25:35 2026 read: IOPS=25, BW=413KiB/s (423kB/s)(6032KiB/14594msec) clat (usec): min=57, max=57893, avg=20018.64, stdev=9637.94 lat (usec): min=58, max=57893, avg=20019.19, stdev=9637.95 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 153], 10.00th=[10421], 20.00th=[13435], | 30.00th=[15008], 40.00th=[17433], 50.00th=[18744], 60.00th=[21365], | 70.00th=[23462], 80.00th=[26870], 90.00th=[32375], 95.00th=[37487], | 99.00th=[49021], 99.50th=[56361], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 223, max= 572, per=24.82%, avg=407.36, stdev=98.07, samples=28 iops : min= 13, max= 35, avg=24.86, stdev= 6.16, samples=28 write: IOPS=26, BW=429KiB/s (439kB/s)(6256KiB/14594msec); 0 zone resets clat (usec): min=1601, max=57204, avg=17833.64, stdev=10583.79 lat (usec): min=1602, max=57205, avg=17834.76, stdev=10583.88 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 4752], 10.00th=[ 5342], 20.00th=[ 7635], | 30.00th=[11338], 40.00th=[13698], 50.00th=[15795], 60.00th=[18482], | 70.00th=[21627], 80.00th=[25822], 90.00th=[33162], 95.00th=[37487], | 99.00th=[49021], 99.50th=[51119], 99.90th=[57410], 99.95th=[57410], | 99.99th=[57410] bw ( KiB/s): min= 287, max= 576, per=24.71%, avg=426.57, stdev=86.74, samples=28 iops : min= 17, max= 36, avg=26.07, stdev= 5.39, samples=28 lat (usec) : 100=1.04%, 250=1.56%, 500=0.13%, 750=0.13% lat (msec) : 2=0.13%, 4=0.39%, 10=14.06%, 20=43.49%, 50=38.28% lat (msec) : 100=0.78% cpu : usr=0.06%, sys=27.79%, ctx=2921, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1641KiB/s (1681kB/s), 403KiB/s-429KiB/s (412kB/s-439kB/s), io=23.4MiB (24.5MB), run=14260-14594msec WRITE: bw=1727KiB/s (1768kB/s), 413KiB/s-459KiB/s (423kB/s-470kB/s), io=24.6MiB (25.8MB), run=14260-14594msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191873: Wed Sep 2 09:25:36 2026 read: IOPS=23, BW=369KiB/s (378kB/s)(5920KiB/16035msec) clat (usec): min=2331, max=75089, avg=18106.00, stdev=13308.71 lat (usec): min=2332, max=75089, avg=18106.71, stdev=13308.55 clat percentiles (usec): | 1.00th=[ 2573], 5.00th=[ 4293], 10.00th=[ 5276], 20.00th=[ 6521], | 30.00th=[ 9503], 40.00th=[11207], 50.00th=[13698], 60.00th=[16909], | 70.00th=[22676], 80.00th=[28181], 90.00th=[37487], 95.00th=[47449], | 99.00th=[57934], 99.50th=[59507], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 159, max= 1152, per=23.17%, avg=345.87, stdev=201.32, samples=31 iops : min= 9, max= 72, avg=20.94, stdev=12.81, samples=31 write: IOPS=24, BW=397KiB/s (407kB/s)(6368KiB/16035msec); 0 zone resets clat (usec): min=3850, max=93989, avg=23405.85, stdev=16101.77 lat (usec): min=3851, max=93991, avg=23407.32, stdev=16101.84 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 6063], 10.00th=[ 6915], 20.00th=[ 8717], | 30.00th=[12125], 40.00th=[15664], 50.00th=[19268], 60.00th=[23987], | 70.00th=[28443], 80.00th=[36963], 90.00th=[44827], 95.00th=[55837], | 99.00th=[73925], 99.50th=[87557], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 192, max= 1248, per=23.83%, avg=374.35, stdev=220.87, samples=31 iops : min= 12, max= 78, avg=22.74, stdev=13.97, samples=31 lat (msec) : 4=2.60%, 10=25.39%, 20=30.73%, 50=35.68%, 100=5.60% cpu : usr=0.07%, sys=13.96%, ctx=1637, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191874: Wed Sep 2 09:25:36 2026 read: IOPS=22, BW=359KiB/s (368kB/s)(5744KiB/15991msec) clat (usec): min=2963, max=69782, avg=18643.76, stdev=13450.91 lat (usec): min=2964, max=69782, avg=18644.32, stdev=13450.91 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 5014], 10.00th=[ 5669], 20.00th=[ 7767], | 30.00th=[10421], 40.00th=[12256], 50.00th=[14091], 60.00th=[16057], | 70.00th=[20579], 80.00th=[29492], 90.00th=[41157], 95.00th=[46400], | 99.00th=[57934], 99.50th=[69731], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 127, max= 1056, per=23.23%, avg=346.84, stdev=181.89, samples=31 iops : min= 7, max= 66, avg=21.00, stdev=11.57, samples=31 write: IOPS=25, BW=409KiB/s (419kB/s)(6544KiB/15991msec); 0 zone resets clat (usec): min=4768, max=87010, avg=22622.19, stdev=14629.71 lat (usec): min=4769, max=87012, avg=22623.42, stdev=14629.78 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 6456], 10.00th=[ 6980], 20.00th=[ 8979], | 30.00th=[11731], 40.00th=[15008], 50.00th=[19792], 60.00th=[24511], | 70.00th=[28705], 80.00th=[33424], 90.00th=[44303], 95.00th=[50594], | 99.00th=[65274], 99.50th=[72877], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 192, max= 1280, per=24.80%, avg=389.58, stdev=235.73, samples=31 iops : min= 12, max= 80, avg=23.68, stdev=14.91, samples=31 lat (msec) : 4=0.78%, 10=24.22%, 20=33.98%, 50=36.59%, 100=4.43% cpu : usr=0.06%, sys=14.08%, ctx=1653, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191875: Wed Sep 2 09:25:36 2026 read: IOPS=24, BW=392KiB/s (402kB/s)(6256KiB/15940msec) clat (usec): min=2862, max=63958, avg=18754.65, stdev=13471.29 lat (usec): min=2863, max=63959, avg=18755.21, stdev=13471.33 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 4948], 10.00th=[ 5473], 20.00th=[ 6849], | 30.00th=[10290], 40.00th=[12256], 50.00th=[14222], 60.00th=[17433], | 70.00th=[21627], 80.00th=[28443], 90.00th=[40109], 95.00th=[48497], | 99.00th=[58459], 99.50th=[60031], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 159, max= 1504, per=25.76%, avg=384.61, stdev=264.32, samples=31 iops : min= 9, max= 94, avg=23.35, stdev=16.66, samples=31 write: IOPS=23, BW=378KiB/s (388kB/s)(6032KiB/15940msec); 0 zone resets clat (usec): min=4462, max=85903, avg=22727.91, stdev=14560.64 lat (usec): min=4463, max=85905, avg=22729.29, stdev=14560.76 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 6259], 10.00th=[ 7177], 20.00th=[ 9896], | 30.00th=[12518], 40.00th=[15139], 50.00th=[19268], 60.00th=[23462], | 70.00th=[28705], 80.00th=[35390], 90.00th=[42730], 95.00th=[49021], | 99.00th=[64226], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 159, max= 1088, per=22.95%, avg=360.55, stdev=183.67, samples=31 iops : min= 9, max= 68, avg=21.87, stdev=11.72, samples=31 lat (msec) : 4=0.91%, 10=23.96%, 20=34.38%, 50=36.72%, 100=4.04% cpu : usr=0.08%, sys=14.22%, ctx=1623, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191876: Wed Sep 2 09:25:36 2026 read: IOPS=23, BW=380KiB/s (390kB/s)(6032KiB/15854msec) clat (usec): min=3359, max=81787, avg=18413.69, stdev=13488.57 lat (usec): min=3360, max=81787, avg=18414.22, stdev=13488.59 clat percentiles (usec): | 1.00th=[ 4113], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 8160], | 30.00th=[10552], 40.00th=[11994], 50.00th=[13698], 60.00th=[16188], | 70.00th=[20055], 80.00th=[27395], 90.00th=[38011], 95.00th=[47449], | 99.00th=[59507], 99.50th=[73925], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 191, max= 1248, per=24.87%, avg=371.32, stdev=222.47, samples=31 iops : min= 11, max= 78, avg=22.52, stdev=14.12, samples=31 write: IOPS=24, BW=395KiB/s (404kB/s)(6256KiB/15854msec); 0 zone resets clat (usec): min=4864, max=84955, avg=22707.91, stdev=13975.97 lat (usec): min=4865, max=84956, avg=22709.17, stdev=13976.06 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6783], 10.00th=[ 7767], 20.00th=[10421], | 30.00th=[13566], 40.00th=[15795], 50.00th=[20579], 60.00th=[23462], | 70.00th=[27657], 80.00th=[33424], 90.00th=[40633], 95.00th=[48497], | 99.00th=[72877], 99.50th=[83362], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 159, max= 1184, per=24.79%, avg=389.45, stdev=202.44, samples=31 iops : min= 9, max= 74, avg=23.68, stdev=12.79, samples=31 lat (msec) : 4=0.39%, 10=21.74%, 20=36.98%, 50=36.85%, 100=4.04% cpu : usr=0.05%, sys=14.67%, ctx=1764, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1494KiB/s (1530kB/s), 359KiB/s-392KiB/s (368kB/s-402kB/s), io=23.4MiB (24.5MB), run=15854-16035msec WRITE: bw=1572KiB/s (1609kB/s), 378KiB/s-409KiB/s (388kB/s-419kB/s), io=24.6MiB (25.8MB), run=15854-16035msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191888: Wed Sep 2 09:25:44 2026 read: IOPS=3, BW=3733KiB/s (3823kB/s)(7168KiB/1920msec) clat (usec): min=360, max=716950, avg=153285.10, stdev=253773.11 lat (usec): min=360, max=716952, avg=153286.02, stdev=253773.66 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 388], | 30.00th=[ 43254], 40.00th=[ 43254], 50.00th=[ 63177], 60.00th=[122160], | 70.00th=[122160], 80.00th=[126354], 90.00th=[717226], 95.00th=[717226], | 99.00th=[717226], 99.50th=[717226], 99.90th=[717226], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 2003, max=10219, per=89.64%, avg=6111.00, stdev=5809.59, samples=2 iops : min= 1, max= 9, avg= 5.00, stdev= 5.66, samples=2 write: IOPS=2, BW=2667KiB/s (2731kB/s)(5120KiB/1920msec); 0 zone resets clat (msec): min=104, max=339, avg=166.80, stdev=98.10 lat (msec): min=104, max=339, avg=166.85, stdev=98.10 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2043, max= 6011, per=42.19%, avg=4027.00, stdev=2805.80, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.05%, sys=50.86%, ctx=1068, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191889: Wed Sep 2 09:25:44 2026 read: IOPS=0, BW=682KiB/s (698kB/s)(2048KiB/3004msec) clat (msec): min=154, max=275, avg=215.28, stdev=85.68 lat (msec): min=154, max=275, avg=215.28, stdev=85.68 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1675, max= 2027, per=27.15%, avg=1851.00, stdev=248.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3409KiB/s (3491kB/s)(10.0MiB/3004msec); 0 zone resets clat (msec): min=101, max=623, avg=251.97, stdev=177.17 lat (msec): min=101, max=623, avg=252.01, stdev=177.17 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 107], | 30.00th=[ 131], 40.00th=[ 133], 50.00th=[ 146], 60.00th=[ 155], | 70.00th=[ 321], 80.00th=[ 388], 90.00th=[ 422], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2027, max= 6144, per=42.61%, avg=4066.25, stdev=1681.22, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.06, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=41.49%, ctx=216, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191890: Wed Sep 2 09:25:44 2026 read: IOPS=2, BW=2243KiB/s (2297kB/s)(6144KiB/2739msec) clat (usec): min=368, max=359394, avg=171610.02, stdev=116456.48 lat (usec): min=368, max=359395, avg=171610.66, stdev=116456.62 clat percentiles (usec): | 1.00th=[ 367], 5.00th=[ 367], 10.00th=[ 367], 20.00th=[139461], | 30.00th=[139461], 40.00th=[154141], 50.00th=[154141], 60.00th=[164627], | 70.00th=[212861], 80.00th=[212861], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2003, max= 4055, per=37.22%, avg=2537.25, stdev=1012.03, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=2, BW=2243KiB/s (2297kB/s)(6144KiB/2739msec); 0 zone resets clat (msec): min=106, max=607, avg=277.77, stdev=175.12 lat (msec): min=106, max=607, avg=277.83, stdev=175.12 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 241], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2027, max= 4096, per=30.14%, avg=2876.50, stdev=1019.54, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=39.19%, ctx=585, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191891: Wed Sep 2 09:25:44 2026 read: IOPS=1, BW=2025KiB/s (2073kB/s)(5120KiB/2529msec) clat (usec): min=267, max=353168, avg=97888.41, stdev=154194.74 lat (usec): min=267, max=353169, avg=97888.82, stdev=154194.87 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 269], 10.00th=[ 269], 20.00th=[ 269], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 433], 60.00th=[ 433], | 70.00th=[135267], 80.00th=[135267], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2834KiB/s (2902kB/s)(7168KiB/2529msec); 0 zone resets clat (msec): min=112, max=766, avg=284.15, stdev=229.42 lat (msec): min=112, max=766, avg=284.21, stdev=229.42 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 138], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 190], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1667, max= 6011, per=40.22%, avg=3839.00, stdev=3071.67, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=25.00% lat (msec) : 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=38.41%, ctx=263, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6818KiB/s (6981kB/s), 682KiB/s-3733KiB/s (698kB/s-3823kB/s), io=20.0MiB (20.0MB), run=1920-3004msec WRITE: bw=9545KiB/s (9774kB/s), 2243KiB/s-3409KiB/s (2297kB/s-3491kB/s), io=28.0MiB (29.4MB), run=1920-3004msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191893: Wed Sep 2 09:25:44 2026 read: IOPS=2, BW=2272KiB/s (2326kB/s)(7168KiB/3155msec) clat (msec): min=16, max=850, avg=300.99, stdev=349.34 lat (msec): min=16, max=850, avg=300.99, stdev=349.34 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 17], 10.00th=[ 17], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 54], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 684], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1992, max= 4087, per=37.65%, avg=2443.60, stdev=918.99, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=1, BW=1623KiB/s (1662kB/s)(5120KiB/3155msec); 0 zone resets clat (msec): min=40, max=433, avg=201.92, stdev=145.07 lat (msec): min=40, max=433, avg=201.97, stdev=145.07 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1992, max= 6144, per=44.77%, avg=4068.00, stdev=2935.91, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 20=8.33%, 50=25.00%, 100=8.33%, 250=25.00%, 500=16.67% lat (msec) : 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.49%, ctx=132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191894: Wed Sep 2 09:25:44 2026 read: IOPS=0, BW=657KiB/s (673kB/s)(2048KiB/3118msec) clat (msec): min=60, max=232, avg=146.43, stdev=121.57 lat (msec): min=60, max=232, avg=146.43, stdev=121.57 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1718, max= 2043, per=28.97%, avg=1880.50, stdev=229.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3284KiB/s (3363kB/s)(10.0MiB/3118msec); 0 zone resets clat (msec): min=45, max=1120, avg=272.03, stdev=308.42 lat (msec): min=45, max=1120, avg=272.08, stdev=308.42 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 124], | 30.00th=[ 126], 40.00th=[ 150], 50.00th=[ 161], 60.00th=[ 174], | 70.00th=[ 234], 80.00th=[ 266], 90.00th=[ 326], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 2043, max= 6144, per=50.21%, avg=4562.50, stdev=1921.21, samples=4 iops : min= 1, max= 6, avg= 3.75, stdev= 2.22, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=19.15%, ctx=161, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191895: Wed Sep 2 09:25:44 2026 read: IOPS=2, BW=2071KiB/s (2120kB/s)(6144KiB/2967msec) clat (msec): min=53, max=337, avg=162.49, stdev=132.36 lat (msec): min=53, max=337, avg=162.49, stdev=132.36 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 58], | 30.00th=[ 58], 40.00th=[ 72], 50.00th=[ 72], 60.00th=[ 136], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 3984, max= 4087, per=62.17%, avg=4035.50, stdev=72.83, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2071KiB/s (2120kB/s)(6144KiB/2967msec); 0 zone resets clat (msec): min=56, max=1000, avg=323.75, stdev=339.46 lat (msec): min=56, max=1001, avg=323.81, stdev=339.47 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 228], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1992, max= 3413, per=27.32%, avg=2482.67, stdev=806.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=18.07%, ctx=273, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191896: Wed Sep 2 09:25:44 2026 read: IOPS=1, BW=1639KiB/s (1678kB/s)(5120KiB/3124msec) clat (msec): min=58, max=284, avg=136.73, stdev=89.45 lat (msec): min=58, max=284, avg=136.73, stdev=89.45 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 4087, max= 4096, per=63.03%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2294KiB/s (2350kB/s)(7168KiB/3124msec); 0 zone resets clat (msec): min=75, max=1067, avg=334.33, stdev=344.89 lat (msec): min=75, max=1067, avg=334.38, stdev=344.89 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 116], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 201], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 409], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1729, max= 6144, per=30.71%, avg=2790.20, stdev=1879.35, samples=5 iops : min= 1, max= 6, avg= 2.00, stdev= 2.24, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=13.93%, ctx=144, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6491KiB/s (6647kB/s), 657KiB/s-2272KiB/s (673kB/s-2326kB/s), io=20.0MiB (20.0MB), run=2967-3155msec WRITE: bw=9088KiB/s (9306kB/s), 1623KiB/s-3284KiB/s (1662kB/s-3363kB/s), io=28.0MiB (29.4MB), run=2967-3155msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191907: Wed Sep 2 09:25:53 2026 read: IOPS=1, BW=6104KiB/s (6251kB/s)(12.0MiB/2013msec) clat (msec): min=495, max=771, avg=636.19, stdev=137.77 lat (msec): min=495, max=771, avg=636.19, stdev=137.77 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=44.28%, ctx=2791, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191908: Wed Sep 2 09:25:53 2026 read: IOPS=0, BW=1797KiB/s (1840kB/s)(4096KiB/2279msec) clat (nsec): min=664406k, max=664406k, avg=664405612.00, stdev= 0.00 lat (nsec): min=664408k, max=664408k, avg=664407595.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3595KiB/s (3681kB/s)(8192KiB/2279msec); 0 zone resets clat (msec): min=646, max=881, avg=764.05, stdev=166.03 lat (msec): min=646, max=881, avg=764.34, stdev=166.05 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8192, max= 8192, per=60.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.09%, sys=25.68%, ctx=922, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191909: Wed Sep 2 09:25:53 2026 write: IOPS=1, BW=5109KiB/s (5232kB/s)(12.0MiB/2405msec); 0 zone resets clat (msec): min=90, max=1663, avg=781.33, stdev=803.59 lat (msec): min=91, max=1663, avg=781.63, stdev=803.63 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8192, max= 8192, per=60.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.19%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191910: Wed Sep 2 09:25:53 2026 write: IOPS=1, BW=5668KiB/s (5804kB/s)(12.0MiB/2168msec); 0 zone resets clat (msec): min=542, max=882, avg=705.66, stdev=170.54 lat (msec): min=542, max=882, avg=705.95, stdev=170.54 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8175, max= 8192, per=60.07%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.26%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7189KiB/s (7362kB/s), 1797KiB/s-6104KiB/s (1840kB/s-6251kB/s), io=16.0MiB (16.8MB), run=2013-2279msec WRITE: bw=13.3MiB/s (13.0MB/s), 3595KiB/s-5668KiB/s (3681kB/s-5804kB/s), io=32.0MiB (33.6MB), run=2168-2405msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191902: Wed Sep 2 09:25:53 2026 read: IOPS=1, BW=5483KiB/s (5615kB/s)(12.0MiB/2241msec) clat (msec): min=459, max=982, avg=737.47, stdev=263.09 lat (msec): min=459, max=982, avg=737.47, stdev=263.09 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.57%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191903: Wed Sep 2 09:25:53 2026 read: IOPS=0, BW=1599KiB/s (1637kB/s)(4096KiB/2562msec) clat (nsec): min=261457k, max=261457k, avg=261456800.00, stdev= 0.00 lat (nsec): min=261458k, max=261458k, avg=261457769.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7433, max= 7433, per=100.00%, avg=7433.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3198KiB/s (3274kB/s)(8192KiB/2562msec); 0 zone resets clat (msec): min=1083, max=1196, avg=1140.16, stdev=79.74 lat (msec): min=1083, max=1196, avg=1140.30, stdev=79.74 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8192, max= 8192, per=64.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=16.87%, ctx=113, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191904: Wed Sep 2 09:25:53 2026 write: IOPS=1, BW=4973KiB/s (5092kB/s)(12.0MiB/2471msec); 0 zone resets clat (msec): min=148, max=1529, avg=816.47, stdev=691.67 lat (msec): min=148, max=1529, avg=816.85, stdev=691.74 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8192, max= 8192, per=64.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.49%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191905: Wed Sep 2 09:25:53 2026 write: IOPS=1, BW=5810KiB/s (5949kB/s)(12.0MiB/2115msec); 0 zone resets clat (msec): min=231, max=1334, avg=696.92, stdev=571.01 lat (msec): min=231, max=1334, avg=697.24, stdev=571.01 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7488, max= 8175, per=61.23%, avg=7831.50, stdev=485.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.92%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6395KiB/s (6548kB/s), 1599KiB/s-5483KiB/s (1637kB/s-5615kB/s), io=16.0MiB (16.8MB), run=2241-2562msec WRITE: bw=12.5MiB/s (13.1MB/s), 3198KiB/s-5810KiB/s (3274kB/s-5949kB/s), io=32.0MiB (33.6MB), run=2115-2562msec