== sanity test 398b: DIO and buffer IO race ============== 23:25:28 (1784085928) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.967 s, 17.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188551: Tue Jul 14 23:26:31 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(5992KiB/53435msec) clat (usec): min=58, max=701300, avg=19120.95, stdev=20088.01 lat (usec): min=58, max=701301, avg=19126.32, stdev=20087.61 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7439], 10.00th=[ 8979], 20.00th=[ 10945], | 30.00th=[ 12911], 40.00th=[ 15139], 50.00th=[ 16909], 60.00th=[ 19006], | 70.00th=[ 21627], 80.00th=[ 25035], 90.00th=[ 31065], 95.00th=[ 36963], | 99.00th=[ 53740], 99.50th=[ 57934], 99.90th=[ 84411], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 13, max= 200, per=24.89%, avg=111.75, stdev=32.15, samples=106 iops : min= 3, max= 50, avg=27.56, stdev= 8.03, samples=106 write: IOPS=29, BW=118KiB/s (121kB/s)(6296KiB/53435msec); 0 zone resets clat (usec): min=840, max=79782, avg=15627.64, stdev=11986.33 lat (usec): min=841, max=79784, avg=15628.82, stdev=11986.37 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2606], 10.00th=[ 3195], 20.00th=[ 4359], | 30.00th=[ 8094], 40.00th=[10552], 50.00th=[12911], 60.00th=[15795], | 70.00th=[19792], 80.00th=[24249], 90.00th=[31589], 95.00th=[38536], | 99.00th=[55837], 99.50th=[61604], 99.90th=[68682], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 47, max= 224, per=25.26%, avg=118.74, stdev=35.43, samples=105 iops : min= 11, max= 56, avg=29.30, stdev= 8.90, samples=105 lat (usec) : 100=0.33%, 250=0.52%, 500=0.07%, 1000=0.23% lat (msec) : 2=1.04%, 4=7.78%, 10=16.50%, 20=41.05%, 50=30.99% lat (msec) : 100=1.46%, 750=0.03% cpu : usr=0.13%, sys=25.00%, ctx=9972, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188552: Tue Jul 14 23:26:31 2026 read: IOPS=28, BW=115KiB/s (117kB/s)(5940KiB/51772msec) clat (usec): min=39, max=80309, avg=18480.30, stdev=9420.73 lat (usec): min=40, max=80309, avg=18483.14, stdev=9420.97 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7963], 10.00th=[ 9110], 20.00th=[10945], | 30.00th=[12780], 40.00th=[14484], 50.00th=[16712], 60.00th=[18744], | 70.00th=[21365], 80.00th=[25035], 90.00th=[30802], 95.00th=[37487], | 99.00th=[47973], 99.50th=[54264], 99.90th=[66323], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 6, max= 183, per=25.53%, avg=114.64, stdev=31.98, samples=103 iops : min= 1, max= 45, avg=28.27, stdev= 7.98, samples=103 write: IOPS=30, BW=123KiB/s (126kB/s)(6348KiB/51772msec); 0 zone resets clat (usec): min=775, max=640617, avg=15192.55, stdev=19338.46 lat (usec): min=775, max=640617, avg=15193.58, stdev=19338.48 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2704], 10.00th=[ 3294], 20.00th=[ 4293], | 30.00th=[ 7177], 40.00th=[ 10028], 50.00th=[ 12256], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 30016], 95.00th=[ 35914], | 99.00th=[ 52691], 99.50th=[ 57934], 99.90th=[108528], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 216, per=26.08%, avg=122.57, stdev=36.59, samples=103 iops : min= 1, max= 54, avg=30.25, stdev= 9.17, samples=103 lat (usec) : 50=0.03%, 100=0.39%, 250=0.46%, 1000=0.33% lat (msec) : 2=0.88%, 4=8.20%, 10=17.32%, 20=41.67%, 50=29.79% lat (msec) : 100=0.88%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=25.43%, ctx=9815, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188553: Tue Jul 14 23:26:31 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(6028KiB/52401msec) clat (usec): min=50, max=96800, avg=18548.91, stdev=10111.98 lat (usec): min=50, max=96801, avg=18549.72, stdev=10112.03 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[10945], | 30.00th=[12518], 40.00th=[14746], 50.00th=[16712], 60.00th=[19006], | 70.00th=[21365], 80.00th=[24249], 90.00th=[30802], 95.00th=[36439], | 99.00th=[50070], 99.50th=[68682], 99.90th=[91751], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 39, max= 200, per=25.88%, avg=116.22, stdev=33.37, samples=103 iops : min= 9, max= 50, avg=28.67, stdev= 8.39, samples=103 write: IOPS=29, BW=119KiB/s (122kB/s)(6260KiB/52401msec); 0 zone resets clat (usec): min=865, max=659375, avg=15487.44, stdev=20194.97 lat (usec): min=866, max=659376, avg=15488.52, stdev=20195.05 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2606], 10.00th=[ 3097], 20.00th=[ 4113], | 30.00th=[ 6718], 40.00th=[ 9634], 50.00th=[ 11994], 60.00th=[ 15008], | 70.00th=[ 19268], 80.00th=[ 24249], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 51643], 99.50th=[ 55837], 99.90th=[127402], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 47, max= 190, per=25.66%, avg=120.59, stdev=33.86, samples=103 iops : min= 11, max= 47, avg=29.76, stdev= 8.51, samples=103 lat (usec) : 100=0.26%, 250=0.59%, 1000=0.23% lat (msec) : 2=1.11%, 4=8.37%, 10=18.00%, 20=39.45%, 50=30.83% lat (msec) : 100=1.11%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=25.17%, ctx=9684, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188554: Tue Jul 14 23:26:31 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/52885msec) clat (usec): min=48, max=655591, avg=19160.82, stdev=19262.22 lat (usec): min=48, max=655592, avg=19161.89, stdev=19262.38 clat percentiles (usec): | 1.00th=[ 102], 5.00th=[ 7635], 10.00th=[ 9110], 20.00th=[ 10683], | 30.00th=[ 12256], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 21890], 80.00th=[ 25297], 90.00th=[ 31589], 95.00th=[ 38536], | 99.00th=[ 50594], 99.50th=[ 62129], 99.90th=[ 85459], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 47, max= 175, per=25.70%, avg=115.40, stdev=30.67, samples=104 iops : min= 11, max= 43, avg=28.46, stdev= 7.67, samples=104 write: IOPS=29, BW=118KiB/s (121kB/s)(6236KiB/52885msec); 0 zone resets clat (usec): min=794, max=83585, avg=15196.34, stdev=11591.43 lat (usec): min=794, max=83586, avg=15198.63, stdev=11590.97 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2802], 10.00th=[ 3195], 20.00th=[ 4359], | 30.00th=[ 7242], 40.00th=[ 9896], 50.00th=[12387], 60.00th=[15926], | 70.00th=[19792], 80.00th=[23987], 90.00th=[30540], 95.00th=[37487], | 99.00th=[52691], 99.50th=[57410], 99.90th=[67634], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 26, max= 207, per=25.03%, avg=117.66, stdev=33.49, samples=105 iops : min= 6, max= 51, avg=29.03, stdev= 8.39, samples=105 lat (usec) : 50=0.03%, 100=0.42%, 250=0.85%, 1000=0.20% lat (msec) : 2=0.81%, 4=8.11%, 10=18.03%, 20=38.44%, 50=31.87% lat (msec) : 100=1.20%, 750=0.03% cpu : usr=0.13%, sys=24.89%, ctx=9721, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=449KiB/s (460kB/s), 112KiB/s-115KiB/s (115kB/s-118kB/s), io=23.4MiB (24.6MB), run=51772-53435msec WRITE: bw=470KiB/s (482kB/s), 118KiB/s-123KiB/s (121kB/s-126kB/s), io=24.6MiB (25.7MB), run=51772-53435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188556: Tue Jul 14 23:26:42 2026 read: IOPS=23, BW=93.3KiB/s (95.6kB/s)(5992KiB/64192msec) clat (msec): min=3, max=713, avg=18.85, stdev=22.04 lat (msec): min=3, max=713, avg=18.85, stdev=22.04 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 46], | 99.00th=[ 62], 99.50th=[ 67], 99.90th=[ 85], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 16, max= 278, per=24.98%, avg=93.41, stdev=49.00, samples=126 iops : min= 4, max= 69, avg=22.90, stdev=12.35, samples=126 write: IOPS=24, BW=98.1KiB/s (100kB/s)(6296KiB/64192msec); 0 zone resets clat (msec): min=5, max=118, avg=22.75, stdev=14.02 lat (msec): min=5, max=118, avg=22.75, stdev=14.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 71], 99.50th=[ 82], 99.90th=[ 93], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 24, max= 263, per=25.06%, avg=97.98, stdev=46.18, samples=126 iops : min= 6, max= 65, avg=24.05, stdev=11.66, samples=126 lat (msec) : 4=0.23%, 10=20.57%, 20=39.91%, 50=34.96%, 100=4.26% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=13.44%, ctx=6770, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188557: Tue Jul 14 23:26:42 2026 read: IOPS=23, BW=92.8KiB/s (95.0kB/s)(5940KiB/64016msec) clat (msec): min=3, max=654, avg=18.22, stdev=20.70 lat (msec): min=3, max=654, avg=18.22, stdev=20.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 62], 99.50th=[ 72], 99.90th=[ 81], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 15, max= 295, per=24.93%, avg=93.22, stdev=47.38, samples=126 iops : min= 3, max= 73, avg=22.86, stdev=11.94, samples=126 write: IOPS=24, BW=99.2KiB/s (102kB/s)(6348KiB/64016msec); 0 zone resets clat (msec): min=5, max=124, avg=23.20, stdev=14.66 lat (msec): min=5, max=124, avg=23.20, stdev=14.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 72], 99.50th=[ 91], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 23, max= 278, per=25.43%, avg=99.44, stdev=47.47, samples=126 iops : min= 5, max= 69, avg=24.41, stdev=11.99, samples=126 lat (msec) : 4=0.23%, 10=20.28%, 20=41.41%, 50=33.43%, 100=4.52% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=13.47%, ctx=6582, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188558: Tue Jul 14 23:26:42 2026 read: IOPS=23, BW=94.1KiB/s (96.3kB/s)(6028KiB/64081msec) clat (usec): min=3149, max=88440, avg=17860.52, stdev=12275.59 lat (usec): min=3149, max=88440, avg=17862.32, stdev=12274.88 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5669], 10.00th=[ 6652], 20.00th=[ 8586], | 30.00th=[10552], 40.00th=[12125], 50.00th=[14091], 60.00th=[16319], | 70.00th=[19792], 80.00th=[25297], 90.00th=[34341], 95.00th=[42730], | 99.00th=[61080], 99.50th=[68682], 99.90th=[82314], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 31, max= 287, per=25.27%, avg=94.49, stdev=48.14, samples=126 iops : min= 7, max= 71, avg=23.17, stdev=12.15, samples=126 write: IOPS=24, BW=97.7KiB/s (100kB/s)(6260KiB/64081msec); 0 zone resets clat (msec): min=5, max=654, avg=23.66, stdev=21.72 lat (msec): min=5, max=654, avg=23.66, stdev=21.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 79], 99.50th=[ 87], 99.90th=[ 113], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 31, max= 272, per=25.04%, avg=97.92, stdev=45.52, samples=126 iops : min= 7, max= 68, avg=24.03, stdev=11.49, samples=126 lat (msec) : 4=0.23%, 10=19.40%, 20=42.77%, 50=33.20%, 100=4.26% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.14%, sys=13.48%, ctx=6734, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188559: Tue Jul 14 23:26:42 2026 read: IOPS=23, BW=94.3KiB/s (96.6kB/s)(6052KiB/64144msec) clat (usec): min=3313, max=86608, avg=18141.65, stdev=12882.49 lat (usec): min=3314, max=86608, avg=18142.51, stdev=12882.49 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5669], 10.00th=[ 6521], 20.00th=[ 8455], | 30.00th=[10290], 40.00th=[11863], 50.00th=[13829], 60.00th=[16188], | 70.00th=[19792], 80.00th=[26084], 90.00th=[36963], 95.00th=[46400], | 99.00th=[60031], 99.50th=[68682], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 15, max= 304, per=25.21%, avg=94.30, stdev=46.91, samples=126 iops : min= 3, max= 76, avg=23.13, stdev=11.86, samples=126 write: IOPS=24, BW=97.2KiB/s (99.6kB/s)(6236KiB/64144msec); 0 zone resets clat (msec): min=5, max=662, avg=23.45, stdev=21.83 lat (msec): min=5, max=662, avg=23.45, stdev=21.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 86], 99.90th=[ 124], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 32, max= 270, per=24.91%, avg=97.41, stdev=45.90, samples=126 iops : min= 8, max= 67, avg=23.90, stdev=11.57, samples=126 lat (msec) : 4=0.20%, 10=19.27%, 20=42.84%, 50=33.24%, 100=4.30% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.11%, sys=13.49%, ctx=6682, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 92.8KiB/s-94.3KiB/s (95.0kB/s-96.6kB/s), io=23.4MiB (24.6MB), run=64016-64192msec WRITE: bw=392KiB/s (401kB/s), 97.2KiB/s-99.2KiB/s (99.6kB/s-102kB/s), io=24.6MiB (25.7MB), run=64016-64192msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188578: Tue Jul 14 23:27:04 2026 read: IOPS=23, BW=369KiB/s (377kB/s)(5920KiB/16061msec) clat (usec): min=35, max=70829, avg=22061.07, stdev=11228.54 lat (usec): min=36, max=70830, avg=22061.96, stdev=11228.64 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 190], 10.00th=[10814], 20.00th=[14091], | 30.00th=[16188], 40.00th=[18482], 50.00th=[20579], 60.00th=[23200], | 70.00th=[26084], 80.00th=[29754], 90.00th=[34866], 95.00th=[42206], | 99.00th=[58983], 99.50th=[64750], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 160, max= 544, per=25.47%, avg=367.06, stdev=105.79, samples=31 iops : min= 10, max= 34, avg=22.39, stdev= 6.60, samples=31 write: IOPS=24, BW=396KiB/s (406kB/s)(6368KiB/16061msec); 0 zone resets clat (usec): min=1158, max=113501, avg=19620.05, stdev=15031.86 lat (usec): min=1160, max=113504, avg=19621.73, stdev=15032.02 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 3654], 10.00th=[ 4817], 20.00th=[ 7242], | 30.00th=[ 10159], 40.00th=[ 12518], 50.00th=[ 15401], 60.00th=[ 19530], | 70.00th=[ 23987], 80.00th=[ 29492], 90.00th=[ 41681], 95.00th=[ 51119], | 99.00th=[ 65799], 99.50th=[ 80217], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 127, max= 636, per=26.34%, avg=399.26, stdev=105.57, samples=31 iops : min= 7, max= 39, avg=24.42, stdev= 6.55, samples=31 lat (usec) : 50=0.13%, 100=0.65%, 250=1.95% lat (msec) : 2=0.91%, 4=2.21%, 10=13.41%, 20=34.64%, 50=42.19% lat (msec) : 100=3.78%, 250=0.13% cpu : usr=0.08%, sys=27.19%, ctx=2939, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188579: Tue Jul 14 23:27:04 2026 read: IOPS=22, BW=357KiB/s (365kB/s)(5744KiB/16095msec) clat (usec): min=91, max=70998, avg=22412.95, stdev=12013.48 lat (usec): min=91, max=70999, avg=22413.89, stdev=12013.58 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 6849], 10.00th=[10814], 20.00th=[13566], | 30.00th=[16188], 40.00th=[18482], 50.00th=[20841], 60.00th=[22414], | 70.00th=[25560], 80.00th=[30016], 90.00th=[37487], 95.00th=[46924], | 99.00th=[66323], 99.50th=[68682], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 128, max= 542, per=24.90%, avg=358.77, stdev=105.12, samples=31 iops : min= 8, max= 33, avg=21.87, stdev= 6.48, samples=31 write: IOPS=25, BW=407KiB/s (416kB/s)(6544KiB/16095msec); 0 zone resets clat (usec): min=1564, max=77808, avg=19593.92, stdev=13412.35 lat (usec): min=1566, max=77810, avg=19596.48, stdev=13411.60 clat percentiles (usec): | 1.00th=[ 2442], 5.00th=[ 4817], 10.00th=[ 5604], 20.00th=[ 8094], | 30.00th=[10945], 40.00th=[13698], 50.00th=[16057], 60.00th=[20055], | 70.00th=[23462], 80.00th=[29230], 90.00th=[36963], 95.00th=[46400], | 99.00th=[64226], 99.50th=[73925], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 188, max= 667, per=26.69%, avg=404.55, stdev=117.05, samples=31 iops : min= 11, max= 41, avg=24.74, stdev= 7.24, samples=31 lat (usec) : 100=0.13%, 250=1.95%, 500=0.13% lat (msec) : 2=0.26%, 4=0.91%, 10=14.58%, 20=35.81%, 50=42.58% lat (msec) : 100=3.65% cpu : usr=0.13%, sys=27.69%, ctx=2890, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188580: Tue Jul 14 23:27:04 2026 read: IOPS=23, BW=378KiB/s (387kB/s)(6256KiB/16545msec) clat (usec): min=56, max=84030, avg=22744.24, stdev=13223.57 lat (usec): min=57, max=84031, avg=22745.32, stdev=13223.81 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 151], 10.00th=[ 9896], 20.00th=[12911], | 30.00th=[16057], 40.00th=[19006], 50.00th=[21365], 60.00th=[23987], | 70.00th=[26870], 80.00th=[30016], 90.00th=[38536], 95.00th=[49546], | 99.00th=[64750], 99.50th=[81265], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 160, max= 608, per=26.39%, avg=380.28, stdev=109.55, samples=32 iops : min= 10, max= 38, avg=23.25, stdev= 6.78, samples=32 write: IOPS=22, BW=365KiB/s (373kB/s)(6032KiB/16545msec); 0 zone resets clat (usec): min=1126, max=73110, avg=20119.72, stdev=13239.59 lat (usec): min=1127, max=73113, avg=20121.72, stdev=13239.83 clat percentiles (usec): | 1.00th=[ 3130], 5.00th=[ 4424], 10.00th=[ 5276], 20.00th=[ 8029], | 30.00th=[11338], 40.00th=[13829], 50.00th=[17171], 60.00th=[20841], | 70.00th=[24773], 80.00th=[31327], 90.00th=[37487], 95.00th=[46400], | 99.00th=[61604], 99.50th=[64226], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 159, max= 669, per=23.83%, avg=361.19, stdev=124.64, samples=32 iops : min= 9, max= 41, avg=22.06, stdev= 7.82, samples=32 lat (usec) : 100=0.78%, 250=2.47% lat (msec) : 2=0.26%, 4=1.30%, 10=12.89%, 20=33.33%, 50=44.92% lat (msec) : 100=4.04% cpu : usr=0.10%, sys=26.71%, ctx=2972, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188581: Tue Jul 14 23:27:04 2026 read: IOPS=22, BW=363KiB/s (372kB/s)(6032KiB/16615msec) clat (usec): min=90, max=82550, avg=22887.77, stdev=12606.13 lat (usec): min=91, max=82551, avg=22888.72, stdev=12606.24 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 153], 10.00th=[10683], 20.00th=[13566], | 30.00th=[15795], 40.00th=[19268], 50.00th=[21627], 60.00th=[25035], | 70.00th=[27132], 80.00th=[31065], 90.00th=[36963], 95.00th=[45351], | 99.00th=[64750], 99.50th=[66323], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 188, max= 512, per=25.08%, avg=361.37, stdev=87.01, samples=32 iops : min= 11, max= 32, avg=22.06, stdev= 5.47, samples=32 write: IOPS=23, BW=377KiB/s (386kB/s)(6256KiB/16615msec); 0 zone resets clat (usec): min=1322, max=75702, avg=20288.54, stdev=13251.66 lat (usec): min=1323, max=75704, avg=20290.22, stdev=13251.74 clat percentiles (usec): | 1.00th=[ 3032], 5.00th=[ 4621], 10.00th=[ 5473], 20.00th=[ 8455], | 30.00th=[11600], 40.00th=[14746], 50.00th=[17695], 60.00th=[21103], | 70.00th=[25297], 80.00th=[30540], 90.00th=[36963], 95.00th=[44827], | 99.00th=[64226], 99.50th=[73925], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 191, max= 734, per=24.82%, avg=376.31, stdev=116.71, samples=32 iops : min= 11, max= 45, avg=23.00, stdev= 7.26, samples=32 lat (usec) : 100=0.65%, 250=2.47%, 500=0.13% lat (msec) : 2=0.39%, 4=0.91%, 10=11.85%, 20=33.33%, 50=46.22% lat (msec) : 100=4.04% cpu : usr=0.08%, sys=26.54%, ctx=2936, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1442KiB/s (1476kB/s), 357KiB/s-378KiB/s (365kB/s-387kB/s), io=23.4MiB (24.5MB), run=16061-16615msec WRITE: bw=1517KiB/s (1553kB/s), 365KiB/s-407KiB/s (373kB/s-416kB/s), io=24.6MiB (25.8MB), run=16061-16615msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188583: Tue Jul 14 23:27:07 2026 read: IOPS=19, BW=320KiB/s (328kB/s)(5920KiB/18503msec) clat (usec): min=3301, max=80445, avg=21616.11, stdev=17181.39 lat (usec): min=3302, max=80446, avg=21617.11, stdev=17181.48 clat percentiles (usec): | 1.00th=[ 3687], 5.00th=[ 5342], 10.00th=[ 6128], 20.00th=[ 8160], | 30.00th=[10290], 40.00th=[12125], 50.00th=[15270], 60.00th=[19268], | 70.00th=[24249], 80.00th=[33162], 90.00th=[51119], 95.00th=[58983], | 99.00th=[73925], 99.50th=[77071], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 95, max= 1056, per=23.67%, avg=306.03, stdev=184.92, samples=36 iops : min= 5, max= 66, avg=18.47, stdev=11.71, samples=36 write: IOPS=21, BW=344KiB/s (352kB/s)(6368KiB/18503msec); 0 zone resets clat (msec): min=5, max=127, avg=26.15, stdev=17.72 lat (msec): min=5, max=127, avg=26.15, stdev=17.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 51], 95.00th=[ 63], | 99.00th=[ 86], 99.50th=[ 94], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 1024, per=24.17%, avg=328.92, stdev=188.13, samples=36 iops : min= 3, max= 64, avg=19.89, stdev=11.88, samples=36 lat (msec) : 4=0.91%, 10=20.96%, 20=32.03%, 50=35.68%, 100=10.29% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=13.56%, ctx=1689, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188584: Tue Jul 14 23:27:07 2026 read: IOPS=19, BW=310KiB/s (318kB/s)(5744KiB/18514msec) clat (msec): min=2, max=102, avg=22.05, stdev=16.23 lat (msec): min=2, max=102, avg=22.05, stdev=16.23 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 82], 99.50th=[ 84], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 126, max= 928, per=23.07%, avg=298.25, stdev=161.74, samples=36 iops : min= 7, max= 58, avg=17.97, stdev=10.20, samples=36 write: IOPS=22, BW=353KiB/s (362kB/s)(6544KiB/18514msec); 0 zone resets clat (msec): min=5, max=127, avg=25.57, stdev=17.69 lat (msec): min=5, max=127, avg=25.57, stdev=17.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 50], 95.00th=[ 63], | 99.00th=[ 83], 99.50th=[ 101], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 127, max= 1024, per=24.69%, avg=335.97, stdev=193.52, samples=36 iops : min= 7, max= 64, avg=20.36, stdev=12.27, samples=36 lat (msec) : 4=0.52%, 10=18.62%, 20=35.03%, 50=37.24%, 100=8.07% lat (msec) : 250=0.52% cpu : usr=0.08%, sys=13.71%, ctx=1814, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188585: Tue Jul 14 23:27:07 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(6256KiB/18312msec) clat (usec): min=4334, max=97251, avg=19976.14, stdev=14944.20 lat (usec): min=4335, max=97253, avg=19977.19, stdev=14944.25 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5997], 10.00th=[ 6980], 20.00th=[ 8979], | 30.00th=[10814], 40.00th=[12387], 50.00th=[14222], 60.00th=[17433], | 70.00th=[22414], 80.00th=[31065], 90.00th=[41157], 95.00th=[50070], | 99.00th=[73925], 99.50th=[93848], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 1120, per=26.26%, avg=339.56, stdev=215.80, samples=36 iops : min= 3, max= 70, avg=20.58, stdev=13.63, samples=36 write: IOPS=20, BW=329KiB/s (337kB/s)(6032KiB/18312msec); 0 zone resets clat (msec): min=5, max=115, avg=27.50, stdev=17.79 lat (msec): min=5, max=115, avg=27.50, stdev=17.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 63], | 99.00th=[ 80], 99.50th=[ 87], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 159, max= 960, per=23.75%, avg=323.28, stdev=167.68, samples=36 iops : min= 9, max= 60, avg=19.56, stdev=10.61, samples=36 lat (msec) : 10=19.14%, 20=35.68%, 50=36.59%, 100=8.46%, 250=0.13% cpu : usr=0.11%, sys=13.95%, ctx=1826, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188586: Tue Jul 14 23:27:07 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(6032KiB/18386msec) clat (usec): min=3567, max=96966, avg=20828.59, stdev=16112.19 lat (usec): min=3588, max=96967, avg=20829.68, stdev=16112.14 clat percentiles (usec): | 1.00th=[ 4113], 5.00th=[ 5276], 10.00th=[ 6325], 20.00th=[ 8291], | 30.00th=[10290], 40.00th=[12256], 50.00th=[15139], 60.00th=[19792], | 70.00th=[23462], 80.00th=[32900], 90.00th=[43779], 95.00th=[53740], | 99.00th=[73925], 99.50th=[85459], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 992, per=24.60%, avg=318.08, stdev=194.79, samples=36 iops : min= 3, max= 62, avg=19.22, stdev=12.31, samples=36 write: IOPS=21, BW=340KiB/s (348kB/s)(6256KiB/18386msec); 0 zone resets clat (msec): min=6, max=132, avg=26.64, stdev=17.16 lat (msec): min=6, max=132, avg=26.64, stdev=17.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 56], | 99.00th=[ 95], 99.50th=[ 104], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 127, max= 1024, per=24.46%, avg=332.89, stdev=174.06, samples=36 iops : min= 7, max= 64, avg=20.14, stdev=11.06, samples=36 lat (msec) : 4=0.26%, 10=19.92%, 20=31.51%, 50=40.23%, 100=7.81% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=13.91%, ctx=1788, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1294KiB/s (1325kB/s), 310KiB/s-342KiB/s (318kB/s-350kB/s), io=23.4MiB (24.5MB), run=18312-18514msec WRITE: bw=1361KiB/s (1394kB/s), 329KiB/s-353KiB/s (337kB/s-362kB/s), io=24.6MiB (25.8MB), run=18312-18514msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188598: Tue Jul 14 23:27:15 2026 read: IOPS=2, BW=2545KiB/s (2607kB/s)(7168KiB/2816msec) clat (msec): min=112, max=559, avg=186.77, stdev=164.50 lat (msec): min=112, max=559, avg=186.77, stdev=164.50 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 128], 60.00th=[ 134], | 70.00th=[ 134], 80.00th=[ 136], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1735, max= 6000, per=44.29%, avg=2920.00, stdev=2056.94, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1818KiB/s (1862kB/s)(5120KiB/2816msec); 0 zone resets clat (msec): min=125, max=870, avg=296.91, stdev=322.23 lat (msec): min=126, max=870, avg=296.96, stdev=322.23 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2000, max= 3828, per=28.38%, avg=2619.67, stdev=1046.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=83.33%, 750=8.33%, 1000=8.33% cpu : usr=0.04%, sys=45.01%, ctx=1124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188599: Tue Jul 14 23:27:15 2026 read: IOPS=0, BW=659KiB/s (675kB/s)(2048KiB/3106msec) clat (usec): min=490, max=111286, avg=55888.31, stdev=78344.64 lat (usec): min=490, max=111288, avg=55889.63, stdev=78345.75 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[111674], | 70.00th=[111674], 80.00th=[111674], 90.00th=[111674], 95.00th=[111674], | 99.00th=[111674], 99.50th=[111674], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 1747, max= 2031, per=28.65%, avg=1889.00, stdev=200.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3297KiB/s (3376kB/s)(10.0MiB/3106msec); 0 zone resets clat (msec): min=143, max=803, avg=291.19, stdev=200.77 lat (msec): min=143, max=803, avg=291.25, stdev=200.77 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 159], | 30.00th=[ 167], 40.00th=[ 182], 50.00th=[ 184], 60.00th=[ 218], | 70.00th=[ 296], 80.00th=[ 380], 90.00th=[ 384], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1914, max= 6095, per=37.75%, avg=3484.75, stdev=1973.44, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=43.03%, ctx=328, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188600: Tue Jul 14 23:27:15 2026 read: IOPS=2, BW=2529KiB/s (2590kB/s)(6144KiB/2429msec) clat (usec): min=464, max=213334, avg=77659.88, stdev=92382.94 lat (usec): min=466, max=213335, avg=77660.79, stdev=92382.86 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 586], 50.00th=[ 586], 60.00th=[ 94897], | 70.00th=[156238], 80.00th=[156238], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 3828, max= 6095, per=75.25%, avg=4961.50, stdev=1603.01, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2529KiB/s (2590kB/s)(6144KiB/2429msec); 0 zone resets clat (msec): min=150, max=785, avg=314.51, stdev=238.18 lat (msec): min=150, max=785, avg=314.57, stdev=238.18 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 249], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1914, max= 4063, per=34.18%, avg=3155.00, stdev=1112.53, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=40.44%, ctx=234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188601: Tue Jul 14 23:27:15 2026 read: IOPS=1, BW=1653KiB/s (1692kB/s)(5120KiB/3098msec) clat (usec): min=390, max=363117, avg=132153.08, stdev=148981.79 lat (usec): min=390, max=363118, avg=132154.33, stdev=148981.77 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 392], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[137364], 60.00th=[137364], | 70.00th=[158335], 80.00th=[158335], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 2031, max= 5896, per=60.12%, avg=3963.50, stdev=2732.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2314KiB/s (2369kB/s)(7168KiB/3098msec); 0 zone resets clat (msec): min=111, max=1046, avg=342.73, stdev=325.02 lat (msec): min=111, max=1046, avg=342.79, stdev=325.02 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 117], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 243], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 397], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1812, max= 4063, per=26.42%, avg=2438.50, stdev=1084.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67% lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=32.68%, ctx=491, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6594KiB/s (6752kB/s), 659KiB/s-2545KiB/s (675kB/s-2607kB/s), io=20.0MiB (20.0MB), run=2429-3106msec WRITE: bw=9231KiB/s (9453kB/s), 1818KiB/s-3297KiB/s (1862kB/s-3376kB/s), io=28.0MiB (29.4MB), run=2429-3106msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188593: Tue Jul 14 23:27:15 2026 read: IOPS=2, BW=2857KiB/s (2925kB/s)(7168KiB/2509msec) clat (msec): min=38, max=420, avg=156.82, stdev=142.84 lat (msec): min=38, max=420, avg=156.83, stdev=142.84 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 48], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 105], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 268], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2007, max= 5206, per=59.88%, avg=3769.67, stdev=1624.28, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=2041KiB/s (2090kB/s)(5120KiB/2509msec); 0 zone resets clat (msec): min=71, max=826, avg=274.27, stdev=313.70 lat (msec): min=71, max=826, avg=274.35, stdev=313.69 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1735, max= 4015, per=29.49%, avg=2599.33, stdev=1235.95, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=25.00%, 100=8.33%, 250=41.67%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=17.66%, ctx=127, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188594: Tue Jul 14 23:27:15 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(2048KiB/2716msec) clat (msec): min=44, max=112, avg=78.32, stdev=47.81 lat (msec): min=44, max=112, avg=78.33, stdev=47.81 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 45], 40.00th=[ 45], 50.00th=[ 45], 60.00th=[ 112], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 112], 95.00th=[ 112], | 99.00th=[ 112], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 1735, max= 2015, per=29.79%, avg=1875.00, stdev=197.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3770KiB/s (3861kB/s)(10.0MiB/2716msec); 0 zone resets clat (msec): min=67, max=559, avg=254.95, stdev=180.12 lat (msec): min=67, max=559, avg=255.02, stdev=180.12 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 91], 50.00th=[ 203], 60.00th=[ 284], | 70.00th=[ 326], 80.00th=[ 359], 90.00th=[ 498], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2007, max= 6144, per=40.17%, avg=3540.20, stdev=1703.14, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 1.87, samples=5 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.04%, sys=17.94%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188595: Tue Jul 14 23:27:15 2026 read: IOPS=1, BW=1889KiB/s (1934kB/s)(6144KiB/3253msec) clat (msec): min=37, max=907, avg=228.28, stdev=337.41 lat (msec): min=37, max=907, avg=228.28, stdev=337.41 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 87], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2015, max= 4015, per=42.77%, avg=2692.67, stdev=1145.29, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1889KiB/s (1934kB/s)(6144KiB/3253msec); 0 zone resets clat (msec): min=58, max=960, avg=309.36, stdev=344.88 lat (msec): min=58, max=960, avg=309.43, stdev=344.87 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 305], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2048, max= 4015, per=36.03%, avg=3176.00, stdev=1014.85, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 50=8.33%, 100=50.00%, 250=8.33%, 500=16.67%, 1000=16.67% cpu : usr=0.00%, sys=14.21%, ctx=131, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188596: Tue Jul 14 23:27:15 2026 read: IOPS=1, BW=1842KiB/s (1887kB/s)(5120KiB/2779msec) clat (msec): min=56, max=240, avg=148.50, stdev=83.07 lat (msec): min=56, max=240, avg=148.50, stdev=83.07 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 2007, max= 6047, per=63.97%, avg=4027.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2579KiB/s (2641kB/s)(7168KiB/2779msec); 0 zone resets clat (msec): min=89, max=864, avg=285.81, stdev=277.25 lat (msec): min=89, max=864, avg=285.88, stdev=277.26 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 106], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 199], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 405], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1729, max= 4096, per=33.72%, avg=2972.00, stdev=1258.31, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=25.00%, 250=58.33%, 500=8.33%, 1000=8.33% cpu : usr=0.04%, sys=18.36%, ctx=225, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6296KiB/s (6447kB/s), 754KiB/s-2857KiB/s (772kB/s-2925kB/s), io=20.0MiB (20.0MB), run=2509-3253msec WRITE: bw=8814KiB/s (9026kB/s), 1889KiB/s-3770KiB/s (1934kB/s-3861kB/s), io=28.0MiB (29.4MB), run=2509-3253msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188608: Tue Jul 14 23:27:24 2026 read: IOPS=1, BW=7376KiB/s (7553kB/s)(12.0MiB/1666msec) clat (msec): min=383, max=625, avg=502.48, stdev=120.77 lat (msec): min=383, max=625, avg=502.48, stdev=120.77 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=19.10%, ctx=84, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188611: Tue Jul 14 23:27:24 2026 read: IOPS=0, BW=1921KiB/s (1967kB/s)(4096KiB/2132msec) clat (nsec): min=1500.9M, max=1500.9M, avg=1500901379.00, stdev= 0.00 lat (nsec): min=1500.9M, max=1500.9M, avg=1500903695.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] write: IOPS=0, BW=3842KiB/s (3935kB/s)(8192KiB/2132msec); 0 zone resets clat (msec): min=203, max=254, avg=228.94, stdev=35.88 lat (msec): min=203, max=254, avg=229.34, stdev=35.90 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.71%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188612: Tue Jul 14 23:27:24 2026 write: IOPS=1, BW=5560KiB/s (5694kB/s)(12.0MiB/2210msec); 0 zone resets clat (msec): min=277, max=1158, avg=671.61, stdev=447.53 lat (msec): min=277, max=1158, avg=671.90, stdev=447.61 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=55.25%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.61%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188614: Tue Jul 14 23:27:24 2026 write: IOPS=1, BW=6554KiB/s (6711kB/s)(12.0MiB/1875msec); 0 zone resets clat (msec): min=138, max=1273, avg=562.15, stdev=619.47 lat (msec): min=139, max=1273, avg=562.45, stdev=619.48 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min=11994, max=11994, per=80.89%, avg=11994.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.64%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7685KiB/s (7869kB/s), 1921KiB/s-7376KiB/s (1967kB/s-7553kB/s), io=16.0MiB (16.8MB), run=1666-2132msec WRITE: bw=14.5MiB/s (15.2MB/s), 3842KiB/s-6554KiB/s (3935kB/s-6711kB/s), io=32.0MiB (33.6MB), run=1875-2210msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188607: Tue Jul 14 23:27:25 2026 read: IOPS=1, BW=7349KiB/s (7526kB/s)(12.0MiB/1672msec) clat (msec): min=410, max=574, avg=491.30, stdev=82.17 lat (msec): min=410, max=574, avg=491.30, stdev=82.17 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8192, max= 8192, per=88.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=44.70%, ctx=2497, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188609: Tue Jul 14 23:27:25 2026 read: IOPS=0, BW=2327KiB/s (2383kB/s)(4096KiB/1760msec) clat (nsec): min=577415k, max=577415k, avg=577415324.00, stdev= 0.00 lat (nsec): min=577419k, max=577419k, avg=577418574.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8192, max= 8192, per=88.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4655KiB/s (4766kB/s)(8192KiB/1760msec); 0 zone resets clat (msec): min=383, max=607, avg=495.80, stdev=158.58 lat (msec): min=384, max=608, avg=496.14, stdev=158.54 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8192, max= 8192, per=62.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=30.93%, ctx=845, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188610: Tue Jul 14 23:27:25 2026 write: IOPS=1, BW=4947KiB/s (5066kB/s)(12.0MiB/2484msec); 0 zone resets clat (msec): min=72, max=2079, avg=746.04, stdev=1154.84 lat (msec): min=73, max=2079, avg=746.35, stdev=1154.72 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 86], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] lat (msec) : 100=66.67%, >=2000=33.33% cpu : usr=0.08%, sys=11.64%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188613: Tue Jul 14 23:27:25 2026 write: IOPS=1, BW=6053KiB/s (6198kB/s)(12.0MiB/2030msec); 0 zone resets clat (msec): min=179, max=1328, avg=629.61, stdev=613.59 lat (msec): min=179, max=1328, avg=629.91, stdev=613.57 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 6681, max= 8192, per=56.38%, avg=7436.50, stdev=1068.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.28%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9309KiB/s (9533kB/s), 2327KiB/s-7349KiB/s (2383kB/s-7526kB/s), io=16.0MiB (16.8MB), run=1672-1760msec WRITE: bw=12.9MiB/s (13.5MB/s), 4655KiB/s-6053KiB/s (4766kB/s-6198kB/s), io=32.0MiB (33.6MB), run=1760-2484msec