== sanity test 398b: DIO and buffer IO race ============== 16:42:15 (1784407335) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.39993 s, 21.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183092: Sat Jul 18 16:43:17 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(5992KiB/53389msec) clat (usec): min=28, max=800620, avg=19436.03, stdev=22392.42 lat (usec): min=29, max=800620, avg=19436.61, stdev=22392.43 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 7570], 10.00th=[ 8979], 20.00th=[ 11076], | 30.00th=[ 13042], 40.00th=[ 15139], 50.00th=[ 17433], 60.00th=[ 19792], | 70.00th=[ 22152], 80.00th=[ 25560], 90.00th=[ 31327], 95.00th=[ 38011], | 99.00th=[ 50070], 99.50th=[ 53740], 99.90th=[ 80217], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 6, max= 208, per=25.03%, avg=112.15, stdev=34.86, samples=106 iops : min= 1, max= 52, avg=27.63, stdev= 8.82, samples=106 write: IOPS=29, BW=118KiB/s (121kB/s)(6296KiB/53389msec); 0 zone resets clat (usec): min=648, max=74757, avg=15313.66, stdev=11165.18 lat (usec): min=648, max=74758, avg=15316.30, stdev=11169.41 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2737], 10.00th=[ 3261], 20.00th=[ 4817], | 30.00th=[ 7898], 40.00th=[10421], 50.00th=[12649], 60.00th=[15926], | 70.00th=[19530], 80.00th=[23987], 90.00th=[31589], 95.00th=[36439], | 99.00th=[49546], 99.50th=[53216], 99.90th=[71828], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 39, max= 232, per=25.29%, avg=118.88, stdev=38.84, samples=105 iops : min= 9, max= 58, avg=29.31, stdev= 9.82, samples=105 lat (usec) : 50=0.10%, 100=0.23%, 250=0.52%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=0.88%, 4=6.93%, 10=17.87%, 20=39.91%, 50=32.29% lat (msec) : 100=0.94%, 1000=0.03% cpu : usr=0.10%, sys=26.02%, ctx=9984, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183093: Sat Jul 18 16:43:17 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(5940KiB/52611msec) clat (usec): min=67, max=72457, avg=18665.81, stdev=9532.77 lat (usec): min=68, max=72459, avg=18666.40, stdev=9532.83 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 7570], 10.00th=[ 9110], 20.00th=[11076], | 30.00th=[12780], 40.00th=[14877], 50.00th=[16909], 60.00th=[19006], | 70.00th=[21627], 80.00th=[25297], 90.00th=[30802], 95.00th=[36439], | 99.00th=[50594], 99.50th=[54264], 99.90th=[70779], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 6, max= 207, per=25.14%, avg=112.61, stdev=34.51, samples=104 iops : min= 1, max= 51, avg=27.75, stdev= 8.69, samples=104 write: IOPS=30, BW=121KiB/s (124kB/s)(6348KiB/52611msec); 0 zone resets clat (usec): min=673, max=786339, avg=15582.70, stdev=22253.53 lat (usec): min=673, max=786340, avg=15583.42, stdev=22253.53 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2802], 10.00th=[ 3326], 20.00th=[ 4948], | 30.00th=[ 7898], 40.00th=[ 10421], 50.00th=[ 12911], 60.00th=[ 15401], | 70.00th=[ 18744], 80.00th=[ 23725], 90.00th=[ 30016], 95.00th=[ 34866], | 99.00th=[ 51643], 99.50th=[ 58459], 99.90th=[ 91751], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 39, max= 238, per=25.80%, avg=121.27, stdev=38.79, samples=103 iops : min= 9, max= 59, avg=29.91, stdev= 9.80, samples=103 lat (usec) : 100=0.42%, 250=0.49%, 750=0.07%, 1000=0.13% lat (msec) : 2=0.55%, 4=7.52%, 10=17.15%, 20=42.19%, 50=30.34% lat (msec) : 100=1.11%, 1000=0.03% cpu : usr=0.10%, sys=26.21%, ctx=9807, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183094: Sat Jul 18 16:43:17 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6028KiB/52904msec) clat (usec): min=76, max=793041, avg=19130.04, stdev=22409.11 lat (usec): min=76, max=793042, avg=19130.65, stdev=22409.14 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[ 10421], | 30.00th=[ 12518], 40.00th=[ 14484], 50.00th=[ 16581], 60.00th=[ 19006], | 70.00th=[ 21627], 80.00th=[ 25297], 90.00th=[ 31589], 95.00th=[ 38536], | 99.00th=[ 52691], 99.50th=[ 61604], 99.90th=[ 69731], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 6, max= 199, per=25.41%, avg=113.83, stdev=35.88, samples=105 iops : min= 1, max= 49, avg=28.05, stdev= 9.04, samples=105 write: IOPS=29, BW=118KiB/s (121kB/s)(6260KiB/52904msec); 0 zone resets clat (usec): min=690, max=74117, avg=15276.02, stdev=11055.48 lat (usec): min=690, max=74117, avg=15280.19, stdev=11054.84 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2704], 10.00th=[ 3163], 20.00th=[ 4817], | 30.00th=[ 7570], 40.00th=[10552], 50.00th=[13173], 60.00th=[15926], | 70.00th=[19530], 80.00th=[23987], 90.00th=[30802], 95.00th=[36439], | 99.00th=[49021], 99.50th=[54264], 99.90th=[63177], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 19, max= 247, per=25.13%, avg=118.12, stdev=40.18, samples=105 iops : min= 4, max= 61, avg=29.12, stdev=10.15, samples=105 lat (usec) : 100=0.36%, 250=0.65%, 500=0.10%, 750=0.03%, 1000=0.16% lat (msec) : 2=0.62%, 4=7.62%, 10=18.39%, 20=39.19%, 50=31.71% lat (msec) : 100=1.14%, 1000=0.03% cpu : usr=0.10%, sys=25.85%, ctx=9788, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183095: Sat Jul 18 16:43:17 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53485msec) clat (usec): min=41, max=79481, avg=18807.68, stdev=10100.04 lat (usec): min=42, max=79481, avg=18808.45, stdev=10100.14 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 6980], 10.00th=[ 8586], 20.00th=[10814], | 30.00th=[12911], 40.00th=[15008], 50.00th=[16909], 60.00th=[19268], | 70.00th=[21890], 80.00th=[25560], 90.00th=[32113], 95.00th=[38011], | 99.00th=[52691], 99.50th=[55837], 99.90th=[64226], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 31, max= 208, per=25.38%, avg=113.71, stdev=32.73, samples=105 iops : min= 7, max= 52, avg=28.02, stdev= 8.29, samples=105 write: IOPS=29, BW=117KiB/s (119kB/s)(6236KiB/53485msec); 0 zone resets clat (usec): min=769, max=767352, avg=15941.02, stdev=22109.22 lat (usec): min=769, max=767354, avg=15941.77, stdev=22109.27 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2868], 10.00th=[ 3359], 20.00th=[ 5145], | 30.00th=[ 8094], 40.00th=[ 10421], 50.00th=[ 13042], 60.00th=[ 15926], | 70.00th=[ 19268], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 37487], | 99.00th=[ 48497], 99.50th=[ 57410], 99.90th=[ 86508], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 39, max= 224, per=24.95%, avg=117.25, stdev=38.52, samples=105 iops : min= 9, max= 56, avg=28.91, stdev= 9.74, samples=105 lat (usec) : 50=0.03%, 100=0.33%, 250=0.75%, 500=0.07%, 1000=0.23% lat (msec) : 2=0.39%, 4=7.13%, 10=17.97%, 20=40.72%, 50=31.18% lat (msec) : 100=1.17%, 1000=0.03% cpu : usr=0.09%, sys=25.95%, ctx=10001, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=449KiB/s (460kB/s), 112KiB/s-114KiB/s (115kB/s-117kB/s), io=23.4MiB (24.6MB), run=52611-53485msec WRITE: bw=470KiB/s (481kB/s), 117KiB/s-121KiB/s (119kB/s-124kB/s), io=24.6MiB (25.7MB), run=52611-53485msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183087: Sat Jul 18 16:43:22 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(5992KiB/58501msec) clat (msec): min=2, max=802, avg=17.20, stdev=24.00 lat (msec): min=2, max=802, avg=17.20, stdev=24.00 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 43], | 99.00th=[ 61], 99.50th=[ 66], 99.90th=[ 85], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 24, max= 376, per=24.95%, avg=102.30, stdev=77.01, samples=115 iops : min= 6, max= 94, avg=25.22, stdev=19.37, samples=115 write: IOPS=26, BW=108KiB/s (110kB/s)(6296KiB/58501msec); 0 zone resets clat (msec): min=3, max=112, avg=20.68, stdev=14.26 lat (msec): min=3, max=112, avg=20.68, stdev=14.26 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 47], | 99.00th=[ 63], 99.50th=[ 68], 99.90th=[ 94], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 15, max= 448, per=24.95%, avg=107.05, stdev=79.78, samples=115 iops : min= 3, max= 112, avg=26.40, stdev=20.06, samples=115 lat (msec) : 4=2.64%, 10=31.15%, 20=28.74%, 50=34.21%, 100=3.19% lat (msec) : 250=0.03%, 1000=0.03% cpu : usr=0.09%, sys=14.71%, ctx=6530, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183088: Sat Jul 18 16:43:22 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58358msec) clat (msec): min=2, max=751, avg=17.39, stdev=23.26 lat (msec): min=2, max=751, avg=17.39, stdev=23.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 62], 99.50th=[ 71], 99.90th=[ 84], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 416, per=24.99%, avg=102.44, stdev=79.19, samples=115 iops : min= 1, max= 104, avg=25.25, stdev=19.91, samples=115 write: IOPS=27, BW=109KiB/s (111kB/s)(6348KiB/58358msec); 0 zone resets clat (msec): min=4, max=105, avg=20.36, stdev=14.40 lat (msec): min=4, max=105, avg=20.36, stdev=14.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 40], 95.00th=[ 49], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 102], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 31, max= 424, per=25.45%, avg=109.20, stdev=79.62, samples=115 iops : min= 7, max= 106, avg=26.94, stdev=20.03, samples=115 lat (msec) : 4=1.89%, 10=31.97%, 20=29.30%, 50=33.24%, 100=3.52% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.08%, sys=14.58%, ctx=6433, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183089: Sat Jul 18 16:43:22 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6028KiB/58286msec) clat (usec): min=3062, max=85894, avg=16953.83, stdev=13145.26 lat (usec): min=3062, max=85895, avg=16954.49, stdev=13145.32 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4228], 10.00th=[ 4621], 20.00th=[ 5342], | 30.00th=[ 7898], 40.00th=[10683], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20579], 80.00th=[26608], 90.00th=[35390], 95.00th=[42730], | 99.00th=[60556], 99.50th=[67634], 99.90th=[80217], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 31, max= 392, per=24.97%, avg=102.37, stdev=75.47, samples=114 iops : min= 7, max= 98, avg=25.23, stdev=18.99, samples=114 write: IOPS=26, BW=107KiB/s (110kB/s)(6260KiB/58286msec); 0 zone resets clat (msec): min=4, max=753, avg=20.78, stdev=23.21 lat (msec): min=4, max=753, avg=20.78, stdev=23.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 64], 99.50th=[ 70], 99.90th=[ 111], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 24, max= 392, per=24.70%, avg=105.96, stdev=71.55, samples=114 iops : min= 6, max= 98, avg=26.12, stdev=17.99, samples=114 lat (msec) : 4=1.46%, 10=32.10%, 20=29.46%, 50=33.63%, 100=3.26% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.09%, sys=14.68%, ctx=6717, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183091: Sat Jul 18 16:43:22 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6052KiB/58526msec) clat (usec): min=2230, max=82065, avg=16897.37, stdev=13153.51 lat (usec): min=2230, max=82065, avg=16897.98, stdev=13153.57 clat percentiles (usec): | 1.00th=[ 3130], 5.00th=[ 3949], 10.00th=[ 4490], 20.00th=[ 5276], | 30.00th=[ 7439], 40.00th=[10552], 50.00th=[13304], 60.00th=[16057], | 70.00th=[20317], 80.00th=[26870], 90.00th=[35390], 95.00th=[44303], | 99.00th=[58983], 99.50th=[66323], 99.90th=[77071], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 31, max= 400, per=25.07%, avg=102.79, stdev=76.96, samples=115 iops : min= 7, max= 100, avg=25.34, stdev=19.34, samples=115 write: IOPS=26, BW=107KiB/s (109kB/s)(6236KiB/58526msec); 0 zone resets clat (msec): min=3, max=763, avg=21.01, stdev=23.73 lat (msec): min=3, max=763, avg=21.01, stdev=23.73 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 49], | 99.00th=[ 66], 99.50th=[ 74], 99.90th=[ 108], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 31, max= 400, per=24.68%, avg=105.86, stdev=78.94, samples=115 iops : min= 7, max= 100, avg=26.10, stdev=19.86, samples=115 lat (msec) : 4=2.93%, 10=31.41%, 20=28.39%, 50=33.92%, 100=3.26% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.09%, sys=14.54%, ctx=6485, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=410KiB/s (420kB/s), 102KiB/s-103KiB/s (104kB/s-106kB/s), io=23.4MiB (24.6MB), run=58286-58526msec WRITE: bw=430KiB/s (440kB/s), 107KiB/s-109KiB/s (109kB/s-111kB/s), io=24.6MiB (25.7MB), run=58286-58526msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183114: Sat Jul 18 16:43:43 2026 read: IOPS=24, BW=391KiB/s (401kB/s)(5920KiB/15130msec) clat (usec): min=52, max=63540, avg=20812.25, stdev=10497.64 lat (usec): min=53, max=63541, avg=20812.92, stdev=10497.66 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 326], 10.00th=[10683], 20.00th=[12780], | 30.00th=[15401], 40.00th=[17171], 50.00th=[19792], 60.00th=[22152], | 70.00th=[24511], 80.00th=[27657], 90.00th=[33162], 95.00th=[39584], | 99.00th=[53216], 99.50th=[62653], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 192, max= 638, per=24.66%, avg=383.93, stdev=100.41, samples=29 iops : min= 12, max= 39, avg=23.55, stdev= 6.09, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6368KiB/15130msec); 0 zone resets clat (usec): min=1170, max=76263, avg=18512.21, stdev=11956.57 lat (usec): min=1171, max=76264, avg=18514.91, stdev=11958.68 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 4948], 10.00th=[ 5735], 20.00th=[ 7898], | 30.00th=[10814], 40.00th=[13042], 50.00th=[15401], 60.00th=[18220], | 70.00th=[23462], 80.00th=[28443], 90.00th=[34866], 95.00th=[40633], | 99.00th=[58983], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 191, max= 574, per=25.66%, avg=420.28, stdev=87.34, samples=29 iops : min= 11, max= 35, avg=25.83, stdev= 5.51, samples=29 lat (usec) : 100=0.39%, 250=1.95%, 500=0.13% lat (msec) : 2=0.39%, 4=0.39%, 10=14.71%, 20=39.71%, 50=40.76% lat (msec) : 100=1.56% cpu : usr=0.05%, sys=28.51%, ctx=3187, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183115: Sat Jul 18 16:43:43 2026 read: IOPS=24, BW=388KiB/s (398kB/s)(5744KiB/14797msec) clat (usec): min=95, max=69487, avg=21116.81, stdev=10388.04 lat (usec): min=95, max=69489, avg=21117.50, stdev=10388.07 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 7177], 10.00th=[10552], 20.00th=[13698], | 30.00th=[15664], 40.00th=[17695], 50.00th=[20055], 60.00th=[21627], | 70.00th=[24249], 80.00th=[28181], 90.00th=[33817], 95.00th=[41157], | 99.00th=[53216], 99.50th=[55837], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 224, max= 608, per=24.94%, avg=388.34, stdev=90.33, samples=29 iops : min= 14, max= 38, avg=23.83, stdev= 5.70, samples=29 write: IOPS=27, BW=442KiB/s (453kB/s)(6544KiB/14797msec); 0 zone resets clat (usec): min=2039, max=65996, avg=17523.02, stdev=11220.50 lat (usec): min=2040, max=65999, avg=17524.73, stdev=11220.12 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 4752], 10.00th=[ 5473], 20.00th=[ 7570], | 30.00th=[10290], 40.00th=[12518], 50.00th=[15008], 60.00th=[17957], | 70.00th=[21890], 80.00th=[25822], 90.00th=[32637], 95.00th=[36963], | 99.00th=[54264], 99.50th=[60556], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 192, max= 796, per=26.92%, avg=440.97, stdev=128.40, samples=29 iops : min= 12, max= 49, avg=27.10, stdev= 7.99, samples=29 lat (usec) : 100=0.26%, 250=1.82% lat (msec) : 2=0.13%, 4=0.91%, 10=16.02%, 20=39.58%, 50=39.58% lat (msec) : 100=1.69% cpu : usr=0.05%, sys=29.23%, ctx=3185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183116: Sat Jul 18 16:43:43 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(6256KiB/15380msec) clat (usec): min=69, max=65625, avg=21267.68, stdev=10831.14 lat (usec): min=70, max=65626, avg=21272.89, stdev=10827.65 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 8029], 10.00th=[11338], 20.00th=[13173], | 30.00th=[15533], 40.00th=[17433], 50.00th=[20055], 60.00th=[22152], | 70.00th=[24511], 80.00th=[28181], 90.00th=[34341], 95.00th=[41681], | 99.00th=[57934], 99.50th=[65274], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 256, max= 640, per=26.05%, avg=405.57, stdev=94.19, samples=30 iops : min= 16, max= 40, avg=24.90, stdev= 5.86, samples=30 write: IOPS=24, BW=392KiB/s (402kB/s)(6032KiB/15380msec); 0 zone resets clat (usec): min=1068, max=65230, avg=18598.24, stdev=11686.04 lat (usec): min=1069, max=65232, avg=18599.53, stdev=11686.00 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 5211], 10.00th=[ 5800], 20.00th=[ 8586], | 30.00th=[10814], 40.00th=[13173], 50.00th=[16057], 60.00th=[19006], | 70.00th=[21890], 80.00th=[27657], 90.00th=[35914], 95.00th=[42206], | 99.00th=[50594], 99.50th=[62653], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 96, max= 578, per=23.46%, avg=384.30, stdev=119.20, samples=30 iops : min= 6, max= 36, avg=23.60, stdev= 7.44, samples=30 lat (usec) : 100=0.13%, 250=2.34% lat (msec) : 2=0.13%, 4=0.91%, 10=13.93%, 20=39.19%, 50=41.93% lat (msec) : 100=1.43% cpu : usr=0.08%, sys=27.99%, ctx=3202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183117: Sat Jul 18 16:43:43 2026 read: IOPS=25, BW=411KiB/s (421kB/s)(6032KiB/14681msec) clat (usec): min=67, max=73656, avg=20491.31, stdev=10930.15 lat (usec): min=68, max=73657, avg=20492.18, stdev=10930.04 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 127], 10.00th=[ 9372], 20.00th=[12649], | 30.00th=[15270], 40.00th=[17695], 50.00th=[19792], 60.00th=[22152], | 70.00th=[24511], 80.00th=[27919], 90.00th=[32375], 95.00th=[38536], | 99.00th=[60031], 99.50th=[68682], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 224, max= 576, per=26.18%, avg=407.62, stdev=99.88, samples=29 iops : min= 14, max= 36, avg=25.03, stdev= 6.22, samples=29 write: IOPS=26, BW=426KiB/s (436kB/s)(6256KiB/14681msec); 0 zone resets clat (usec): min=1023, max=62037, avg=17732.28, stdev=11134.28 lat (usec): min=1024, max=62039, avg=17733.38, stdev=11134.30 clat percentiles (usec): | 1.00th=[ 3097], 5.00th=[ 4621], 10.00th=[ 5669], 20.00th=[ 7635], | 30.00th=[10814], 40.00th=[13042], 50.00th=[15139], 60.00th=[18220], | 70.00th=[22414], 80.00th=[26608], 90.00th=[32900], 95.00th=[39060], | 99.00th=[57410], 99.50th=[62129], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 190, max= 640, per=25.92%, avg=424.55, stdev=113.51, samples=29 iops : min= 11, max= 40, avg=26.07, stdev= 7.18, samples=29 lat (usec) : 100=0.65%, 250=2.99% lat (msec) : 2=0.39%, 4=0.52%, 10=14.84%, 20=39.06%, 50=40.10% lat (msec) : 100=1.43% cpu : usr=0.07%, sys=28.45%, ctx=3017, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1557KiB/s (1595kB/s), 388KiB/s-411KiB/s (398kB/s-421kB/s), io=23.4MiB (24.5MB), run=14681-15380msec WRITE: bw=1638KiB/s (1678kB/s), 392KiB/s-442KiB/s (402kB/s-453kB/s), io=24.6MiB (25.8MB), run=14681-15380msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183119: Sat Jul 18 16:43:45 2026 read: IOPS=21, BW=351KiB/s (359kB/s)(5920KiB/16870msec) clat (usec): min=4355, max=92946, avg=19833.33, stdev=13794.82 lat (usec): min=4355, max=92947, avg=19834.04, stdev=13794.85 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 6063], 10.00th=[ 6849], 20.00th=[ 8979], | 30.00th=[11207], 40.00th=[12518], 50.00th=[14484], 60.00th=[17695], | 70.00th=[23462], 80.00th=[30802], 90.00th=[41157], 95.00th=[46924], | 99.00th=[63177], 99.50th=[68682], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 128, max= 992, per=24.51%, avg=344.88, stdev=179.51, samples=33 iops : min= 8, max= 62, avg=21.12, stdev=11.36, samples=33 write: IOPS=23, BW=377KiB/s (387kB/s)(6368KiB/16870msec); 0 zone resets clat (usec): min=5982, max=84667, avg=23792.85, stdev=14350.39 lat (usec): min=5983, max=84668, avg=23794.15, stdev=14350.45 clat percentiles (usec): | 1.00th=[ 6652], 5.00th=[ 7767], 10.00th=[ 8979], 20.00th=[11731], | 30.00th=[13829], 40.00th=[16712], 50.00th=[20055], 60.00th=[23725], | 70.00th=[28967], 80.00th=[34866], 90.00th=[43779], 95.00th=[51643], | 99.00th=[70779], 99.50th=[81265], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 159, max= 1056, per=25.41%, avg=376.09, stdev=189.16, samples=33 iops : min= 9, max= 66, avg=23.09, stdev=12.00, samples=33 lat (msec) : 10=17.71%, 20=38.80%, 50=38.28%, 100=5.21% cpu : usr=0.09%, sys=15.02%, ctx=1834, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183120: Sat Jul 18 16:43:45 2026 read: IOPS=21, BW=338KiB/s (346kB/s)(5744KiB/16976msec) clat (usec): min=4361, max=83859, avg=20370.89, stdev=13680.71 lat (usec): min=4362, max=83860, avg=20371.61, stdev=13680.66 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5997], 10.00th=[ 7177], 20.00th=[ 9241], | 30.00th=[11600], 40.00th=[13435], 50.00th=[15533], 60.00th=[19006], | 70.00th=[23987], 80.00th=[31851], 90.00th=[40109], 95.00th=[46924], | 99.00th=[66323], 99.50th=[70779], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 158, max= 800, per=23.61%, avg=332.15, stdev=146.24, samples=33 iops : min= 9, max= 50, avg=20.33, stdev= 9.29, samples=33 write: IOPS=24, BW=385KiB/s (395kB/s)(6544KiB/16976msec); 0 zone resets clat (usec): min=5469, max=91603, avg=23429.45, stdev=14340.80 lat (usec): min=5470, max=91604, avg=23430.71, stdev=14340.86 clat percentiles (usec): | 1.00th=[ 6652], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[11076], | 30.00th=[13304], 40.00th=[15664], 50.00th=[20317], 60.00th=[24249], | 70.00th=[29230], 80.00th=[34866], 90.00th=[41681], 95.00th=[50070], | 99.00th=[65799], 99.50th=[73925], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 127, max= 1184, per=25.31%, avg=374.61, stdev=203.97, samples=33 iops : min= 7, max= 74, avg=23.00, stdev=12.91, samples=33 lat (msec) : 10=18.10%, 20=36.98%, 50=40.76%, 100=4.17% cpu : usr=0.08%, sys=14.66%, ctx=1901, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183121: Sat Jul 18 16:43:45 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(6256KiB/16891msec) clat (usec): min=3597, max=84003, avg=20333.44, stdev=14029.16 lat (usec): min=3598, max=84004, avg=20334.13, stdev=14029.14 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5800], 10.00th=[ 6652], 20.00th=[ 8717], | 30.00th=[10814], 40.00th=[13304], 50.00th=[15795], 60.00th=[19792], | 70.00th=[24511], 80.00th=[31065], 90.00th=[41681], 95.00th=[49021], | 99.00th=[66323], 99.50th=[73925], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 128, max= 1312, per=26.11%, avg=367.42, stdev=225.12, samples=33 iops : min= 8, max= 82, avg=22.55, stdev=14.16, samples=33 write: IOPS=22, BW=357KiB/s (366kB/s)(6032KiB/16891msec); 0 zone resets clat (usec): min=5935, max=77867, avg=23492.87, stdev=13953.90 lat (usec): min=5936, max=77868, avg=23494.53, stdev=13954.06 clat percentiles (usec): | 1.00th=[ 6652], 5.00th=[ 8029], 10.00th=[ 9372], 20.00th=[11600], | 30.00th=[13829], 40.00th=[15926], 50.00th=[19792], 60.00th=[24249], | 70.00th=[28705], 80.00th=[33162], 90.00th=[43254], 95.00th=[50070], | 99.00th=[69731], 99.50th=[72877], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 158, max= 832, per=23.66%, avg=350.18, stdev=167.84, samples=33 iops : min= 9, max= 52, avg=21.45, stdev=10.65, samples=33 lat (msec) : 4=0.26%, 10=20.05%, 20=35.03%, 50=40.36%, 100=4.30% cpu : usr=0.09%, sys=14.86%, ctx=1871, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183122: Sat Jul 18 16:43:45 2026 read: IOPS=22, BW=354KiB/s (363kB/s)(6032KiB/17017msec) clat (usec): min=2994, max=86883, avg=19678.43, stdev=14328.90 lat (usec): min=2995, max=86884, avg=19679.02, stdev=14328.90 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 5866], 10.00th=[ 6652], 20.00th=[ 8848], | 30.00th=[10945], 40.00th=[12387], 50.00th=[14615], 60.00th=[17433], | 70.00th=[21365], 80.00th=[29754], 90.00th=[41157], 95.00th=[49021], | 99.00th=[66847], 99.50th=[83362], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 128, max= 1024, per=24.31%, avg=342.03, stdev=183.41, samples=33 iops : min= 8, max= 64, avg=20.97, stdev=11.60, samples=33 write: IOPS=22, BW=368KiB/s (376kB/s)(6256KiB/17017msec); 0 zone resets clat (usec): min=5097, max=90428, avg=24391.14, stdev=15075.79 lat (usec): min=5098, max=90429, avg=24392.45, stdev=15075.81 clat percentiles (usec): | 1.00th=[ 6718], 5.00th=[ 8291], 10.00th=[ 9765], 20.00th=[12125], | 30.00th=[13829], 40.00th=[17171], 50.00th=[20055], 60.00th=[24249], | 70.00th=[29754], 80.00th=[34866], 90.00th=[42206], 95.00th=[53216], | 99.00th=[81265], 99.50th=[83362], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 127, max= 800, per=24.08%, avg=356.36, stdev=156.21, samples=33 iops : min= 7, max= 50, avg=21.85, stdev= 9.94, samples=33 lat (msec) : 4=0.65%, 10=17.06%, 20=40.23%, 50=36.46%, 100=5.60% cpu : usr=0.06%, sys=14.66%, ctx=1880, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1408KiB/s (1441kB/s), 338KiB/s-370KiB/s (346kB/s-379kB/s), io=23.4MiB (24.5MB), run=16870-17017msec WRITE: bw=1481KiB/s (1516kB/s), 357KiB/s-385KiB/s (366kB/s-395kB/s), io=24.6MiB (25.8MB), run=16870-17017msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183129: Sat Jul 18 16:43:55 2026 read: IOPS=2, BW=2609KiB/s (2672kB/s)(7168KiB/2747msec) clat (usec): min=660, max=768759, avg=199835.45, stdev=256157.67 lat (usec): min=661, max=768760, avg=199836.70, stdev=256157.54 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 85459], | 30.00th=[110625], 40.00th=[110625], 50.00th=[139461], 60.00th=[143655], | 70.00th=[143655], 80.00th=[149947], 90.00th=[767558], 95.00th=[767558], | 99.00th=[767558], 99.50th=[767558], 99.90th=[767558], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 1771, max= 4096, per=53.09%, avg=2999.25, stdev=1266.11, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1864KiB/s (1909kB/s)(5120KiB/2747msec); 0 zone resets clat (msec): min=143, max=566, avg=262.01, stdev=174.41 lat (msec): min=144, max=566, avg=262.07, stdev=174.38 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2043, max= 4087, per=34.47%, avg=2726.00, stdev=1178.66, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.04%, sys=49.67%, ctx=1195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183130: Sat Jul 18 16:43:55 2026 read: IOPS=0, BW=565KiB/s (579kB/s)(2048KiB/3625msec) clat (usec): min=506, max=97403, avg=48955.18, stdev=68516.16 lat (usec): min=508, max=97405, avg=48956.85, stdev=68516.50 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[96994], | 70.00th=[96994], 80.00th=[96994], 90.00th=[96994], 95.00th=[96994], | 99.00th=[96994], 99.50th=[96994], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 1756, max= 2048, per=33.67%, avg=1902.00, stdev=206.48, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2825KiB/s (2893kB/s)(10.0MiB/3625msec); 0 zone resets clat (msec): min=101, max=934, avg=351.43, stdev=282.59 lat (msec): min=101, max=934, avg=351.50, stdev=282.58 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 161], | 30.00th=[ 171], 40.00th=[ 201], 50.00th=[ 220], 60.00th=[ 224], | 70.00th=[ 288], 80.00th=[ 439], 90.00th=[ 776], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 2043, max= 6144, per=46.57%, avg=3683.60, stdev=1714.14, samples=5 iops : min= 1, max= 6, avg= 3.20, stdev= 1.92, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=16.67% cpu : usr=0.03%, sys=40.12%, ctx=380, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183131: Sat Jul 18 16:43:55 2026 read: IOPS=2, BW=2227KiB/s (2280kB/s)(6144KiB/2759msec) clat (usec): min=443, max=179688, avg=55992.72, stdev=71337.88 lat (usec): min=445, max=179689, avg=55993.83, stdev=71337.71 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[ 76022], | 70.00th=[ 79168], 80.00th=[ 79168], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 2043, max= 4096, per=60.34%, avg=3408.67, stdev=1182.71, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2227KiB/s (2280kB/s)(6144KiB/2759msec); 0 zone resets clat (msec): min=145, max=967, avg=397.51, stdev=308.35 lat (msec): min=145, max=967, avg=397.56, stdev=308.36 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 259], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2043, max= 3512, per=30.49%, avg=2411.50, stdev=733.67, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=16.67%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=36.91%, ctx=481, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183132: Sat Jul 18 16:43:55 2026 read: IOPS=1, BW=1679KiB/s (1720kB/s)(5120KiB/3049msec) clat (usec): min=493, max=319642, avg=171063.48, stdev=122413.46 lat (usec): min=494, max=319642, avg=171064.57, stdev=122412.92 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[131597], 40.00th=[131597], 50.00th=[149947], 60.00th=[149947], | 70.00th=[252707], 80.00th=[252707], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 4087, max= 4096, per=72.43%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2351KiB/s (2407kB/s)(7168KiB/3049msec); 0 zone resets clat (msec): min=135, max=911, avg=310.64, stdev=272.06 lat (msec): min=135, max=911, avg=310.71, stdev=272.06 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 157], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 230], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 292], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1790, max= 4087, per=33.40%, avg=2641.67, stdev=1258.33, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=45.31%, ctx=699, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5650KiB/s (5785kB/s), 565KiB/s-2609KiB/s (579kB/s-2672kB/s), io=20.0MiB (20.0MB), run=2747-3625msec WRITE: bw=7910KiB/s (8099kB/s), 1864KiB/s-2825KiB/s (1909kB/s-2893kB/s), io=28.0MiB (29.4MB), run=2747-3625msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183134: Sat Jul 18 16:43:55 2026 read: IOPS=1, BW=1950KiB/s (1997kB/s)(7168KiB/3675msec) clat (msec): min=51, max=929, avg=444.88, stdev=402.08 lat (msec): min=51, max=929, avg=444.88, stdev=402.08 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 66], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 368], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 894], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 2019, max= 4096, per=54.50%, avg=3036.75, stdev=1159.42, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1393KiB/s (1427kB/s)(5120KiB/3675msec); 0 zone resets clat (msec): min=50, max=148, avg=105.07, stdev=47.37 lat (msec): min=50, max=148, avg=105.15, stdev=47.37 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 133], 60.00th=[ 133], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 2048, max= 6144, per=52.51%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (msec) : 100=41.67%, 250=25.00%, 500=8.33%, 750=8.33%, 1000=16.67% cpu : usr=0.03%, sys=10.62%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183135: Sat Jul 18 16:43:55 2026 read: IOPS=0, BW=563KiB/s (576kB/s)(2048KiB/3638msec) clat (msec): min=177, max=291, avg=234.39, stdev=81.10 lat (msec): min=177, max=291, avg=234.39, stdev=81.10 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1939, max= 2048, per=35.78%, avg=1993.50, stdev=77.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2815KiB/s (2882kB/s)(10.0MiB/3638msec); 0 zone resets clat (msec): min=48, max=687, avg=308.91, stdev=209.12 lat (msec): min=48, max=688, avg=308.98, stdev=209.10 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 163], | 30.00th=[ 165], 40.00th=[ 194], 50.00th=[ 203], 60.00th=[ 313], | 70.00th=[ 334], 80.00th=[ 338], 90.00th=[ 651], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1992, max= 8192, per=47.11%, avg=3675.20, stdev=2678.96, samples=5 iops : min= 1, max= 8, avg= 3.40, stdev= 2.79, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=21.91%, ctx=186, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183136: Sat Jul 18 16:43:55 2026 read: IOPS=1, BW=1881KiB/s (1926kB/s)(6144KiB/3266msec) clat (msec): min=40, max=322, avg=133.15, stdev=108.90 lat (msec): min=40, max=322, avg=133.15, stdev=108.90 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 51], | 30.00th=[ 51], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 132], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2019, max= 4096, per=60.42%, avg=3366.33, stdev=1168.17, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1881KiB/s (1926kB/s)(6144KiB/3266msec); 0 zone resets clat (msec): min=137, max=992, avg=409.49, stdev=325.37 lat (msec): min=138, max=992, avg=409.55, stdev=325.35 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 393], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2019, max= 3799, per=31.77%, avg=2478.50, stdev=880.44, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=21.10%, ctx=383, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183137: Sat Jul 18 16:43:55 2026 read: IOPS=1, BW=1411KiB/s (1445kB/s)(5120KiB/3629msec) clat (msec): min=47, max=559, avg=210.02, stdev=209.31 lat (msec): min=47, max=559, avg=210.03, stdev=209.31 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 60], 40.00th=[ 60], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2019, max= 4096, per=48.83%, avg=2721.00, stdev=1190.87, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1975KiB/s (2023kB/s)(7168KiB/3629msec); 0 zone resets clat (msec): min=55, max=1137, avg=367.85, stdev=363.92 lat (msec): min=55, max=1137, avg=367.92, stdev=363.92 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 138], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 220], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 422], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1924, max= 4096, per=31.04%, avg=2421.60, stdev=937.41, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=16.01%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5573KiB/s (5707kB/s), 563KiB/s-1950KiB/s (576kB/s-1997kB/s), io=20.0MiB (20.0MB), run=3266-3675msec WRITE: bw=7802KiB/s (7989kB/s), 1393KiB/s-2815KiB/s (1427kB/s-2882kB/s), io=28.0MiB (29.4MB), run=3266-3675msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183143: Sat Jul 18 16:44:04 2026 read: IOPS=2, BW=8996KiB/s (9212kB/s)(12.0MiB/1366msec) clat (msec): min=420, max=476, avg=449.81, stdev=28.30 lat (msec): min=420, max=476, avg=449.81, stdev=28.30 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8110, max= 8192, per=89.40%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=51.21%, ctx=2975, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183144: Sat Jul 18 16:44:04 2026 read: IOPS=0, BW=2279KiB/s (2334kB/s)(4096KiB/1797msec) clat (nsec): min=499843k, max=499843k, avg=499842848.00, stdev= 0.00 lat (nsec): min=499846k, max=499846k, avg=499845633.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7501, max= 7501, per=82.27%, avg=7501.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4559KiB/s (4668kB/s)(8192KiB/1797msec); 0 zone resets clat (msec): min=478, max=784, avg=631.36, stdev=215.96 lat (msec): min=478, max=784, avg=631.60, stdev=215.94 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=55.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=23.55%, ctx=826, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183146: Sat Jul 18 16:44:04 2026 write: IOPS=1, BW=5575KiB/s (5709kB/s)(12.0MiB/2204msec); 0 zone resets clat (msec): min=142, max=1662, avg=728.01, stdev=818.17 lat (msec): min=142, max=1663, avg=728.30, stdev=818.18 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8078, max= 8078, per=54.34%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.12%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183147: Sat Jul 18 16:44:04 2026 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=261, max=1220, avg=616.39, stdev=525.46 lat (msec): min=262, max=1220, avg=616.80, stdev=525.44 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7515, max= 8192, per=52.83%, avg=7853.50, stdev=478.71, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.92%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9117KiB/s (9336kB/s), 2279KiB/s-8996KiB/s (2334kB/s-9212kB/s), io=16.0MiB (16.8MB), run=1366-1797msec WRITE: bw=14.5MiB/s (15.2MB/s), 4559KiB/s-6614KiB/s (4668kB/s-6772kB/s), io=32.0MiB (33.6MB), run=1797-2204msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183148: Sat Jul 18 16:44:04 2026 read: IOPS=1, BW=7232KiB/s (7406kB/s)(12.0MiB/1699msec) clat (msec): min=255, max=890, avg=549.78, stdev=319.79 lat (msec): min=255, max=890, avg=549.79, stdev=319.79 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.85%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183149: Sat Jul 18 16:44:04 2026 read: IOPS=0, BW=1872KiB/s (1917kB/s)(4096KiB/2188msec) clat (nsec): min=527764k, max=527764k, avg=527764373.00, stdev= 0.00 lat (nsec): min=527767k, max=527767k, avg=527766701.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7447, max= 7447, per=99.45%, avg=7447.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3744KiB/s (3834kB/s)(8192KiB/2188msec); 0 zone resets clat (msec): min=399, max=1238, avg=818.89, stdev=592.80 lat (msec): min=399, max=1238, avg=819.15, stdev=592.79 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8192, max= 8192, per=54.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.63%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183150: Sat Jul 18 16:44:04 2026 write: IOPS=1, BW=6135KiB/s (6282kB/s)(12.0MiB/2003msec); 0 zone resets clat (msec): min=149, max=1389, avg=652.55, stdev=652.19 lat (msec): min=150, max=1389, avg=652.81, stdev=652.08 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8110, max= 8110, per=54.15%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=14.39%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183151: Sat Jul 18 16:44:04 2026 write: IOPS=1, BW=6478KiB/s (6633kB/s)(12.0MiB/1897msec); 0 zone resets clat (msec): min=462, max=700, avg=617.44, stdev=134.68 lat (msec): min=462, max=701, avg=617.71, stdev=134.66 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8110, max= 8192, per=54.43%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.11%, sys=15.24%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7488KiB/s (7668kB/s), 1872KiB/s-7232KiB/s (1917kB/s-7406kB/s), io=16.0MiB (16.8MB), run=1699-2188msec WRITE: bw=14.6MiB/s (15.3MB/s), 3744KiB/s-6478KiB/s (3834kB/s-6633kB/s), io=32.0MiB (33.6MB), run=1897-2188msec