== sanity test 398b: DIO and buffer IO race ============== 16:59:59 (1760129999) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.91892 s, 17.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187643: Fri Oct 10 17:00:59 2025 read: IOPS=29, BW=120KiB/s (123kB/s)(5992KiB/50010msec) clat (usec): min=127, max=742731, avg=18083.40, stdev=20949.40 lat (usec): min=128, max=742732, avg=18084.38, stdev=20949.42 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 7111], 10.00th=[ 8455], 20.00th=[ 10159], | 30.00th=[ 11863], 40.00th=[ 13829], 50.00th=[ 16188], 60.00th=[ 18482], | 70.00th=[ 20579], 80.00th=[ 23725], 90.00th=[ 28181], 95.00th=[ 34341], | 99.00th=[ 51119], 99.50th=[ 57934], 99.90th=[ 77071], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 47, max= 208, per=25.18%, avg=120.63, stdev=28.57, samples=98 iops : min= 11, max= 52, avg=29.74, stdev= 7.18, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6296KiB/50010msec); 0 zone resets clat (usec): min=747, max=78923, avg=14471.46, stdev=11761.53 lat (usec): min=748, max=78924, avg=14472.88, stdev=11761.47 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 3261], | 30.00th=[ 5211], 40.00th=[ 9634], 50.00th=[12125], 60.00th=[14877], | 70.00th=[18744], 80.00th=[23462], 90.00th=[31065], 95.00th=[37487], | 99.00th=[49546], 99.50th=[57934], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 39, max= 207, per=25.31%, avg=126.83, stdev=31.84, samples=98 iops : min= 9, max= 51, avg=31.30, stdev= 7.98, samples=98 lat (usec) : 250=0.23%, 500=0.65%, 750=0.29%, 1000=0.26% lat (msec) : 2=2.51%, 4=10.45%, 10=16.02%, 20=39.81%, 50=28.84% lat (msec) : 100=0.91%, 750=0.03% cpu : usr=0.13%, sys=22.17%, ctx=8852, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187644: Fri Oct 10 17:00:59 2025 read: IOPS=29, BW=120KiB/s (123kB/s)(5940KiB/49583msec) clat (usec): min=128, max=93434, avg=17508.31, stdev=8975.03 lat (usec): min=128, max=93435, avg=17509.14, stdev=8975.07 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 7308], 10.00th=[ 8979], 20.00th=[10552], | 30.00th=[11994], 40.00th=[13829], 50.00th=[16057], 60.00th=[18482], | 70.00th=[20317], 80.00th=[23462], 90.00th=[27919], 95.00th=[33424], | 99.00th=[48497], 99.50th=[57934], 99.90th=[71828], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 6, max= 199, per=24.89%, avg=119.24, stdev=29.87, samples=98 iops : min= 1, max= 49, avg=29.40, stdev= 7.49, samples=98 write: IOPS=32, BW=128KiB/s (131kB/s)(6348KiB/49583msec); 0 zone resets clat (usec): min=760, max=726821, avg=14783.09, stdev=21516.91 lat (usec): min=761, max=726822, avg=14784.18, stdev=21516.96 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2040], 10.00th=[ 2573], 20.00th=[ 3261], | 30.00th=[ 5014], 40.00th=[ 9372], 50.00th=[ 11731], 60.00th=[ 14091], | 70.00th=[ 18220], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 36439], | 99.00th=[ 50070], 99.50th=[ 62653], 99.90th=[ 95945], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 79, max= 271, per=25.56%, avg=128.07, stdev=31.06, samples=97 iops : min= 19, max= 67, avg=31.61, stdev= 7.81, samples=97 lat (usec) : 250=0.13%, 500=0.88%, 750=0.07%, 1000=0.26% lat (msec) : 2=2.21%, 4=10.81%, 10=15.69%, 20=41.11%, 50=27.86% lat (msec) : 100=0.94%, 750=0.03% cpu : usr=0.12%, sys=22.55%, ctx=8889, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187645: Fri Oct 10 17:00:59 2025 read: IOPS=30, BW=122KiB/s (125kB/s)(6028KiB/49353msec) clat (usec): min=213, max=104576, avg=17482.28, stdev=9552.78 lat (usec): min=268, max=104577, avg=17483.52, stdev=9552.84 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 7111], 10.00th=[ 8717], 20.00th=[ 10159], | 30.00th=[ 11863], 40.00th=[ 13435], 50.00th=[ 15926], 60.00th=[ 17957], | 70.00th=[ 20579], 80.00th=[ 23725], 90.00th=[ 28705], 95.00th=[ 33162], | 99.00th=[ 51119], 99.50th=[ 55313], 99.90th=[ 82314], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 55, max= 200, per=25.73%, avg=123.27, stdev=28.25, samples=97 iops : min= 13, max= 50, avg=30.41, stdev= 7.04, samples=97 write: IOPS=31, BW=127KiB/s (130kB/s)(6260KiB/49353msec); 0 zone resets clat (usec): min=790, max=740664, avg=14607.68, stdev=21935.48 lat (usec): min=790, max=740665, avg=14608.91, stdev=21935.50 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1991], 10.00th=[ 2540], 20.00th=[ 3195], | 30.00th=[ 4752], 40.00th=[ 8848], 50.00th=[ 11469], 60.00th=[ 14091], | 70.00th=[ 17695], 80.00th=[ 22938], 90.00th=[ 30802], 95.00th=[ 37487], | 99.00th=[ 51119], 99.50th=[ 59507], 99.90th=[ 96994], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 55, max= 199, per=25.56%, avg=128.07, stdev=30.17, samples=97 iops : min= 13, max= 49, avg=31.61, stdev= 7.55, samples=97 lat (usec) : 250=0.03%, 500=1.27%, 750=0.20%, 1000=0.26% lat (msec) : 2=2.34%, 4=10.97%, 10=16.73%, 20=39.19%, 50=27.83% lat (msec) : 100=1.11%, 250=0.03%, 750=0.03% cpu : usr=0.14%, sys=22.37%, ctx=8739, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187646: Fri Oct 10 17:00:59 2025 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/50113msec) clat (usec): min=89, max=73661, avg=17537.96, stdev=9685.81 lat (usec): min=90, max=73662, avg=17539.65, stdev=9685.80 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 6849], 10.00th=[ 8356], 20.00th=[10290], | 30.00th=[11731], 40.00th=[13566], 50.00th=[15533], 60.00th=[17957], | 70.00th=[20841], 80.00th=[24249], 90.00th=[28967], 95.00th=[35390], | 99.00th=[51119], 99.50th=[56886], 99.90th=[71828], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 55, max= 184, per=25.24%, avg=120.89, stdev=26.41, samples=98 iops : min= 13, max= 46, avg=29.81, stdev= 6.58, samples=98 write: IOPS=31, BW=124KiB/s (127kB/s)(6236KiB/50113msec); 0 zone resets clat (usec): min=663, max=718116, avg=15039.31, stdev=21405.80 lat (usec): min=664, max=718126, avg=15040.42, stdev=21406.01 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1991], 10.00th=[ 2474], 20.00th=[ 3294], | 30.00th=[ 5276], 40.00th=[ 9372], 50.00th=[ 12256], 60.00th=[ 15008], | 70.00th=[ 19006], 80.00th=[ 23987], 90.00th=[ 31851], 95.00th=[ 37487], | 99.00th=[ 51643], 99.50th=[ 58459], 99.90th=[ 84411], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 13, max= 232, per=24.68%, avg=123.66, stdev=34.15, samples=99 iops : min= 3, max= 58, avg=30.51, stdev= 8.58, samples=99 lat (usec) : 100=0.03%, 250=0.16%, 500=1.17%, 750=0.29%, 1000=0.13% lat (msec) : 2=2.57%, 4=10.35%, 10=15.85%, 20=39.23%, 50=28.97% lat (msec) : 100=1.20%, 750=0.03% cpu : usr=0.13%, sys=22.15%, ctx=8887, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=479KiB/s (491kB/s), 120KiB/s-122KiB/s (123kB/s-125kB/s), io=23.4MiB (24.6MB), run=49353-50113msec WRITE: bw=502KiB/s (514kB/s), 124KiB/s-128KiB/s (127kB/s-131kB/s), io=24.6MiB (25.7MB), run=49353-50113msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187638: Fri Oct 10 17:01:12 2025 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(5992KiB/62814msec) clat (msec): min=3, max=736, avg=17.13, stdev=22.55 lat (msec): min=3, max=736, avg=17.13, stdev=22.55 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 43], | 99.00th=[ 62], 99.50th=[ 71], 99.90th=[ 90], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 15, max= 287, per=25.25%, avg=95.96, stdev=52.80, samples=124 iops : min= 3, max= 71, avg=23.63, stdev=13.24, samples=124 write: IOPS=25, BW=100KiB/s (103kB/s)(6296KiB/62814msec); 0 zone resets clat (msec): min=5, max=116, avg=23.47, stdev=14.43 lat (msec): min=5, max=116, avg=23.47, stdev=14.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 73], 99.50th=[ 81], 99.90th=[ 99], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 24, max= 232, per=25.31%, avg=100.74, stdev=47.55, samples=124 iops : min= 6, max= 58, avg=24.82, stdev=11.93, samples=124 lat (msec) : 4=0.16%, 10=23.73%, 20=40.20%, 50=31.45%, 100=4.39% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=9.74%, ctx=5499, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187639: Fri Oct 10 17:01:12 2025 read: IOPS=23, BW=94.2KiB/s (96.5kB/s)(5940KiB/63038msec) clat (msec): min=3, max=728, avg=17.32, stdev=22.44 lat (msec): min=3, max=728, avg=17.32, stdev=22.44 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 62], 99.50th=[ 66], 99.90th=[ 90], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8, max= 303, per=24.85%, avg=94.42, stdev=51.70, samples=124 iops : min= 2, max= 75, avg=23.24, stdev=12.96, samples=124 write: IOPS=25, BW=101KiB/s (103kB/s)(6348KiB/63038msec); 0 zone resets clat (msec): min=5, max=126, avg=23.39, stdev=14.87 lat (msec): min=5, max=126, avg=23.39, stdev=14.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 82], 99.90th=[ 111], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 32, max= 288, per=25.23%, avg=100.41, stdev=48.80, samples=124 iops : min= 8, max= 72, avg=24.74, stdev=12.26, samples=124 lat (msec) : 4=0.33%, 10=22.75%, 20=40.23%, 50=32.06%, 100=4.52% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=9.76%, ctx=5545, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187640: Fri Oct 10 17:01:12 2025 read: IOPS=24, BW=96.2KiB/s (98.6kB/s)(6028KiB/62628msec) clat (msec): min=3, max=108, avg=17.03, stdev=12.95 lat (msec): min=3, max=108, avg=17.03, stdev=12.95 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 66], 99.50th=[ 70], 99.90th=[ 81], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 31, max= 304, per=25.44%, avg=96.68, stdev=51.11, samples=123 iops : min= 7, max= 76, avg=23.80, stdev=12.85, samples=123 write: IOPS=24, BW=99.0KiB/s (102kB/s)(6260KiB/62628msec); 0 zone resets clat (msec): min=5, max=729, avg=23.49, stdev=23.00 lat (msec): min=5, max=729, avg=23.49, stdev=23.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 113], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 32, max= 263, per=25.17%, avg=100.19, stdev=49.06, samples=123 iops : min= 8, max= 65, avg=24.68, stdev=12.29, samples=123 lat (msec) : 4=0.42%, 10=23.01%, 20=40.62%, 50=31.51%, 100=4.33% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=9.80%, ctx=5543, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187641: Fri Oct 10 17:01:12 2025 read: IOPS=23, BW=95.9KiB/s (98.2kB/s)(6052KiB/63098msec) clat (usec): min=3187, max=89105, avg=16968.17, stdev=12812.58 lat (usec): min=3188, max=89107, avg=16968.99, stdev=12812.55 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 7504], | 30.00th=[ 8979], 40.00th=[10814], 50.00th=[12780], 60.00th=[15139], | 70.00th=[18482], 80.00th=[24249], 90.00th=[35390], 95.00th=[44303], | 99.00th=[60031], 99.50th=[70779], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 31, max= 272, per=25.13%, avg=95.51, stdev=49.97, samples=124 iops : min= 7, max= 68, avg=23.52, stdev=12.52, samples=124 write: IOPS=24, BW=98.8KiB/s (101kB/s)(6236KiB/63098msec); 0 zone resets clat (msec): min=4, max=728, avg=23.87, stdev=23.06 lat (msec): min=4, max=728, avg=23.87, stdev=23.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 81], 99.90th=[ 114], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 32, max= 264, per=24.78%, avg=98.60, stdev=48.74, samples=124 iops : min= 8, max= 66, avg=24.29, stdev=12.25, samples=124 lat (msec) : 4=0.33%, 10=23.63%, 20=39.94%, 50=31.45%, 100=4.56% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=9.67%, ctx=5521, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=381KiB/s (390kB/s), 94.2KiB/s-96.2KiB/s (96.5kB/s-98.6kB/s), io=23.4MiB (24.6MB), run=62628-63098msec WRITE: bw=398KiB/s (408kB/s), 98.8KiB/s-101KiB/s (101kB/s-103kB/s), io=24.6MiB (25.7MB), run=62628-63098msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187678: Fri Oct 10 17:01:32 2025 read: IOPS=25, BW=411KiB/s (420kB/s)(5920KiB/14421msec) clat (usec): min=107, max=74439, avg=19580.77, stdev=10721.04 lat (usec): min=107, max=74440, avg=19582.18, stdev=10721.36 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 537], 10.00th=[ 8455], 20.00th=[11994], | 30.00th=[13566], 40.00th=[16057], 50.00th=[18744], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26608], 90.00th=[32637], 95.00th=[39584], | 99.00th=[54264], 99.50th=[56886], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 95, max= 637, per=24.54%, avg=404.43, stdev=112.69, samples=28 iops : min= 5, max= 39, avg=24.68, stdev= 7.21, samples=28 write: IOPS=27, BW=442KiB/s (452kB/s)(6368KiB/14421msec); 0 zone resets clat (usec): min=1435, max=91031, avg=17864.81, stdev=13494.77 lat (usec): min=1436, max=91033, avg=17866.57, stdev=13494.77 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3130], 10.00th=[ 3916], 20.00th=[ 5538], | 30.00th=[ 8455], 40.00th=[12256], 50.00th=[14222], 60.00th=[18220], | 70.00th=[22938], 80.00th=[28181], 90.00th=[34866], 95.00th=[42206], | 99.00th=[61080], 99.50th=[80217], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 223, max= 608, per=25.35%, avg=439.50, stdev=111.82, samples=28 iops : min= 13, max= 38, avg=26.86, stdev= 6.97, samples=28 lat (usec) : 250=0.78%, 500=1.30%, 750=0.78%, 1000=0.13% lat (msec) : 2=0.91%, 4=4.69%, 10=14.97%, 20=36.85%, 50=37.37% lat (msec) : 100=2.21% cpu : usr=0.12%, sys=22.48%, ctx=2499, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187679: Fri Oct 10 17:01:32 2025 read: IOPS=24, BW=395KiB/s (405kB/s)(5744KiB/14532msec) clat (usec): min=107, max=76238, avg=20325.93, stdev=10885.26 lat (usec): min=108, max=76238, avg=20326.93, stdev=10885.34 clat percentiles (usec): | 1.00th=[ 212], 5.00th=[ 7242], 10.00th=[10159], 20.00th=[12387], | 30.00th=[14222], 40.00th=[16057], 50.00th=[17957], 60.00th=[21103], | 70.00th=[24511], 80.00th=[27657], 90.00th=[33817], 95.00th=[39584], | 99.00th=[62653], 99.50th=[68682], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 190, max= 573, per=23.73%, avg=391.04, stdev=88.32, samples=28 iops : min= 11, max= 35, avg=23.82, stdev= 5.62, samples=28 write: IOPS=28, BW=450KiB/s (461kB/s)(6544KiB/14532msec); 0 zone resets clat (usec): min=1598, max=68995, avg=17578.52, stdev=13671.22 lat (usec): min=1601, max=68996, avg=17599.33, stdev=13688.20 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2900], 10.00th=[ 3851], 20.00th=[ 5211], | 30.00th=[ 8160], 40.00th=[11207], 50.00th=[14484], 60.00th=[17433], | 70.00th=[20841], 80.00th=[27395], 90.00th=[38536], 95.00th=[44303], | 99.00th=[60556], 99.50th=[64226], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 255, max= 670, per=25.40%, avg=440.43, stdev=113.99, samples=28 iops : min= 15, max= 41, avg=26.93, stdev= 7.18, samples=28 lat (usec) : 250=0.52%, 500=1.17% lat (msec) : 2=1.56%, 4=4.69%, 10=16.54%, 20=37.37%, 50=35.68% lat (msec) : 100=2.47% cpu : usr=0.12%, sys=23.00%, ctx=2577, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187680: Fri Oct 10 17:01:32 2025 read: IOPS=27, BW=437KiB/s (447kB/s)(6256KiB/14326msec) clat (usec): min=152, max=105390, avg=19927.71, stdev=11623.02 lat (usec): min=153, max=105391, avg=19928.65, stdev=11623.02 clat percentiles (usec): | 1.00th=[ 215], 5.00th=[ 338], 10.00th=[ 8455], 20.00th=[ 11600], | 30.00th=[ 13960], 40.00th=[ 16188], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24249], 80.00th=[ 27657], 90.00th=[ 33817], 95.00th=[ 38536], | 99.00th=[ 51643], 99.50th=[ 55313], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 318, max= 608, per=26.71%, avg=440.14, stdev=69.03, samples=28 iops : min= 19, max= 38, avg=26.89, stdev= 4.52, samples=28 write: IOPS=26, BW=421KiB/s (431kB/s)(6032KiB/14326msec); 0 zone resets clat (usec): min=1483, max=74278, avg=17154.67, stdev=13345.16 lat (usec): min=1485, max=74284, avg=17156.79, stdev=13345.40 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 3261], 10.00th=[ 4015], 20.00th=[ 5145], | 30.00th=[ 6980], 40.00th=[10290], 50.00th=[14615], 60.00th=[17171], | 70.00th=[21365], 80.00th=[27395], 90.00th=[36963], 95.00th=[43779], | 99.00th=[58459], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 192, max= 606, per=24.05%, avg=416.96, stdev=112.92, samples=28 iops : min= 12, max= 37, avg=25.46, stdev= 7.12, samples=28 lat (usec) : 250=0.91%, 500=2.99%, 750=0.13% lat (msec) : 2=0.91%, 4=4.30%, 10=16.54%, 20=35.42%, 50=36.85% lat (msec) : 100=1.82%, 250=0.13% cpu : usr=0.15%, sys=22.75%, ctx=2504, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187681: Fri Oct 10 17:01:32 2025 read: IOPS=27, BW=434KiB/s (444kB/s)(6032KiB/13908msec) clat (usec): min=142, max=79002, avg=19167.96, stdev=11240.73 lat (usec): min=143, max=79004, avg=19168.89, stdev=11240.80 clat percentiles (usec): | 1.00th=[ 215], 5.00th=[ 367], 10.00th=[ 8455], 20.00th=[11469], | 30.00th=[13829], 40.00th=[15664], 50.00th=[17957], 60.00th=[20055], | 70.00th=[23462], 80.00th=[26608], 90.00th=[30802], 95.00th=[37487], | 99.00th=[56886], 99.50th=[76022], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 287, max= 608, per=26.22%, avg=432.11, stdev=82.86, samples=27 iops : min= 17, max= 38, avg=26.41, stdev= 5.39, samples=27 write: IOPS=28, BW=450KiB/s (461kB/s)(6256KiB/13908msec); 0 zone resets clat (usec): min=1547, max=77571, avg=16929.22, stdev=12892.77 lat (usec): min=1549, max=77574, avg=16941.44, stdev=12895.09 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 3326], 10.00th=[ 3884], 20.00th=[ 5145], | 30.00th=[ 7242], 40.00th=[10945], 50.00th=[13829], 60.00th=[16909], | 70.00th=[20841], 80.00th=[27132], 90.00th=[35914], 95.00th=[41157], | 99.00th=[57410], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 254, max= 701, per=25.85%, avg=448.22, stdev=110.11, samples=27 iops : min= 15, max= 43, avg=27.41, stdev= 6.96, samples=27 lat (usec) : 250=0.65%, 500=2.86%, 750=0.26% lat (msec) : 2=0.91%, 4=4.95%, 10=16.80%, 20=37.50%, 50=34.38% lat (msec) : 100=1.69% cpu : usr=0.09%, sys=23.56%, ctx=2474, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1648KiB/s (1688kB/s), 395KiB/s-437KiB/s (405kB/s-447kB/s), io=23.4MiB (24.5MB), run=13908-14532msec WRITE: bw=1734KiB/s (1776kB/s), 421KiB/s-450KiB/s (431kB/s-461kB/s), io=24.6MiB (25.8MB), run=13908-14532msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187683: Fri Oct 10 17:01:36 2025 read: IOPS=20, BW=322KiB/s (329kB/s)(5920KiB/18398msec) clat (usec): min=4645, max=83793, avg=19100.17, stdev=14513.85 lat (usec): min=4646, max=83795, avg=19101.36, stdev=14513.76 clat percentiles (usec): | 1.00th=[ 5866], 5.00th=[ 6718], 10.00th=[ 7504], 20.00th=[ 9110], | 30.00th=[10290], 40.00th=[11731], 50.00th=[12911], 60.00th=[15401], | 70.00th=[20841], 80.00th=[27132], 90.00th=[38536], 95.00th=[50070], | 99.00th=[71828], 99.50th=[82314], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 63, max= 733, per=24.47%, avg=316.11, stdev=144.05, samples=36 iops : min= 3, max= 45, avg=19.17, stdev= 9.07, samples=36 write: IOPS=21, BW=346KiB/s (354kB/s)(6368KiB/18398msec); 0 zone resets clat (msec): min=9, max=109, avg=28.20, stdev=16.62 lat (msec): min=9, max=109, avg=28.21, stdev=16.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 54], 95.00th=[ 63], | 99.00th=[ 85], 99.50th=[ 94], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 159, max= 640, per=25.32%, avg=344.08, stdev=132.32, samples=36 iops : min= 9, max= 40, avg=20.92, stdev= 8.34, samples=36 lat (msec) : 10=13.54%, 20=39.32%, 50=38.80%, 100=8.20%, 250=0.13% cpu : usr=0.09%, sys=8.47%, ctx=1359, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187684: Fri Oct 10 17:01:36 2025 read: IOPS=19, BW=315KiB/s (322kB/s)(5744KiB/18247msec) clat (msec): min=5, max=101, avg=19.58, stdev=15.40 lat (msec): min=5, max=101, avg=19.58, stdev=15.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 56], | 99.00th=[ 81], 99.50th=[ 86], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 63, max= 736, per=24.30%, avg=314.00, stdev=152.43, samples=36 iops : min= 3, max= 46, avg=19.03, stdev= 9.64, samples=36 write: IOPS=22, BW=359KiB/s (367kB/s)(6544KiB/18247msec); 0 zone resets clat (msec): min=6, max=127, avg=27.18, stdev=16.29 lat (msec): min=6, max=127, avg=27.18, stdev=16.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 52], 95.00th=[ 60], | 99.00th=[ 73], 99.50th=[ 97], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 159, max= 832, per=26.38%, avg=358.47, stdev=149.20, samples=36 iops : min= 9, max= 52, avg=21.83, stdev= 9.37, samples=36 lat (msec) : 10=14.84%, 20=40.23%, 50=36.20%, 100=8.33%, 250=0.39% cpu : usr=0.10%, sys=8.40%, ctx=1443, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187685: Fri Oct 10 17:01:36 2025 read: IOPS=21, BW=339KiB/s (347kB/s)(6256KiB/18470msec) clat (usec): min=5048, max=86952, avg=20332.37, stdev=15650.26 lat (usec): min=5049, max=86954, avg=20333.51, stdev=15650.24 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 7046], 10.00th=[ 8029], 20.00th=[ 9241], | 30.00th=[11076], 40.00th=[12649], 50.00th=[14353], 60.00th=[17433], | 70.00th=[20579], 80.00th=[27919], 90.00th=[42730], 95.00th=[55837], | 99.00th=[77071], 99.50th=[85459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 95, max= 702, per=26.07%, avg=336.89, stdev=155.19, samples=36 iops : min= 5, max= 43, avg=20.47, stdev= 9.69, samples=36 write: IOPS=20, BW=327KiB/s (334kB/s)(6032KiB/18470msec); 0 zone resets clat (msec): min=9, max=126, avg=27.63, stdev=16.90 lat (msec): min=9, max=126, avg=27.63, stdev=16.90 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 63], | 99.00th=[ 89], 99.50th=[ 106], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 63, max= 736, per=23.60%, avg=320.69, stdev=147.46, samples=36 iops : min= 3, max= 46, avg=19.47, stdev= 9.34, samples=36 lat (msec) : 10=12.63%, 20=43.49%, 50=35.55%, 100=8.07%, 250=0.26% cpu : usr=0.12%, sys=8.44%, ctx=1437, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187686: Fri Oct 10 17:01:36 2025 read: IOPS=20, BW=326KiB/s (333kB/s)(6032KiB/18530msec) clat (msec): min=4, max=101, avg=19.66, stdev=16.27 lat (msec): min=4, max=101, avg=19.66, stdev=16.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 57], | 99.00th=[ 82], 99.50th=[ 87], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 127, max= 798, per=24.66%, avg=318.61, stdev=150.81, samples=36 iops : min= 7, max= 49, avg=19.33, stdev= 9.45, samples=36 write: IOPS=21, BW=338KiB/s (346kB/s)(6256KiB/18530msec); 0 zone resets clat (usec): min=8403, max=96623, avg=28206.38, stdev=15597.86 lat (usec): min=8405, max=96625, avg=28210.91, stdev=15599.81 clat percentiles (usec): | 1.00th=[10028], 5.00th=[12125], 10.00th=[13960], 20.00th=[15664], | 30.00th=[17433], 40.00th=[19792], 50.00th=[22676], 60.00th=[27657], | 70.00th=[32637], 80.00th=[38536], 90.00th=[52167], 95.00th=[60556], | 99.00th=[76022], 99.50th=[88605], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 95, max= 733, per=24.57%, avg=333.97, stdev=142.27, samples=36 iops : min= 5, max= 45, avg=20.31, stdev= 8.98, samples=36 lat (msec) : 10=14.32%, 20=40.76%, 50=35.42%, 100=9.38%, 250=0.13% cpu : usr=0.10%, sys=8.11%, ctx=1378, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1293KiB/s (1324kB/s), 315KiB/s-339KiB/s (322kB/s-347kB/s), io=23.4MiB (24.5MB), run=18247-18530msec WRITE: bw=1360KiB/s (1393kB/s), 327KiB/s-359KiB/s (334kB/s-367kB/s), io=24.6MiB (25.8MB), run=18247-18530msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187695: Fri Oct 10 17:01:46 2025 read: IOPS=3, BW=3107KiB/s (3182kB/s)(7168KiB/2307msec) clat (msec): min=65, max=486, avg=196.34, stdev=142.34 lat (msec): min=65, max=486, avg=196.34, stdev=142.34 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 90], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 194], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 232], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1996, max= 5840, per=79.39%, avg=3971.67, stdev=1924.25, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2219KiB/s (2273kB/s)(5120KiB/2307msec); 0 zone resets clat (msec): min=112, max=237, avg=183.45, stdev=45.16 lat (msec): min=112, max=237, avg=183.52, stdev=45.18 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1996, max= 6059, per=48.03%, avg=3364.67, stdev=2333.46, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=75.00%, 500=8.33% cpu : usr=0.04%, sys=17.04%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187697: Fri Oct 10 17:01:46 2025 read: IOPS=0, BW=500KiB/s (512kB/s)(2048KiB/4093msec) clat (msec): min=79, max=464, avg=271.90, stdev=271.82 lat (msec): min=79, max=464, avg=271.90, stdev=271.82 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1965, max= 2043, per=40.06%, avg=2004.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2502KiB/s (2562kB/s)(10.0MiB/4093msec); 0 zone resets clat (msec): min=49, max=1389, avg=351.31, stdev=379.95 lat (msec): min=49, max=1389, avg=351.40, stdev=379.95 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 132], | 30.00th=[ 171], 40.00th=[ 207], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 342], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1965, max= 6144, per=43.35%, avg=3037.00, stdev=1725.24, samples=6 iops : min= 1, max= 6, avg= 2.17, stdev= 2.04, samples=6 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.02%, sys=18.33%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187699: Fri Oct 10 17:01:46 2025 read: IOPS=1, BW=1589KiB/s (1627kB/s)(6144KiB/3867msec) clat (msec): min=58, max=624, avg=256.25, stdev=199.44 lat (msec): min=58, max=624, avg=256.25, stdev=199.44 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 218], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2019, max= 4087, per=54.27%, avg=2715.00, stdev=1188.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1589KiB/s (1627kB/s)(6144KiB/3867msec); 0 zone resets clat (msec): min=77, max=1081, avg=381.50, stdev=382.80 lat (msec): min=77, max=1081, avg=381.60, stdev=382.78 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 388], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1996, max= 3968, per=38.08%, avg=2667.67, stdev=1126.33, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=11.33%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187702: Fri Oct 10 17:01:46 2025 read: IOPS=1, BW=1380KiB/s (1413kB/s)(5120KiB/3710msec) clat (msec): min=58, max=380, avg=181.44, stdev=145.35 lat (msec): min=58, max=380, avg=181.44, stdev=145.35 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 100], 60.00th=[ 100], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 3992, max= 4039, per=80.26%, avg=4015.50, stdev=33.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1932KiB/s (1978kB/s)(7168KiB/3710msec); 0 zone resets clat (msec): min=62, max=1492, avg=389.40, stdev=502.50 lat (msec): min=62, max=1492, avg=389.52, stdev=502.48 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 107], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 197], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 426], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1984, max= 4079, per=36.12%, avg=2530.25, stdev=1032.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=14.10%, ctx=156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5004KiB/s (5124kB/s), 500KiB/s-3107KiB/s (512kB/s-3182kB/s), io=20.0MiB (20.0MB), run=2307-4093msec WRITE: bw=7005KiB/s (7173kB/s), 1589KiB/s-2502KiB/s (1627kB/s-2562kB/s), io=28.0MiB (29.4MB), run=2307-4093msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187696: Fri Oct 10 17:01:46 2025 read: IOPS=2, BW=3036KiB/s (3109kB/s)(7168KiB/2361msec) clat (usec): min=924, max=182815, avg=131576.27, stdev=61687.97 lat (usec): min=925, max=182816, avg=131577.63, stdev=61688.09 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[120062], | 30.00th=[130548], 40.00th=[130548], 50.00th=[154141], 60.00th=[164627], | 70.00th=[164627], 80.00th=[168821], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 4071, max= 5851, per=100.00%, avg=4961.00, stdev=1258.65, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2169KiB/s (2221kB/s)(5120KiB/2361msec); 0 zone resets clat (msec): min=127, max=461, avg=284.41, stdev=141.88 lat (msec): min=127, max=461, avg=284.48, stdev=141.89 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2019, max= 2043, per=29.38%, avg=2032.33, stdev=12.22, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=47.25%, ctx=617, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187698: Fri Oct 10 17:01:46 2025 read: IOPS=0, BW=494KiB/s (506kB/s)(2048KiB/4144msec) clat (msec): min=129, max=198, avg=163.96, stdev=48.47 lat (msec): min=129, max=198, avg=163.97, stdev=48.47 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1996, max= 2031, per=40.74%, avg=2013.50, stdev=24.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2471KiB/s (2530kB/s)(10.0MiB/4144msec); 0 zone resets clat (msec): min=48, max=1269, avg=368.54, stdev=348.16 lat (msec): min=48, max=1269, avg=368.63, stdev=348.15 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 99], | 30.00th=[ 109], 40.00th=[ 268], 50.00th=[ 271], 60.00th=[ 342], | 70.00th=[ 376], 80.00th=[ 435], 90.00th=[ 477], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2019, max= 5763, per=46.07%, avg=3187.00, stdev=1693.62, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=31.50%, ctx=344, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187700: Fri Oct 10 17:01:46 2025 read: IOPS=2, BW=2683KiB/s (2747kB/s)(6144KiB/2290msec) clat (usec): min=545, max=196649, avg=108336.09, stdev=86348.15 lat (usec): min=547, max=196650, avg=108337.21, stdev=86348.08 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 1205], | 30.00th=[ 1205], 40.00th=[135267], 50.00th=[135267], 60.00th=[141558], | 70.00th=[177210], 80.00th=[177210], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 2035, max= 6059, per=68.37%, avg=3379.00, stdev=2320.95, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2683KiB/s (2747kB/s)(6144KiB/2290msec); 0 zone resets clat (msec): min=151, max=499, avg=257.45, stdev=129.31 lat (msec): min=151, max=499, avg=257.51, stdev=129.33 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 266], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1988, max= 4071, per=36.57%, avg=2530.25, stdev=1027.41, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=46.79%, ctx=400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187701: Fri Oct 10 17:01:46 2025 read: IOPS=1, BW=1253KiB/s (1283kB/s)(5120KiB/4086msec) clat (usec): min=805, max=1310.8k, avg=385053.72, stdev=530965.72 lat (usec): min=806, max=1310.8k, avg=385054.99, stdev=530965.74 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], | 20.00th=[ 807], 30.00th=[ 85459], 40.00th=[ 85459], | 50.00th=[ 219153], 60.00th=[ 219153], 70.00th=[ 308282], | 80.00th=[ 308282], 90.00th=[1317012], 95.00th=[1317012], | 99.00th=[1317012], 99.50th=[1317012], 99.90th=[1317012], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 2019, max= 4096, per=54.94%, avg=2715.33, stdev=1195.71, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1754KiB/s (1796kB/s)(7168KiB/4086msec); 0 zone resets clat (msec): min=140, max=541, avg=291.37, stdev=163.30 lat (msec): min=140, max=541, avg=291.49, stdev=163.32 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 157], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 241], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 498], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2003, max= 5763, per=40.08%, avg=2772.60, stdev=1671.76, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=32.51%, ctx=913, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4942KiB/s (5061kB/s), 494KiB/s-3036KiB/s (506kB/s-3109kB/s), io=20.0MiB (20.0MB), run=2290-4144msec WRITE: bw=6919KiB/s (7085kB/s), 1754KiB/s-2683KiB/s (1796kB/s-2747kB/s), io=28.0MiB (29.4MB), run=2290-4144msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187713: Fri Oct 10 17:01:54 2025 read: IOPS=1, BW=7618KiB/s (7801kB/s)(12.0MiB/1613msec) clat (msec): min=447, max=599, avg=522.04, stdev=76.22 lat (msec): min=447, max=599, avg=522.04, stdev=76.22 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5988, max= 8159, per=69.64%, avg=7073.50, stdev=1535.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=46.77%, ctx=1794, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187714: Fri Oct 10 17:01:54 2025 read: IOPS=0, BW=2591KiB/s (2653kB/s)(4096KiB/1581msec) clat (nsec): min=583576k, max=583576k, avg=583575514.00, stdev= 0.00 lat (nsec): min=583578k, max=583578k, avg=583577909.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 6023, max= 6023, per=59.30%, avg=6023.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5182KiB/s (5306kB/s)(8192KiB/1581msec); 0 zone resets clat (msec): min=368, max=568, avg=468.42, stdev=141.19 lat (msec): min=368, max=568, avg=468.78, stdev=141.29 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8159, max= 8159, per=46.26%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.63%, ctx=648, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187715: Fri Oct 10 17:01:54 2025 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=149, max=921, avg=586.86, stdev=395.86 lat (msec): min=149, max=921, avg=587.19, stdev=395.93 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8159, max= 8159, per=46.26%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.69%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187716: Fri Oct 10 17:01:54 2025 write: IOPS=1, BW=7054KiB/s (7223kB/s)(12.0MiB/1742msec); 0 zone resets clat (msec): min=475, max=642, avg=536.47, stdev=92.38 lat (msec): min=475, max=643, avg=536.88, stdev=92.32 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 6086, max= 8192, per=40.48%, avg=7139.00, stdev=1489.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.11%, sys=21.31%, ctx=113, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.92MiB/s (10.4MB/s), 2591KiB/s-7618KiB/s (2653kB/s-7801kB/s), io=16.0MiB (16.8MB), run=1581-1613msec WRITE: bw=17.2MiB/s (18.1MB/s), 5182KiB/s-7054KiB/s (5306kB/s-7223kB/s), io=32.0MiB (33.6MB), run=1581-1858msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187708: Fri Oct 10 17:01:54 2025 read: IOPS=1, BW=6853KiB/s (7018kB/s)(12.0MiB/1793msec) clat (msec): min=323, max=896, avg=536.40, stdev=313.57 lat (msec): min=323, max=896, avg=536.40, stdev=313.57 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 5665, max= 7892, per=83.54%, avg=6778.50, stdev=1574.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.64%, ctx=129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187710: Fri Oct 10 17:01:54 2025 read: IOPS=0, BW=2029KiB/s (2077kB/s)(4096KiB/2019msec) clat (nsec): min=650966k, max=650966k, avg=650965611.00, stdev= 0.00 lat (nsec): min=650968k, max=650968k, avg=650968176.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7892, max= 7892, per=97.26%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4057KiB/s (4155kB/s)(8192KiB/2019msec); 0 zone resets clat (msec): min=494, max=680, avg=587.50, stdev=132.14 lat (msec): min=494, max=681, avg=587.90, stdev=132.00 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=54.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.57%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187711: Fri Oct 10 17:01:54 2025 write: IOPS=1, BW=5624KiB/s (5759kB/s)(12.0MiB/2185msec); 0 zone resets clat (msec): min=80, max=1228, avg=666.48, stdev=574.32 lat (msec): min=81, max=1229, avg=666.85, stdev=574.23 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8192, max= 8192, per=54.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=11.58%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187712: Fri Oct 10 17:01:54 2025 write: IOPS=1, BW=7548KiB/s (7729kB/s)(12.0MiB/1628msec); 0 zone resets clat (msec): min=264, max=889, avg=481.71, stdev=353.55 lat (msec): min=264, max=889, avg=482.02, stdev=353.53 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 5680, max= 7892, per=45.25%, avg=6786.00, stdev=1564.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=20.59%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8115KiB/s (8310kB/s), 2029KiB/s-6853KiB/s (2077kB/s-7018kB/s), io=16.0MiB (16.8MB), run=1793-2019msec WRITE: bw=14.6MiB/s (15.4MB/s), 4057KiB/s-7548KiB/s (4155kB/s-7729kB/s), io=32.0MiB (33.6MB), run=1628-2185msec