== sanity test 398b: DIO and buffer IO race ============== 10:44:19 (1766418259) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.96944 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183818: Mon Dec 22 10:45:20 2025 read: IOPS=29, BW=117KiB/s (120kB/s)(5992KiB/51163msec) clat (usec): min=81, max=808051, avg=18805.81, stdev=22522.86 lat (usec): min=82, max=808052, avg=18808.01, stdev=22522.40 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 18744], | 70.00th=[ 21627], 80.00th=[ 25297], 90.00th=[ 30802], 95.00th=[ 35914], | 99.00th=[ 48497], 99.50th=[ 51119], 99.90th=[ 86508], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 6, max= 200, per=25.00%, avg=116.75, stdev=28.91, samples=101 iops : min= 1, max= 50, avg=28.85, stdev= 7.26, samples=101 write: IOPS=30, BW=123KiB/s (126kB/s)(6296KiB/51163msec); 0 zone resets clat (usec): min=817, max=88392, avg=14424.38, stdev=11979.48 lat (usec): min=818, max=88393, avg=14425.51, stdev=11979.50 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2024], 10.00th=[ 2704], 20.00th=[ 3261], | 30.00th=[ 5080], 40.00th=[ 9110], 50.00th=[11731], 60.00th=[14615], | 70.00th=[18482], 80.00th=[23987], 90.00th=[31327], 95.00th=[37487], | 99.00th=[50070], 99.50th=[57934], 99.90th=[86508], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 40, max= 192, per=25.47%, avg=124.56, stdev=27.70, samples=99 iops : min= 10, max= 48, avg=30.80, stdev= 6.99, samples=99 lat (usec) : 100=0.03%, 250=0.10%, 500=0.78%, 750=0.13%, 1000=0.36% lat (msec) : 2=2.21%, 4=10.58%, 10=16.73%, 20=37.50%, 50=30.76% lat (msec) : 100=0.78%, 1000=0.03% cpu : usr=0.15%, sys=23.59%, ctx=8424, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183819: Mon Dec 22 10:45:20 2025 read: IOPS=29, BW=116KiB/s (119kB/s)(5940KiB/51099msec) clat (usec): min=103, max=91551, avg=18173.48, stdev=9721.28 lat (usec): min=104, max=91552, avg=18177.91, stdev=9718.65 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 7832], 10.00th=[ 8848], 20.00th=[10290], | 30.00th=[11994], 40.00th=[14091], 50.00th=[16450], 60.00th=[18744], | 70.00th=[21365], 80.00th=[24773], 90.00th=[29754], 95.00th=[35390], | 99.00th=[50594], 99.50th=[63177], 99.90th=[80217], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 6, max= 192, per=25.03%, avg=116.89, stdev=27.00, samples=100 iops : min= 1, max= 48, avg=28.88, stdev= 6.78, samples=100 write: IOPS=31, BW=124KiB/s (127kB/s)(6348KiB/51099msec); 0 zone resets clat (usec): min=682, max=795906, avg=15002.80, stdev=23088.36 lat (usec): min=682, max=795908, avg=15005.09, stdev=23088.55 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2024], 10.00th=[ 2606], 20.00th=[ 3228], | 30.00th=[ 5276], 40.00th=[ 9241], 50.00th=[ 11731], 60.00th=[ 14484], | 70.00th=[ 17957], 80.00th=[ 23725], 90.00th=[ 31065], 95.00th=[ 38536], | 99.00th=[ 55313], 99.50th=[ 59507], 99.90th=[ 82314], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 24, max= 208, per=25.43%, avg=124.35, stdev=34.00, samples=100 iops : min= 6, max= 52, avg=30.75, stdev= 8.51, samples=100 lat (usec) : 250=0.16%, 500=0.68%, 750=0.20%, 1000=0.36% lat (msec) : 2=2.08%, 4=10.64%, 10=16.50%, 20=38.54%, 50=29.43% lat (msec) : 100=1.37%, 1000=0.03% cpu : usr=0.11%, sys=23.31%, ctx=8297, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183820: Mon Dec 22 10:45:20 2025 read: IOPS=29, BW=118KiB/s (120kB/s)(6028KiB/51237msec) clat (usec): min=138, max=87245, avg=18329.91, stdev=10169.68 lat (usec): min=140, max=87246, avg=18330.95, stdev=10169.68 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 7439], 10.00th=[ 8848], 20.00th=[10552], | 30.00th=[12387], 40.00th=[14222], 50.00th=[16188], 60.00th=[18744], | 70.00th=[21365], 80.00th=[25035], 90.00th=[30540], 95.00th=[35914], | 99.00th=[54264], 99.50th=[57934], 99.90th=[80217], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 48, max= 192, per=25.68%, avg=119.94, stdev=28.44, samples=100 iops : min= 12, max= 48, avg=29.64, stdev= 7.15, samples=100 write: IOPS=30, BW=122KiB/s (125kB/s)(6260KiB/51237msec); 0 zone resets clat (usec): min=724, max=841853, avg=14901.20, stdev=24043.73 lat (usec): min=725, max=841858, avg=14902.51, stdev=24043.86 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2180], 10.00th=[ 2671], 20.00th=[ 3261], | 30.00th=[ 4817], 40.00th=[ 9241], 50.00th=[ 11600], 60.00th=[ 14353], | 70.00th=[ 18220], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 50594], 99.50th=[ 56886], 99.90th=[ 78119], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 55, max= 199, per=25.46%, avg=124.49, stdev=30.53, samples=100 iops : min= 13, max= 49, avg=30.78, stdev= 7.58, samples=100 lat (usec) : 250=0.16%, 500=0.91%, 750=0.20%, 1000=0.42% lat (msec) : 2=1.66%, 4=11.13%, 10=15.63%, 20=39.71%, 50=28.78% lat (msec) : 100=1.37%, 1000=0.03% cpu : usr=0.13%, sys=23.20%, ctx=8403, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183821: Mon Dec 22 10:45:20 2025 read: IOPS=29, BW=118KiB/s (121kB/s)(6052KiB/51344msec) clat (usec): min=153, max=103409, avg=17955.08, stdev=9913.28 lat (usec): min=154, max=103410, avg=17956.02, stdev=9913.32 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 10290], | 30.00th=[ 11600], 40.00th=[ 13829], 50.00th=[ 16188], 60.00th=[ 18482], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 30016], 95.00th=[ 34866], | 99.00th=[ 50070], 99.50th=[ 62129], 99.90th=[ 83362], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 56, max= 200, per=25.63%, avg=119.70, stdev=24.34, samples=100 iops : min= 14, max= 50, avg=29.58, stdev= 6.18, samples=100 write: IOPS=30, BW=121KiB/s (124kB/s)(6236KiB/51344msec); 0 zone resets clat (usec): min=751, max=839066, avg=15318.17, stdev=24062.22 lat (usec): min=751, max=839069, avg=15319.30, stdev=24062.24 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2114], 10.00th=[ 2573], 20.00th=[ 3261], | 30.00th=[ 5604], 40.00th=[ 10028], 50.00th=[ 12256], 60.00th=[ 15270], | 70.00th=[ 18744], 80.00th=[ 24511], 90.00th=[ 31589], 95.00th=[ 38536], | 99.00th=[ 49546], 99.50th=[ 61604], 99.90th=[ 84411], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 64, max= 192, per=25.21%, avg=123.30, stdev=28.49, samples=100 iops : min= 16, max= 48, avg=30.48, stdev= 7.15, samples=100 lat (usec) : 250=0.13%, 500=1.14%, 750=0.16%, 1000=0.46% lat (msec) : 2=1.82%, 4=10.35%, 10=15.07%, 20=40.20%, 50=29.79% lat (msec) : 100=0.81%, 250=0.03%, 1000=0.03% cpu : usr=0.12%, sys=23.16%, ctx=8365, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=468KiB/s (479kB/s), 116KiB/s-118KiB/s (119kB/s-121kB/s), io=23.4MiB (24.6MB), run=51099-51344msec WRITE: bw=490KiB/s (501kB/s), 121KiB/s-124KiB/s (124kB/s-127kB/s), io=24.6MiB (25.7MB), run=51099-51344msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183822: Mon Dec 22 10:45:32 2025 read: IOPS=23, BW=94.1KiB/s (96.4kB/s)(5992KiB/63681msec) clat (msec): min=3, max=812, avg=18.06, stdev=24.42 lat (msec): min=3, max=812, avg=18.06, stdev=24.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 64], 99.50th=[ 71], 99.90th=[ 108], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 24, max= 360, per=25.24%, avg=94.41, stdev=58.75, samples=125 iops : min= 6, max= 90, avg=23.33, stdev=14.76, samples=125 write: IOPS=24, BW=98.9KiB/s (101kB/s)(6296KiB/63681msec); 0 zone resets clat (msec): min=5, max=111, avg=23.10, stdev=15.43 lat (msec): min=5, max=111, avg=23.10, stdev=15.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 75], 99.50th=[ 92], 99.90th=[ 110], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 24, max= 280, per=25.53%, avg=99.81, stdev=55.54, samples=124 iops : min= 6, max= 70, avg=24.68, stdev=13.93, samples=124 lat (msec) : 4=0.49%, 10=26.86%, 20=34.34%, 50=33.72%, 100=4.43% lat (msec) : 250=0.13%, 1000=0.03% cpu : usr=0.13%, sys=10.37%, ctx=5592, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183823: Mon Dec 22 10:45:32 2025 read: IOPS=23, BW=93.0KiB/s (95.3kB/s)(5940KiB/63847msec) clat (msec): min=3, max=811, avg=18.01, stdev=24.75 lat (msec): min=3, max=811, avg=18.01, stdev=24.75 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 70], 99.50th=[ 80], 99.90th=[ 111], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8, max= 320, per=25.04%, avg=93.66, stdev=56.64, samples=126 iops : min= 2, max= 80, avg=23.14, stdev=14.21, samples=126 write: IOPS=24, BW=99.4KiB/s (102kB/s)(6348KiB/63847msec); 0 zone resets clat (msec): min=4, max=117, avg=23.21, stdev=15.10 lat (msec): min=4, max=117, avg=23.21, stdev=15.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 72], 99.50th=[ 92], 99.90th=[ 109], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 8, max= 328, per=25.53%, avg=99.82, stdev=54.53, samples=126 iops : min= 2, max= 82, avg=24.68, stdev=13.69, samples=126 lat (msec) : 4=0.42%, 10=25.42%, 20=36.59%, 50=32.75%, 100=4.59% lat (msec) : 250=0.20%, 1000=0.03% cpu : usr=0.11%, sys=10.60%, ctx=5530, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183824: Mon Dec 22 10:45:32 2025 read: IOPS=23, BW=94.3KiB/s (96.5kB/s)(6028KiB/63942msec) clat (usec): min=3025, max=92537, avg=17661.56, stdev=13269.83 lat (usec): min=3026, max=92538, avg=17662.64, stdev=13269.83 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 5145], 10.00th=[ 5800], 20.00th=[ 7504], | 30.00th=[ 9372], 40.00th=[11207], 50.00th=[13304], 60.00th=[15795], | 70.00th=[19530], 80.00th=[26084], 90.00th=[36439], 95.00th=[45351], | 99.00th=[65799], 99.50th=[70779], 99.90th=[83362], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 32, max= 312, per=25.48%, avg=95.30, stdev=53.46, samples=125 iops : min= 8, max= 78, avg=23.55, stdev=13.43, samples=125 write: IOPS=24, BW=97.9KiB/s (100kB/s)(6260KiB/63942msec); 0 zone resets clat (msec): min=5, max=815, avg=23.68, stdev=25.07 lat (msec): min=5, max=815, avg=23.68, stdev=25.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 72], 99.50th=[ 82], 99.90th=[ 112], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 16, max= 352, per=25.09%, avg=98.10, stdev=55.00, samples=126 iops : min= 4, max= 88, avg=24.25, stdev=13.83, samples=126 lat (msec) : 4=0.52%, 10=24.90%, 20=37.11%, 50=32.39%, 100=4.98% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.09%, sys=10.51%, ctx=5650, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183825: Mon Dec 22 10:45:32 2025 read: IOPS=23, BW=94.3KiB/s (96.6kB/s)(6052KiB/64154msec) clat (msec): min=2, max=112, avg=17.74, stdev=13.88 lat (msec): min=2, max=112, avg=17.74, stdev=13.88 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 67], 99.50th=[ 73], 99.90th=[ 93], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 31, max= 352, per=25.24%, avg=94.41, stdev=56.43, samples=125 iops : min= 7, max= 88, avg=23.33, stdev=14.18, samples=125 write: IOPS=24, BW=97.2KiB/s (99.5kB/s)(6236KiB/64154msec); 0 zone resets clat (msec): min=4, max=817, avg=23.77, stdev=25.30 lat (msec): min=4, max=817, avg=23.77, stdev=25.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 74], 99.50th=[ 80], 99.90th=[ 121], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 16, max= 304, per=24.70%, avg=96.58, stdev=55.11, samples=126 iops : min= 4, max= 76, avg=23.87, stdev=13.83, samples=126 lat (msec) : 4=1.17%, 10=25.75%, 20=35.03%, 50=33.14%, 100=4.75% lat (msec) : 250=0.13%, 1000=0.03% cpu : usr=0.11%, sys=10.27%, ctx=5440, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 93.0KiB/s-94.3KiB/s (95.3kB/s-96.6kB/s), io=23.4MiB (24.6MB), run=63681-64154msec WRITE: bw=392KiB/s (401kB/s), 97.2KiB/s-99.4KiB/s (99.5kB/s-102kB/s), io=24.6MiB (25.7MB), run=63681-64154msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183855: Mon Dec 22 10:45:53 2025 read: IOPS=26, BW=423KiB/s (434kB/s)(5920KiB/13979msec) clat (usec): min=172, max=79655, avg=18771.24, stdev=10902.94 lat (usec): min=173, max=79656, avg=18772.04, stdev=10902.92 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 482], 10.00th=[ 8455], 20.00th=[10814], | 30.00th=[13042], 40.00th=[15401], 50.00th=[17695], 60.00th=[19268], | 70.00th=[22676], 80.00th=[25822], 90.00th=[31851], 95.00th=[35914], | 99.00th=[55837], 99.50th=[62129], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 287, max= 640, per=25.09%, avg=417.52, stdev=116.27, samples=27 iops : min= 17, max= 40, avg=25.59, stdev= 7.31, samples=27 write: IOPS=28, BW=456KiB/s (466kB/s)(6368KiB/13979msec); 0 zone resets clat (usec): min=1096, max=62790, avg=17629.51, stdev=12338.85 lat (usec): min=1097, max=62792, avg=17631.02, stdev=12338.90 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3785], 10.00th=[ 4621], 20.00th=[ 6259], | 30.00th=[ 9896], 40.00th=[12256], 50.00th=[14484], 60.00th=[16450], | 70.00th=[22152], 80.00th=[27657], 90.00th=[35390], 95.00th=[42206], | 99.00th=[55837], 99.50th=[62129], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 319, max= 606, per=26.00%, avg=455.33, stdev=85.76, samples=27 iops : min= 19, max= 37, avg=27.96, stdev= 5.39, samples=27 lat (usec) : 250=0.13%, 500=2.34%, 750=0.78%, 1000=0.26% lat (msec) : 2=0.78%, 4=2.73%, 10=16.02%, 20=40.89%, 50=34.24% lat (msec) : 100=1.82% cpu : usr=0.12%, sys=27.56%, ctx=2544, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183856: Mon Dec 22 10:45:53 2025 read: IOPS=24, BW=399KiB/s (409kB/s)(5744KiB/14391msec) clat (usec): min=151, max=77372, avg=20159.06, stdev=11575.55 lat (usec): min=152, max=77372, avg=20159.79, stdev=11575.56 clat percentiles (usec): | 1.00th=[ 239], 5.00th=[ 611], 10.00th=[ 8979], 20.00th=[11469], | 30.00th=[14091], 40.00th=[16450], 50.00th=[18744], 60.00th=[20579], | 70.00th=[23462], 80.00th=[27395], 90.00th=[33817], 95.00th=[39060], | 99.00th=[62653], 99.50th=[67634], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 159, max= 608, per=23.73%, avg=394.86, stdev=109.85, samples=28 iops : min= 9, max= 38, avg=24.14, stdev= 6.89, samples=28 write: IOPS=28, BW=455KiB/s (466kB/s)(6544KiB/14391msec); 0 zone resets clat (usec): min=1147, max=88989, avg=17456.73, stdev=12855.36 lat (usec): min=1147, max=88991, avg=17458.45, stdev=12855.43 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 3326], 10.00th=[ 4555], 20.00th=[ 6521], | 30.00th=[ 9503], 40.00th=[12387], 50.00th=[14222], 60.00th=[17171], | 70.00th=[20579], 80.00th=[27132], 90.00th=[34341], 95.00th=[40109], | 99.00th=[58983], 99.50th=[62129], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 190, max= 640, per=25.38%, avg=444.39, stdev=119.38, samples=28 iops : min= 11, max= 40, avg=27.25, stdev= 7.56, samples=28 lat (usec) : 250=0.52%, 500=1.43%, 750=0.39%, 1000=0.13% lat (msec) : 2=0.91%, 4=3.12%, 10=16.28%, 20=40.89%, 50=33.46% lat (msec) : 100=2.86% cpu : usr=0.15%, sys=27.24%, ctx=2702, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183857: Mon Dec 22 10:45:53 2025 read: IOPS=27, BW=439KiB/s (450kB/s)(6256KiB/14247msec) clat (usec): min=150, max=63214, avg=19546.00, stdev=10336.50 lat (usec): min=151, max=63214, avg=19546.94, stdev=10336.71 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 2147], 10.00th=[ 9503], 20.00th=[11863], | 30.00th=[13566], 40.00th=[15926], 50.00th=[18220], 60.00th=[20317], | 70.00th=[23200], 80.00th=[25560], 90.00th=[32113], 95.00th=[38536], | 99.00th=[52691], 99.50th=[60031], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 256, max= 606, per=26.53%, avg=441.43, stdev=94.17, samples=28 iops : min= 16, max= 37, avg=27.07, stdev= 5.81, samples=28 write: IOPS=26, BW=423KiB/s (434kB/s)(6032KiB/14247msec); 0 zone resets clat (usec): min=1334, max=54616, avg=17466.30, stdev=11918.39 lat (usec): min=1337, max=54619, avg=17467.96, stdev=11918.40 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 3851], 10.00th=[ 4555], 20.00th=[ 6325], | 30.00th=[10290], 40.00th=[11863], 50.00th=[14484], 60.00th=[17433], | 70.00th=[21890], 80.00th=[27132], 90.00th=[36439], 95.00th=[42730], | 99.00th=[50594], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 256, max= 638, per=23.84%, avg=417.46, stdev=109.55, samples=28 iops : min= 16, max= 39, avg=25.57, stdev= 6.83, samples=28 lat (usec) : 250=0.13%, 500=2.08%, 750=0.26% lat (msec) : 2=0.78%, 4=2.08%, 10=14.71%, 20=42.06%, 50=36.33% lat (msec) : 100=1.56% cpu : usr=0.18%, sys=27.31%, ctx=2751, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183858: Mon Dec 22 10:45:53 2025 read: IOPS=27, BW=442KiB/s (452kB/s)(6032KiB/13662msec) clat (usec): min=139, max=91456, avg=18857.49, stdev=11573.43 lat (usec): min=140, max=91456, avg=18859.78, stdev=11572.55 clat percentiles (usec): | 1.00th=[ 249], 5.00th=[ 392], 10.00th=[ 8094], 20.00th=[11469], | 30.00th=[13435], 40.00th=[15139], 50.00th=[16909], 60.00th=[19530], | 70.00th=[22938], 80.00th=[25822], 90.00th=[32375], 95.00th=[38536], | 99.00th=[59507], 99.50th=[78119], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 223, max= 606, per=26.37%, avg=438.78, stdev=83.01, samples=27 iops : min= 13, max= 37, avg=26.93, stdev= 5.16, samples=27 write: IOPS=28, BW=458KiB/s (469kB/s)(6256KiB/13662msec); 0 zone resets clat (usec): min=1692, max=79558, avg=16703.75, stdev=13065.48 lat (usec): min=1694, max=79560, avg=16705.42, stdev=13065.59 clat percentiles (usec): | 1.00th=[ 3032], 5.00th=[ 3720], 10.00th=[ 4424], 20.00th=[ 5276], | 30.00th=[ 7701], 40.00th=[10290], 50.00th=[13042], 60.00th=[16319], | 70.00th=[20579], 80.00th=[26870], 90.00th=[33817], 95.00th=[41681], | 99.00th=[61080], 99.50th=[78119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 255, max= 736, per=26.21%, avg=458.89, stdev=126.77, samples=27 iops : min= 15, max= 46, avg=28.19, stdev= 8.05, samples=27 lat (usec) : 250=0.52%, 500=2.86%, 750=0.65%, 1000=0.13% lat (msec) : 2=0.52%, 4=3.12%, 10=19.40%, 20=38.80%, 50=32.03% lat (msec) : 100=1.95% cpu : usr=0.10%, sys=27.59%, ctx=2551, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1664KiB/s (1704kB/s), 399KiB/s-442KiB/s (409kB/s-452kB/s), io=23.4MiB (24.5MB), run=13662-14391msec WRITE: bw=1751KiB/s (1793kB/s), 423KiB/s-458KiB/s (434kB/s-469kB/s), io=24.6MiB (25.8MB), run=13662-14391msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183850: Mon Dec 22 10:45:55 2025 read: IOPS=22, BW=359KiB/s (368kB/s)(5920KiB/16471msec) clat (msec): min=3, max=104, avg=18.61, stdev=13.92 lat (msec): min=3, max=104, avg=18.61, stdev=13.92 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 62], 99.50th=[ 68], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 159, max= 864, per=24.00%, avg=346.03, stdev=168.12, samples=32 iops : min= 9, max= 54, avg=21.09, stdev=10.72, samples=32 write: IOPS=24, BW=387KiB/s (396kB/s)(6368KiB/16471msec); 0 zone resets clat (msec): min=5, max=112, avg=23.97, stdev=15.66 lat (msec): min=5, max=112, avg=23.97, stdev=15.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 82], 99.50th=[ 91], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 191, max= 896, per=24.44%, avg=371.03, stdev=165.74, samples=32 iops : min= 11, max= 56, avg=22.66, stdev=10.53, samples=32 lat (msec) : 4=0.13%, 10=23.44%, 20=36.33%, 50=35.29%, 100=4.56% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=11.54%, ctx=1459, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183851: Mon Dec 22 10:45:55 2025 read: IOPS=21, BW=346KiB/s (354kB/s)(5744KiB/16599msec) clat (usec): min=3959, max=93603, avg=18581.48, stdev=14606.65 lat (usec): min=3960, max=93606, avg=18582.39, stdev=14606.65 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 5145], 10.00th=[ 6194], 20.00th=[ 7635], | 30.00th=[ 9241], 40.00th=[10945], 50.00th=[13042], 60.00th=[15533], | 70.00th=[20055], 80.00th=[28181], 90.00th=[41157], 95.00th=[51643], | 99.00th=[62129], 99.50th=[71828], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 127, max= 800, per=22.94%, avg=330.84, stdev=166.87, samples=32 iops : min= 7, max= 50, avg=20.16, stdev=10.65, samples=32 write: IOPS=24, BW=394KiB/s (404kB/s)(6544KiB/16599msec); 0 zone resets clat (usec): min=5218, max=92493, avg=24143.75, stdev=16328.23 lat (usec): min=5219, max=92494, avg=24145.61, stdev=16328.24 clat percentiles (usec): | 1.00th=[ 6915], 5.00th=[ 7701], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[12256], 40.00th=[15139], 50.00th=[18744], 60.00th=[24249], | 70.00th=[29492], 80.00th=[36439], 90.00th=[49021], 95.00th=[54789], | 99.00th=[74974], 99.50th=[78119], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 192, max= 1056, per=24.30%, avg=368.88, stdev=192.70, samples=32 iops : min= 12, max= 66, avg=22.53, stdev=12.21, samples=32 lat (msec) : 4=0.13%, 10=26.56%, 20=34.11%, 50=31.90%, 100=7.29% cpu : usr=0.10%, sys=11.42%, ctx=1378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183852: Mon Dec 22 10:45:55 2025 read: IOPS=23, BW=378KiB/s (387kB/s)(6256KiB/16554msec) clat (usec): min=3477, max=91653, avg=19092.28, stdev=15109.94 lat (usec): min=3478, max=91653, avg=19093.42, stdev=15109.84 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5669], 10.00th=[ 6390], 20.00th=[ 7963], | 30.00th=[ 9372], 40.00th=[11338], 50.00th=[13304], 60.00th=[16450], | 70.00th=[20055], 80.00th=[28181], 90.00th=[42206], 95.00th=[52167], | 99.00th=[70779], 99.50th=[74974], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 159, max= 1088, per=25.19%, avg=363.25, stdev=197.91, samples=32 iops : min= 9, max= 68, avg=22.19, stdev=12.52, samples=32 write: IOPS=22, BW=364KiB/s (373kB/s)(6032KiB/16555msec); 0 zone resets clat (usec): min=5843, max=97475, avg=23923.87, stdev=15690.47 lat (usec): min=5844, max=97478, avg=23932.85, stdev=15690.17 clat percentiles (usec): | 1.00th=[ 6325], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[11076], | 30.00th=[13435], 40.00th=[15926], 50.00th=[19268], 60.00th=[23987], | 70.00th=[28181], 80.00th=[34866], 90.00th=[45876], 95.00th=[53740], | 99.00th=[85459], 99.50th=[92799], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 159, max= 960, per=22.60%, avg=343.03, stdev=169.58, samples=32 iops : min= 9, max= 60, avg=20.91, stdev=10.76, samples=32 lat (msec) : 4=0.26%, 10=23.44%, 20=36.59%, 50=33.33%, 100=6.38% cpu : usr=0.12%, sys=11.63%, ctx=1476, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183853: Mon Dec 22 10:45:55 2025 read: IOPS=23, BW=371KiB/s (380kB/s)(6032KiB/16246msec) clat (usec): min=4073, max=76431, avg=18293.07, stdev=13085.77 lat (usec): min=4074, max=76431, avg=18294.08, stdev=13085.75 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5932], 10.00th=[ 6587], 20.00th=[ 8225], | 30.00th=[ 9896], 40.00th=[11863], 50.00th=[13960], 60.00th=[16450], | 70.00th=[19792], 80.00th=[26608], 90.00th=[38011], 95.00th=[46400], | 99.00th=[61080], 99.50th=[72877], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 159, max= 1152, per=25.39%, avg=366.06, stdev=200.94, samples=32 iops : min= 9, max= 72, avg=22.34, stdev=12.73, samples=32 write: IOPS=24, BW=385KiB/s (394kB/s)(6256KiB/16246msec); 0 zone resets clat (msec): min=5, max=111, avg=23.85, stdev=14.43 lat (msec): min=5, max=111, avg=23.85, stdev=14.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 66], 99.50th=[ 69], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 160, max= 864, per=25.14%, avg=381.59, stdev=168.52, samples=32 iops : min= 10, max= 54, avg=23.31, stdev=10.67, samples=32 lat (msec) : 10=21.48%, 20=39.58%, 50=34.64%, 100=4.17%, 250=0.13% cpu : usr=0.12%, sys=12.05%, ctx=1454, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1443KiB/s (1478kB/s), 346KiB/s-378KiB/s (354kB/s-387kB/s), io=23.4MiB (24.5MB), run=16246-16599msec WRITE: bw=1518KiB/s (1555kB/s), 364KiB/s-394KiB/s (373kB/s-404kB/s), io=24.6MiB (25.8MB), run=16246-16599msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183866: Mon Dec 22 10:46:05 2025 read: IOPS=2, BW=2098KiB/s (2149kB/s)(7168KiB/3416msec) clat (msec): min=60, max=397, avg=161.91, stdev=128.69 lat (msec): min=60, max=397, avg=161.91, stdev=128.69 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 93], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 275], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2039, max= 7086, per=76.15%, avg=3724.33, stdev=2911.29, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=1, BW=1499KiB/s (1535kB/s)(5120KiB/3416msec); 0 zone resets clat (msec): min=83, max=788, avg=452.79, stdev=296.44 lat (msec): min=83, max=788, avg=452.90, stdev=296.42 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1771, max= 4096, per=38.20%, avg=2615.67, stdev=1286.26, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=41.67%, 250=8.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=16.87%, ctx=256, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183867: Mon Dec 22 10:46:05 2025 read: IOPS=0, BW=497KiB/s (509kB/s)(2048KiB/4120msec) clat (msec): min=84, max=708, avg=396.36, stdev=441.21 lat (msec): min=84, max=708, avg=396.36, stdev=441.21 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1747, max= 2048, per=38.80%, avg=1897.50, stdev=212.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2485KiB/s (2545kB/s)(10.0MiB/4120msec); 0 zone resets clat (msec): min=67, max=941, avg=330.11, stdev=293.80 lat (msec): min=67, max=941, avg=330.22, stdev=293.79 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 96], 50.00th=[ 243], 60.00th=[ 255], | 70.00th=[ 330], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1868, max= 4079, per=39.54%, avg=2707.40, stdev=1009.24, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 0.84, samples=5 lat (msec) : 100=41.67%, 250=8.33%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=15.44%, ctx=184, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183868: Mon Dec 22 10:46:05 2025 read: IOPS=1, BW=1647KiB/s (1686kB/s)(6144KiB/3731msec) clat (msec): min=191, max=960, avg=413.58, stdev=282.12 lat (msec): min=191, max=960, avg=413.58, stdev=282.12 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 380], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], rand-rw: (groupid=0, jobs=1): err= 0: pid=183871: Mon Dec 22 10:46:05 2025 read: IOPS=2, BW=2105KiB/s (2156kB/s)(7168KiB/3405msec) clat (usec): min=836, max=331270, avg=178366.53, stdev=106863.92 lat (usec): min=838, max=331272, avg=178367.99, stdev=106864.02 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[106431], | 30.00th=[156238], 40.00th=[156238], 50.00th=[175113], 60.00th=[227541], | 70.00th=[227541], 80.00th=[252707], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2048, max= 4248, per=64.38%, avg=3326.33, stdev=1142.54, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1504KiB/s (1540kB/s)(5120KiB/3405msec); 0 zone resets clat (msec): min=179, max=1058, avg=430.70, stdev=358.84 lat (msec): min=179, max=1058, avg=430.81, stdev=358.83 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1841, max= 2048, per=26.90%, avg=1946.25, stdev=117.53, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.06%, sys=52.67%, ctx=1197, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183872: Mon Dec 22 10:46:05 2025 read: IOPS=0, BW=517KiB/s (529kB/s)(2048KiB/3963msec) clat (usec): min=1113, max=411986, avg=206550.14, stdev=290531.51 lat (usec): min=1114, max=411988, avg=206551.46, stdev=290532.33 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1106], 20.00th=[ 1106], | 30.00th=[ 1106], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[413139], | 70.00th=[413139], 80.00th=[413139], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 1976, max= 2048, per=38.94%, avg=2012.00, stdev=50.91, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2584KiB/s (2646kB/s)(10.0MiB/3963msec); 0 zone resets clat (msec): min=51, max=681, avg=354.75, stdev=189.36 lat (msec): min=51, max=681, avg=354.82, stdev=189.35 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 144], | 30.00th=[ 268], 40.00th=[ 305], 50.00th=[ 334], 60.00th=[ 347], | 70.00th=[ 397], 80.00th=[ 422], 90.00th=[ 609], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2048, max= 4096, per=38.53%, avg=2787.20, stdev=1022.02, samples=5 iops : min= 2, max= 4, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.03%, sys=50.15%, ctx=371, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183873: Mon Dec 22 | 99.99th=[ 961] 10:46:05 2025 read: IOPS=2, BW=2311KiB/s (2366kB/s)(6144KiB/2659msec) clat (usec): min=1206, max=315048, avg=77393.61, stdev=121583.58 lat (usec): min=1207, max=315049, avg=77395.21, stdev=121583.42 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1205], 10.00th=[ 1205], 20.00th=[ 1287], | 30.00th=[ 1287], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 69731], | 70.00th=[ 76022], 80.00th=[ 76022], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1841, max= 5545, per=60.86%, avg=3144.67, stdev=2081.32, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2311KiB/s (2366kB/s)(6144KiB/2659msec); 0 zone resets clat (msec): min=256, max=648, avg=365.20, stdev=154.98 lat (msec): min=256, max=648, avg=365.29, stdev=154.99 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 292], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1841, max= 2771, per=29.40%, avg=2127.00, stdev=439.93, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 2=25.00%, 100=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.04%, sys=53.20%, ctx=182, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183874: Mon Dec 22 10:46:05 2025 read: IOPS=1, BW=1597KiB/s (1635kB/s)(5120KiB/3206msec) clat (usec): min=1182, max=307911, avg=76149.11, stdev=132801.32 lat (usec): min=1182, max=307912, avg=76150.13, stdev=132801.50 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1188], 10.00th=[ 1188], 20.00th=[ 1188], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1532], 60.00th=[ 1532], | 70.00th=[ 68682], 80.00th=[ 68682], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2236KiB/s (2289kB/s)(7168KiB/3206msec); 0 zone resets clat (msec): min=222, max=644, avg=403.22, stdev=172.16 lat (msec): min=222, max=644, avg=403.32, stdev=172.18 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 236], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 397], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 558], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1368, max= 4096, per=30.97%, avg=2240.20, stdev=1067.10, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 2=25.00%, 100=8.33%, 250=16.67%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=54.54%, ctx=426, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5168KiB/s (5292kB/s), 517KiB/s-2311KiB/s (529kB/s-2366kB/s), io=20.0MiB (20.0MB), run=2659-3963ms bw ( KiB/s): min= 1868, max= 4079, per=50.99%, avg=2493.75, stdev=1059.44, samples=4 ec iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 WRITE: bw=7235KiB/s (7409kB/s), 1504KiB/s-2584KiB/s (1540kB/s-2646kB/s), io=28.0MiB (29.4MB), run=2659-3963msec write: IOPS=1, BW=1647KiB/s (1686kB/s)(6144KiB/3731msec); 0 zone resets clat (msec): min=51, max=612, avg=205.92, stdev=207.23 lat (msec): min=51, max=612, avg=206.03, stdev=207.21 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 169], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1868, max= 5242, per=40.67%, avg=2784.50, stdev=1640.01, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=21.31%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183869: Mon Dec 22 10:46:05 2025 read: IOPS=1, BW=1223KiB/s (1252kB/s)(5120KiB/4187msec) clat (msec): min=53, max=922, avg=414.57, stdev=353.64 lat (msec): min=53, max=922, avg=414.57, stdev=353.64 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1868, max= 4096, per=54.60%, avg=2670.67, stdev=1237.65, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1712KiB/s (1753kB/s)(7168KiB/4187msec); 0 zone resets clat (msec): min=94, max=597, avg=298.20, stdev=168.33 lat (msec): min=94, max=597, avg=298.34, stdev=168.35 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 133], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 288], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 388], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1980, max= 4096, per=40.02%, avg=2740.00, stdev=1002.72, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=16.15%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4891KiB/s (5009kB/s), 497KiB/s-2098KiB/s (509kB/s-2149kB/s), io=20.0MiB (20.0MB), run=3416-4187msec WRITE: bw=6848KiB/s (7012kB/s), 1499KiB/s-2485KiB/s (1535kB/s-2545kB/s), io=28.0MiB (29.4MB), run=3416-4187msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183884: Mon Dec 22 10:46:15 2025 read: IOPS=1, BW=8026KiB/s (8219kB/s)(12.0MiB/1531msec) clat (msec): min=422, max=519, avg=465.85, stdev=49.20 lat (msec): min=422, max=519, avg=465.85, stdev=49.20 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 5720, max= 8192, per=70.91%, avg=6956.00, stdev=1747.97, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=48.24%, ctx=2846, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183885: Mon Dec 22 10:46:15 2025 read: IOPS=0, BW=2453KiB/s (2512kB/s)(4096KiB/1670msec) clat (nsec): min=427589k, max=427589k, avg=427588926.00, stdev= 0.00 lat (nsec): min=427590k, max=427590k, avg=427589906.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 5769, max= 5769, per=58.81%, avg=5769.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4905KiB/s (5023kB/s)(8192KiB/1670msec); 0 zone resets clat (msec): min=447, max=666, avg=557.14, stdev=154.76 lat (msec): min=448, max=666, avg=557.47, stdev=154.70 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=30.02%, ctx=954, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183886: Mon Dec 22 10:46:15 2025 write: IOPS=1, BW=6184KiB/s (6333kB/s)(12.0MiB/1987msec); 0 zone resets clat (msec): min=134, max=1163, avg=620.64, stdev=516.62 lat (msec): min=134, max=1166, avg=622.11, stdev=518.46 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8175, per=49.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.10%, sys=18.33%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183887: Mon Dec 22 10:46:15 2025 write: IOPS=1, BW=6599KiB/s (6758kB/s)(12.0MiB/1862msec); 0 zone resets clat (msec): min=483, max=723, avg=582.14, stdev=125.63 lat (msec): min=484, max=724, avg=582.53, stdev=125.63 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 5868, max= 8175, per=42.58%, avg=7021.50, stdev=1631.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.05%, sys=17.84%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9811KiB/s (10.0MB/s), 2453KiB/s-8026KiB/s (2512kB/s-8219kB/s), io=16.0MiB (16.8MB), run=1531-1670msec WRITE: bw=16.1MiB/s (16.9MB/s), 4905KiB/s-6599KiB/s (5023kB/s-6758kB/s), io=32.0MiB (33.6MB), run=1670-1987msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183879: Mon Dec 22 10:46:15 2025 read: IOPS=1, BW=6872KiB/s (7037kB/s)(12.0MiB/1788msec) clat (msec): min=217, max=832, avg=557.46, stdev=312.62 lat (msec): min=217, max=832, avg=557.47, stdev=312.62 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.07%, ctx=267, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183880: Mon Dec 22 10:46:15 2025 read: IOPS=0, BW=1802KiB/s (1845kB/s)(4096KiB/2273msec) clat (nsec): min=854698k, max=854698k, avg=854698411.00, stdev= 0.00 lat (nsec): min=854701k, max=854701k, avg=854701444.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3604KiB/s (3691kB/s)(8192KiB/2273msec); 0 zone resets clat (msec): min=322, max=973, avg=648.05, stdev=460.49 lat (msec): min=322, max=974, avg=648.56, stdev=460.63 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8159, max= 8159, per=56.60%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.09%, sys=15.45%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183882: Mon Dec 22 10:46:15 2025 write: IOPS=1, BW=5416KiB/s (5546kB/s)(12.0MiB/2269msec); 0 zone resets clat (msec): min=146, max=1577, avg=714.90, stdev=759.56 lat (msec): min=146, max=1577, avg=715.29, stdev=759.58 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8159, max= 8159, per=56.60%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=15.30%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183883: Mon Dec 22 10:46:15 2025 write: IOPS=1, BW=6711KiB/s (6872kB/s)(12.0MiB/1831msec); 0 zone resets clat (msec): min=193, max=1291, avg=571.38, stdev=624.33 lat (msec): min=193, max=1292, avg=571.76, stdev=624.35 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8175, max= 8192, per=56.77%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.11%, sys=14.97%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7208KiB/s (7381kB/s), 1802KiB/s-6872KiB/s (1845kB/s-7037kB/s), io=16.0MiB (16.8MB), run=1788-2273msec WRITE: bw=14.1MiB/s (14.8MB/s), 3604KiB/s-6711KiB/s (3691kB/s-6872kB/s), io=32.0MiB (33.6MB), run=1831-2273msec