== sanity test 398b: DIO and buffer IO race ============== 09:56:08 (1789307768) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.1674 s, 15.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181478: Sun Sep 13 09:57:08 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(5992KiB/49130msec) clat (usec): min=64, max=95818, avg=17084.52, stdev=9507.23 lat (usec): min=65, max=95818, avg=17085.30, stdev=9507.60 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 6587], 10.00th=[ 7832], 20.00th=[ 9896], | 30.00th=[11600], 40.00th=[13304], 50.00th=[15533], 60.00th=[17695], | 70.00th=[19792], 80.00th=[23200], 90.00th=[28181], 95.00th=[33817], | 99.00th=[49546], 99.50th=[58459], 99.90th=[87557], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 7, max= 207, per=24.85%, avg=121.26, stdev=38.27, samples=97 iops : min= 1, max= 51, avg=29.93, stdev= 9.67, samples=97 write: IOPS=32, BW=128KiB/s (131kB/s)(6296KiB/49130msec); 0 zone resets clat (usec): min=642, max=691855, avg=14772.46, stdev=20451.14 lat (usec): min=643, max=691856, avg=14776.32, stdev=20452.50 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2212], 10.00th=[ 2704], 20.00th=[ 3621], | 30.00th=[ 6390], 40.00th=[ 9241], 50.00th=[ 11731], 60.00th=[ 14746], | 70.00th=[ 18220], 80.00th=[ 23200], 90.00th=[ 30278], 95.00th=[ 36963], | 99.00th=[ 48497], 99.50th=[ 55837], 99.90th=[ 64750], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 232, per=24.82%, avg=126.86, stdev=39.93, samples=97 iops : min= 1, max= 58, avg=31.33, stdev=10.04, samples=97 lat (usec) : 100=0.36%, 250=0.81%, 500=0.03%, 750=0.10%, 1000=0.29% lat (msec) : 2=1.50%, 4=9.57%, 10=19.56%, 20=39.75%, 50=27.15% lat (msec) : 100=0.85%, 750=0.03% cpu : usr=0.14%, sys=25.68%, ctx=9208, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181479: Sun Sep 13 09:57:08 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48172msec) clat (usec): min=39, max=727230, avg=17634.44, stdev=20735.24 lat (usec): min=40, max=727230, avg=17635.40, stdev=20735.21 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 6587], 10.00th=[ 8029], 20.00th=[ 9634], | 30.00th=[ 11076], 40.00th=[ 13173], 50.00th=[ 15533], 60.00th=[ 17433], | 70.00th=[ 20055], 80.00th=[ 22938], 90.00th=[ 29492], 95.00th=[ 34341], | 99.00th=[ 50070], 99.50th=[ 66323], 99.90th=[ 74974], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 216, per=25.11%, avg=122.55, stdev=37.26, samples=95 iops : min= 1, max= 54, avg=30.24, stdev= 9.42, samples=95 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48172msec); 0 zone resets clat (usec): min=670, max=83858, avg=13664.63, stdev=11007.64 lat (usec): min=671, max=83860, avg=13667.25, stdev=11006.22 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2180], 10.00th=[ 2671], 20.00th=[ 3490], | 30.00th=[ 5211], 40.00th=[ 8979], 50.00th=[11076], 60.00th=[14091], | 70.00th=[17695], 80.00th=[21890], 90.00th=[28443], 95.00th=[34341], | 99.00th=[46400], 99.50th=[54789], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 47, max= 216, per=25.66%, avg=131.12, stdev=39.64, samples=94 iops : min= 11, max= 54, avg=32.38, stdev= 9.99, samples=94 lat (usec) : 50=0.03%, 100=0.20%, 250=0.55%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.42% lat (msec) : 2=1.43%, 4=10.29%, 10=20.64%, 20=39.03%, 50=26.40% lat (msec) : 100=0.81%, 750=0.03% cpu : usr=0.14%, sys=26.29%, ctx=8910, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181480: Sun Sep 13 09:57:08 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(6028KiB/48985msec) clat (usec): min=49, max=97425, avg=17190.02, stdev=10078.53 lat (usec): min=49, max=97425, avg=17190.83, stdev=10078.61 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 6652], 10.00th=[ 7832], 20.00th=[ 9503], | 30.00th=[11076], 40.00th=[13304], 50.00th=[15139], 60.00th=[17171], | 70.00th=[20055], 80.00th=[23462], 90.00th=[29492], 95.00th=[35390], | 99.00th=[50594], 99.50th=[61604], 99.90th=[85459], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 47, max= 216, per=25.38%, avg=123.84, stdev=37.46, samples=96 iops : min= 11, max= 54, avg=30.58, stdev= 9.44, samples=96 write: IOPS=31, BW=128KiB/s (131kB/s)(6260KiB/48985msec); 0 zone resets clat (usec): min=654, max=696078, avg=14562.46, stdev=20423.63 lat (usec): min=655, max=696079, avg=14563.49, stdev=20423.71 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 2147], 10.00th=[ 2704], 20.00th=[ 3556], | 30.00th=[ 6259], 40.00th=[ 9372], 50.00th=[ 11731], 60.00th=[ 14877], | 70.00th=[ 18482], 80.00th=[ 22414], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 47973], 99.50th=[ 56361], 99.90th=[ 76022], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 224, per=24.86%, avg=127.02, stdev=40.32, samples=97 iops : min= 3, max= 56, avg=31.36, stdev=10.23, samples=97 lat (usec) : 50=0.03%, 100=0.42%, 250=0.78%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.52% lat (msec) : 2=1.60%, 4=8.76%, 10=20.64%, 20=39.10%, 50=27.05% lat (msec) : 100=0.98%, 750=0.03% cpu : usr=0.09%, sys=25.84%, ctx=9024, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181481: Sun Sep 13 09:57:08 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6052KiB/48935msec) clat (usec): min=31, max=81079, avg=17277.82, stdev=9711.45 lat (usec): min=32, max=81080, avg=17278.61, stdev=9711.55 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 6587], 10.00th=[ 8029], 20.00th=[ 9634], | 30.00th=[11207], 40.00th=[13435], 50.00th=[15533], 60.00th=[17433], | 70.00th=[20055], 80.00th=[23462], 90.00th=[30016], 95.00th=[35390], | 99.00th=[49021], 99.50th=[57410], 99.90th=[67634], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 47, max= 208, per=25.52%, avg=124.52, stdev=34.50, samples=96 iops : min= 11, max= 52, avg=30.75, stdev= 8.68, samples=96 write: IOPS=31, BW=127KiB/s (130kB/s)(6236KiB/48935msec); 0 zone resets clat (usec): min=560, max=703781, avg=14429.25, stdev=20741.97 lat (usec): min=561, max=703782, avg=14431.48, stdev=20742.43 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2278], 10.00th=[ 2769], 20.00th=[ 3720], | 30.00th=[ 5932], 40.00th=[ 8848], 50.00th=[ 11469], 60.00th=[ 13960], | 70.00th=[ 17695], 80.00th=[ 22414], 90.00th=[ 29754], 95.00th=[ 34866], | 99.00th=[ 48497], 99.50th=[ 61080], 99.90th=[ 79168], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 23, max= 232, per=24.84%, avg=126.93, stdev=43.30, samples=97 iops : min= 5, max= 58, avg=31.35, stdev=10.93, samples=97 lat (usec) : 50=0.03%, 100=0.52%, 250=0.59%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.20% lat (msec) : 2=1.17%, 4=9.99%, 10=20.83%, 20=39.19%, 50=26.30% lat (msec) : 100=0.88%, 750=0.03% cpu : usr=0.13%, sys=25.84%, ctx=9238, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=489KiB/s (500kB/s), 122KiB/s-124KiB/s (125kB/s-127kB/s), io=23.4MiB (24.6MB), run=48172-49130msec WRITE: bw=512KiB/s (524kB/s), 127KiB/s-132KiB/s (130kB/s-135kB/s), io=24.6MiB (25.7MB), run=48172-49130msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181483: Sun Sep 13 09:57:14 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(5992KiB/54903msec) clat (msec): min=2, max=744, avg=15.92, stdev=22.73 lat (msec): min=2, max=744, avg=15.92, stdev=22.73 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 63], 99.50th=[ 69], 99.90th=[ 81], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 23, max= 392, per=25.47%, avg=110.52, stdev=80.40, samples=108 iops : min= 5, max= 98, avg=27.31, stdev=20.20, samples=108 write: IOPS=28, BW=115KiB/s (117kB/s)(6296KiB/54903msec); 0 zone resets clat (msec): min=4, max=103, avg=19.70, stdev=14.21 lat (msec): min=4, max=103, avg=19.70, stdev=14.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 67], 99.50th=[ 78], 99.90th=[ 87], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 31, max= 408, per=25.48%, avg=115.93, stdev=80.41, samples=108 iops : min= 7, max= 102, avg=28.66, stdev=20.21, samples=108 lat (msec) : 4=2.93%, 10=35.22%, 20=29.26%, 50=29.23%, 100=3.29% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.13%, sys=11.61%, ctx=5532, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181484: Sun Sep 13 09:57:14 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5940KiB/55203msec) clat (msec): min=2, max=720, avg=16.23, stdev=22.76 lat (msec): min=2, max=720, avg=16.23, stdev=22.76 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 61], 99.50th=[ 72], 99.90th=[ 118], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 31, max= 392, per=24.89%, avg=108.01, stdev=82.58, samples=108 iops : min= 7, max= 98, avg=26.68, stdev=20.75, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55203msec); 0 zone resets clat (msec): min=4, max=100, avg=19.56, stdev=14.50 lat (msec): min=4, max=100, avg=19.56, stdev=14.50 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 77], 99.90th=[ 93], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 23, max= 384, per=25.25%, avg=114.88, stdev=80.91, samples=108 iops : min= 5, max= 96, avg=28.40, stdev=20.34, samples=108 lat (msec) : 4=2.73%, 10=36.65%, 20=28.39%, 50=28.71%, 100=3.39% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.13%, sys=11.52%, ctx=5500, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181485: Sun Sep 13 09:57:14 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55146msec) clat (msec): min=2, max=102, avg=15.31, stdev=12.58 lat (msec): min=2, max=102, avg=15.31, stdev=12.58 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 42], | 99.00th=[ 55], 99.50th=[ 62], 99.90th=[ 82], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 16, max= 440, per=25.31%, avg=109.85, stdev=80.78, samples=108 iops : min= 4, max= 110, avg=27.14, stdev=20.29, samples=108 write: IOPS=28, BW=114KiB/s (116kB/s)(6260KiB/55146msec); 0 zone resets clat (msec): min=4, max=737, avg=20.46, stdev=23.27 lat (msec): min=4, max=737, avg=20.47, stdev=23.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 72], 99.50th=[ 84], 99.90th=[ 100], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 31, max= 376, per=25.00%, avg=113.76, stdev=79.02, samples=108 iops : min= 7, max= 94, avg=28.12, stdev=19.87, samples=108 lat (msec) : 4=2.57%, 10=36.43%, 20=27.77%, 50=30.05%, 100=3.12% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=11.64%, ctx=5505, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181486: Sun Sep 13 09:57:14 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(6052KiB/55018msec) clat (msec): min=2, max=118, avg=15.90, stdev=12.99 lat (msec): min=2, max=118, avg=15.90, stdev=12.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 58], 99.50th=[ 63], 99.90th=[ 92], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 31, max= 400, per=25.56%, avg=110.94, stdev=79.62, samples=108 iops : min= 7, max= 100, avg=27.42, stdev=20.01, samples=108 write: IOPS=28, BW=113KiB/s (116kB/s)(6236KiB/55018msec); 0 zone resets clat (msec): min=4, max=728, avg=19.83, stdev=22.97 lat (msec): min=4, max=728, avg=19.83, stdev=22.97 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 40], 95.00th=[ 47], | 99.00th=[ 68], 99.50th=[ 79], 99.90th=[ 107], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 39, max= 416, per=25.12%, avg=114.30, stdev=79.87, samples=108 iops : min= 9, max= 104, avg=28.25, stdev=20.08, samples=108 lat (msec) : 4=2.28%, 10=36.00%, 20=28.94%, 50=29.43%, 100=3.22% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=11.71%, ctx=5374, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=435KiB/s (445kB/s), 108KiB/s-110KiB/s (110kB/s-113kB/s), io=23.4MiB (24.6MB), run=54903-55203msec WRITE: bw=455KiB/s (466kB/s), 113KiB/s-115KiB/s (116kB/s-118kB/s), io=24.6MiB (25.7MB), run=54903-55203msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181507: Sun Sep 13 09:57:35 2026 read: IOPS=26, BW=419KiB/s (429kB/s)(5920KiB/14143msec) clat (usec): min=61, max=76369, avg=18986.65, stdev=10941.00 lat (usec): min=62, max=76370, avg=18987.48, stdev=10941.04 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 129], 10.00th=[ 8356], 20.00th=[11731], | 30.00th=[13829], 40.00th=[15533], 50.00th=[16909], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25560], 90.00th=[33424], 95.00th=[39584], | 99.00th=[56361], 99.50th=[56886], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 256, max= 608, per=24.74%, avg=410.15, stdev=107.89, samples=27 iops : min= 16, max= 38, avg=25.22, stdev= 6.76, samples=27 write: IOPS=28, BW=450KiB/s (461kB/s)(6368KiB/14143msec); 0 zone resets clat (usec): min=1641, max=85921, avg=17734.66, stdev=13272.08 lat (usec): min=1642, max=85923, avg=17736.40, stdev=13272.07 clat percentiles (usec): | 1.00th=[ 2147], 5.00th=[ 3589], 10.00th=[ 4424], 20.00th=[ 5997], | 30.00th=[10028], 40.00th=[12256], 50.00th=[14222], 60.00th=[17171], | 70.00th=[21103], 80.00th=[26346], 90.00th=[35390], 95.00th=[43254], | 99.00th=[64750], 99.50th=[81265], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 160, max= 666, per=25.65%, avg=447.41, stdev=122.27, samples=27 iops : min= 10, max= 41, avg=27.59, stdev= 7.52, samples=27 lat (usec) : 100=0.91%, 250=2.47%, 500=0.13% lat (msec) : 2=0.39%, 4=3.26%, 10=15.23%, 20=42.84%, 50=32.16% lat (msec) : 100=2.60% cpu : usr=0.14%, sys=27.33%, ctx=2709, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181508: Sun Sep 13 09:57:35 2026 read: IOPS=25, BW=402KiB/s (412kB/s)(5744KiB/14283msec) clat (usec): min=73, max=63414, avg=20816.70, stdev=10906.03 lat (usec): min=73, max=63416, avg=20817.78, stdev=10906.04 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 5735], 10.00th=[10028], 20.00th=[12125], | 30.00th=[14746], 40.00th=[17171], 50.00th=[20055], 60.00th=[22152], | 70.00th=[23987], 80.00th=[27132], 90.00th=[36439], 95.00th=[41157], | 99.00th=[55837], 99.50th=[57410], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 192, max= 604, per=24.15%, avg=400.36, stdev=93.11, samples=28 iops : min= 12, max= 37, avg=24.61, stdev= 5.72, samples=28 write: IOPS=28, BW=458KiB/s (469kB/s)(6544KiB/14283msec); 0 zone resets clat (usec): min=1223, max=70526, avg=16447.20, stdev=11886.56 lat (usec): min=1224, max=70527, avg=16468.82, stdev=11874.71 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 3654], 10.00th=[ 4490], 20.00th=[ 5735], | 30.00th=[ 7898], 40.00th=[10552], 50.00th=[13435], 60.00th=[16057], | 70.00th=[21365], 80.00th=[25560], 90.00th=[34341], 95.00th=[40109], | 99.00th=[49021], 99.50th=[51643], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 192, max= 701, per=26.13%, avg=455.64, stdev=132.54, samples=28 iops : min= 12, max= 43, avg=28.07, stdev= 8.24, samples=28 lat (usec) : 100=0.52%, 250=1.43%, 500=0.13%, 750=0.13% lat (msec) : 2=0.78%, 4=2.86%, 10=19.27%, 20=34.51%, 50=38.67% lat (msec) : 100=1.69% cpu : usr=0.14%, sys=27.48%, ctx=2753, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181509: Sun Sep 13 09:57:35 2026 read: IOPS=27, BW=433KiB/s (444kB/s)(6256KiB/14444msec) clat (usec): min=79, max=63965, avg=20211.77, stdev=11200.16 lat (usec): min=80, max=63965, avg=20212.84, stdev=11200.28 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 293], 10.00th=[ 9372], 20.00th=[11863], | 30.00th=[13960], 40.00th=[16188], 50.00th=[18482], 60.00th=[21627], | 70.00th=[23725], 80.00th=[26870], 90.00th=[34866], 95.00th=[41157], | 99.00th=[57410], 99.50th=[63177], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 255, max= 672, per=25.84%, avg=428.46, stdev=108.42, samples=28 iops : min= 15, max= 42, avg=26.36, stdev= 6.89, samples=28 write: IOPS=26, BW=418KiB/s (428kB/s)(6032KiB/14444msec); 0 zone resets clat (usec): min=1494, max=56919, avg=17270.65, stdev=11937.40 lat (usec): min=1495, max=56921, avg=17272.73, stdev=11937.27 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 3851], 10.00th=[ 4555], 20.00th=[ 6587], | 30.00th=[ 9634], 40.00th=[12125], 50.00th=[14484], 60.00th=[17171], | 70.00th=[20579], 80.00th=[25035], 90.00th=[35390], 95.00th=[42206], | 99.00th=[53740], 99.50th=[55313], 99.90th=[56886], 99.95th=[56886], | 99.99th=[56886] bw ( KiB/s): min= 192, max= 702, per=23.13%, avg=403.43, stdev=115.38, samples=28 iops : min= 12, max= 43, avg=24.79, stdev= 7.03, samples=28 lat (usec) : 100=0.91%, 250=1.43%, 500=0.39% lat (msec) : 2=0.52%, 4=2.60%, 10=15.63%, 20=40.49%, 50=35.94% lat (msec) : 100=2.08% cpu : usr=0.11%, sys=26.97%, ctx=2719, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181510: Sun Sep 13 09:57:35 2026 read: IOPS=27, BW=433KiB/s (443kB/s)(6032KiB/13945msec) clat (usec): min=47, max=69776, avg=18746.49, stdev=11167.77 lat (usec): min=47, max=69776, avg=18747.30, stdev=11167.82 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 129], 10.00th=[ 269], 20.00th=[11338], | 30.00th=[13304], 40.00th=[15270], 50.00th=[18482], 60.00th=[20317], | 70.00th=[23200], 80.00th=[25822], 90.00th=[32375], 95.00th=[40109], | 99.00th=[52691], 99.50th=[59507], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 255, max= 669, per=25.73%, avg=426.59, stdev=121.31, samples=27 iops : min= 15, max= 41, avg=26.26, stdev= 7.52, samples=27 write: IOPS=28, BW=449KiB/s (459kB/s)(6256KiB/13945msec); 0 zone resets clat (usec): min=1362, max=80551, avg=17456.48, stdev=12996.77 lat (usec): min=1363, max=80553, avg=17458.82, stdev=12996.01 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 3752], 10.00th=[ 4359], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[11600], 50.00th=[14091], 60.00th=[16909], | 70.00th=[20579], 80.00th=[26870], 90.00th=[34341], 95.00th=[45351], | 99.00th=[56886], 99.50th=[72877], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 224, max= 702, per=25.57%, avg=445.89, stdev=120.04, samples=27 iops : min= 14, max= 43, avg=27.48, stdev= 7.43, samples=27 lat (usec) : 50=0.13%, 100=0.91%, 250=3.78%, 500=0.26% lat (msec) : 2=0.39%, 4=3.12%, 10=16.80%, 20=37.89%, 50=34.64% lat (msec) : 100=2.08% cpu : usr=0.14%, sys=27.26%, ctx=2714, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1658KiB/s (1698kB/s), 402KiB/s-433KiB/s (412kB/s-444kB/s), io=23.4MiB (24.5MB), run=13945-14444msec WRITE: bw=1745KiB/s (1787kB/s), 418KiB/s-458KiB/s (428kB/s-469kB/s), io=24.6MiB (25.8MB), run=13945-14444msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181512: Sun Sep 13 09:57:37 2026 read: IOPS=22, BW=356KiB/s (364kB/s)(5920KiB/16633msec) clat (usec): min=3271, max=93317, avg=18069.21, stdev=14394.52 lat (usec): min=3272, max=93318, avg=18070.44, stdev=14394.45 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 4817], 10.00th=[ 5604], 20.00th=[ 6915], | 30.00th=[ 8586], 40.00th=[10421], 50.00th=[13173], 60.00th=[16319], | 70.00th=[20841], 80.00th=[27132], 90.00th=[37487], 95.00th=[48497], | 99.00th=[70779], 99.50th=[78119], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 992, per=23.48%, avg=338.06, stdev=203.10, samples=32 iops : min= 9, max= 62, avg=20.69, stdev=12.78, samples=32 write: IOPS=23, BW=383KiB/s (392kB/s)(6368KiB/16633msec); 0 zone resets clat (usec): min=5648, max=96996, avg=24779.28, stdev=17428.89 lat (usec): min=5650, max=96998, avg=24781.11, stdev=17429.31 clat percentiles (usec): | 1.00th=[ 5997], 5.00th=[ 6849], 10.00th=[ 7898], 20.00th=[10028], | 30.00th=[12518], 40.00th=[14615], 50.00th=[19006], 60.00th=[24773], | 70.00th=[30802], 80.00th=[38536], 90.00th=[49546], 95.00th=[59507], | 99.00th=[84411], 99.50th=[88605], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 127, max= 1120, per=24.22%, avg=367.00, stdev=202.05, samples=32 iops : min= 7, max= 70, avg=22.50, stdev=12.71, samples=32 lat (msec) : 4=0.26%, 10=27.34%, 20=31.77%, 50=33.59%, 100=7.03% cpu : usr=0.13%, sys=10.89%, ctx=1508, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181513: Sun Sep 13 09:57:37 2026 read: IOPS=21, BW=346KiB/s (354kB/s)(5744KiB/16604msec) clat (usec): min=3061, max=77569, avg=18501.61, stdev=14423.56 lat (usec): min=3062, max=77569, avg=18502.82, stdev=14423.57 clat percentiles (usec): | 1.00th=[ 4113], 5.00th=[ 5211], 10.00th=[ 5932], 20.00th=[ 7570], | 30.00th=[ 9634], 40.00th=[10945], 50.00th=[13304], 60.00th=[16188], | 70.00th=[20841], 80.00th=[27919], 90.00th=[38011], 95.00th=[50594], | 99.00th=[67634], 99.50th=[73925], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 63, max= 896, per=23.38%, avg=336.63, stdev=205.95, samples=32 iops : min= 3, max= 56, avg=20.59, stdev=12.98, samples=32 write: IOPS=24, BW=394KiB/s (404kB/s)(6544KiB/16604msec); 0 zone resets clat (usec): min=5482, max=89939, avg=24125.81, stdev=16895.34 lat (usec): min=5483, max=89940, avg=24127.73, stdev=16895.42 clat percentiles (usec): | 1.00th=[ 5932], 5.00th=[ 6915], 10.00th=[ 7832], 20.00th=[ 9503], | 30.00th=[11731], 40.00th=[14746], 50.00th=[18744], 60.00th=[23725], | 70.00th=[29754], 80.00th=[37487], 90.00th=[47449], 95.00th=[56886], | 99.00th=[79168], 99.50th=[85459], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 159, max= 1408, per=24.97%, avg=378.28, stdev=245.88, samples=32 iops : min= 9, max= 88, avg=23.22, stdev=15.47, samples=32 lat (msec) : 4=0.26%, 10=26.69%, 20=32.42%, 50=33.85%, 100=6.77% cpu : usr=0.13%, sys=11.11%, ctx=1451, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181514: Sun Sep 13 09:57:37 2026 read: IOPS=23, BW=380KiB/s (390kB/s)(6256KiB/16443msec) clat (usec): min=3262, max=93539, avg=18527.52, stdev=14650.23 lat (usec): min=3262, max=93539, avg=18528.55, stdev=14650.32 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 5014], 10.00th=[ 5866], 20.00th=[ 7635], | 30.00th=[ 9503], 40.00th=[11600], 50.00th=[13566], 60.00th=[15926], | 70.00th=[20055], 80.00th=[27919], 90.00th=[38536], 95.00th=[50070], | 99.00th=[70779], 99.50th=[81265], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 191, max= 1248, per=26.19%, avg=377.09, stdev=237.80, samples=32 iops : min= 11, max= 78, avg=23.12, stdev=14.96, samples=32 write: IOPS=22, BW=367KiB/s (376kB/s)(6032KiB/16443msec); 0 zone resets clat (usec): min=5526, max=84025, avg=24282.86, stdev=15826.08 lat (usec): min=5527, max=84027, avg=24284.89, stdev=15826.43 clat percentiles (usec): | 1.00th=[ 6194], 5.00th=[ 7046], 10.00th=[ 8356], 20.00th=[10290], | 30.00th=[13042], 40.00th=[15795], 50.00th=[18744], 60.00th=[25560], | 70.00th=[29754], 80.00th=[37487], 90.00th=[47449], 95.00th=[55313], | 99.00th=[69731], 99.50th=[80217], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 95, max= 896, per=23.45%, avg=355.25, stdev=198.77, samples=32 iops : min= 5, max= 56, avg=21.78, stdev=12.50, samples=32 lat (msec) : 4=0.39%, 10=25.26%, 20=35.16%, 50=32.29%, 100=6.90% cpu : usr=0.12%, sys=11.13%, ctx=1455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181515: Sun Sep 13 09:57:37 2026 read: IOPS=22, BW=365KiB/s (373kB/s)(6032KiB/16539msec) clat (usec): min=3354, max=93091, avg=18845.90, stdev=15495.92 lat (usec): min=3355, max=93093, avg=18846.87, stdev=15495.92 clat percentiles (usec): | 1.00th=[ 4113], 5.00th=[ 5014], 10.00th=[ 5473], 20.00th=[ 7439], | 30.00th=[ 9372], 40.00th=[11469], 50.00th=[13304], 60.00th=[15664], | 70.00th=[20317], 80.00th=[27395], 90.00th=[40633], 95.00th=[52691], | 99.00th=[69731], 99.50th=[81265], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 190, max= 1280, per=24.62%, avg=354.50, stdev=221.87, samples=32 iops : min= 11, max= 80, avg=21.72, stdev=13.96, samples=32 write: IOPS=23, BW=378KiB/s (387kB/s)(6256KiB/16539msec); 0 zone resets clat (usec): min=5636, max=95516, avg=23908.22, stdev=16090.51 lat (usec): min=5637, max=95518, avg=23910.12, stdev=16090.62 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 7308], 10.00th=[ 8356], 20.00th=[10421], | 30.00th=[13435], 40.00th=[15401], 50.00th=[19006], 60.00th=[22938], | 70.00th=[28443], 80.00th=[35390], 90.00th=[46924], 95.00th=[55837], | 99.00th=[78119], 99.50th=[86508], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 160, max= 960, per=24.44%, avg=370.25, stdev=210.60, samples=32 iops : min= 10, max= 60, avg=22.72, stdev=13.24, samples=32 lat (msec) : 4=0.39%, 10=24.74%, 20=35.42%, 50=32.42%, 100=7.03% cpu : usr=0.15%, sys=11.22%, ctx=1528, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1440KiB/s (1475kB/s), 346KiB/s-380KiB/s (354kB/s-390kB/s), io=23.4MiB (24.5MB), run=16443-16633msec WRITE: bw=1515KiB/s (1551kB/s), 367KiB/s-394KiB/s (376kB/s-404kB/s), io=24.6MiB (25.8MB), run=16443-16633msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181522: Sun Sep 13 09:57:45 2026 read: IOPS=2, BW=2808KiB/s (2875kB/s)(7168KiB/2553msec) clat (usec): min=625, max=246763, avg=141860.04, stdev=84820.63 lat (usec): min=626, max=246764, avg=141861.79, stdev=84820.76 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[106431], | 30.00th=[108528], 40.00th=[108528], 50.00th=[117965], 60.00th=[181404], | 70.00th=[181404], 80.00th=[229639], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 1946, max= 5120, per=53.11%, avg=3029.67, stdev=1810.69, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=2005KiB/s (2054kB/s)(5120KiB/2553msec); 0 zone resets clat (msec): min=137, max=536, avg=299.14, stdev=154.30 lat (msec): min=137, max=536, avg=299.20, stdev=154.29 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1946, max= 4096, per=37.83%, avg=3021.00, stdev=1520.28, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=52.27%, ctx=1040, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181523: Sun Sep 13 09:57:45 2026 read: IOPS=0, BW=570KiB/s (584kB/s)(2048KiB/3590msec) clat (msec): min=104, max=151, avg=127.70, stdev=33.49 lat (msec): min=104, max=151, avg=127.71, stdev=33.49 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1709, max= 2048, per=32.93%, avg=1878.50, stdev=239.71, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2852KiB/s (2921kB/s)(10.0MiB/3590msec); 0 zone resets clat (msec): min=94, max=1019, avg=327.91, stdev=267.73 lat (msec): min=94, max=1019, avg=328.26, stdev=267.51 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 128], | 30.00th=[ 184], 40.00th=[ 203], 50.00th=[ 236], 60.00th=[ 264], | 70.00th=[ 292], 80.00th=[ 426], 90.00th=[ 435], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1946, max= 4096, per=37.43%, avg=2989.50, stdev=1163.85, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=45.64%, ctx=407, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181524: Sun Sep 13 09:57:45 2026 read: IOPS=2, BW=2723KiB/s (2789kB/s)(6144KiB/2256msec) clat (usec): min=392, max=162565, avg=63057.68, stdev=76173.74 lat (usec): min=392, max=162567, avg=63059.04, stdev=76174.02 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 64750], | 70.00th=[149947], 80.00th=[149947], 90.00th=[162530], 95.00th=[162530], | 99.00th=[162530], 99.50th=[162530], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 4047, max= 6144, per=89.33%, avg=5095.50, stdev=1482.80, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2723KiB/s (2789kB/s)(6144KiB/2256msec); 0 zone resets clat (msec): min=132, max=951, avg=310.96, stdev=325.49 lat (msec): min=132, max=951, avg=311.02, stdev=325.48 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 146], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2048, max= 4047, per=39.71%, avg=3171.33, stdev=1022.25, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=51.66%, ctx=421, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181525: Sun Sep 13 09:57:45 2026 read: IOPS=1, BW=1949KiB/s (1996kB/s)(5120KiB/2627msec) clat (usec): min=647, max=322050, avg=123879.01, stdev=133421.58 lat (usec): min=647, max=322052, avg=123880.02, stdev=133421.99 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 816], 40.00th=[ 816], 50.00th=[132645], 60.00th=[132645], | 70.00th=[162530], 80.00th=[162530], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2729KiB/s (2794kB/s)(7168KiB/2627msec); 0 zone resets clat (msec): min=156, max=419, avg=278.79, stdev=116.07 lat (msec): min=156, max=419, avg=278.87, stdev=116.06 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 161], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 317], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 397], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1709, max= 3893, per=31.83%, avg=2541.67, stdev=1180.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=55.79%, ctx=911, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5705KiB/s (5842kB/s), 570KiB/s-2808KiB/s (584kB/s-2875kB/s), io=20.0MiB (20.0MB), run=2256-3590msec WRITE: bw=7987KiB/s (8178kB/s), 2005KiB/s-2852KiB/s (2054kB/s-2921kB/s), io=28.0MiB (29.4MB), run=2256-3590msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181527: Sun Sep 13 09:57:46 2026 read: IOPS=2, BW=2285KiB/s (2340kB/s)(7168KiB/3137msec) clat (msec): min=60, max=630, avg=222.45, stdev=209.02 lat (msec): min=60, max=630, avg=222.46, stdev=209.02 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 84], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 128], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 380], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1723, max= 4096, per=53.11%, avg=2988.50, stdev=1280.53, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1632KiB/s (1671kB/s)(5120KiB/3137msec); 0 zone resets clat (msec): min=86, max=878, avg=298.36, stdev=327.57 lat (msec): min=86, max=878, avg=298.46, stdev=327.57 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1939, max= 6144, per=42.86%, avg=3377.00, stdev=2396.91, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=21.27%, ctx=399, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181528: Sun Sep 13 09:57:46 2026 read: IOPS=0, BW=564KiB/s (578kB/s)(2048KiB/3631msec) clat (msec): min=138, max=434, avg=286.47, stdev=209.49 lat (msec): min=138, max=434, avg=286.47, stdev=209.49 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1747, max= 2048, per=33.72%, avg=1897.50, stdev=212.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2820KiB/s (2888kB/s)(10.0MiB/3631msec); 0 zone resets clat (msec): min=50, max=655, avg=294.84, stdev=226.48 lat (msec): min=50, max=655, avg=295.08, stdev=226.34 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 83], | 30.00th=[ 90], 40.00th=[ 138], 50.00th=[ 192], 60.00th=[ 236], | 70.00th=[ 414], 80.00th=[ 498], 90.00th=[ 600], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2048, max= 8192, per=46.23%, avg=3642.80, stdev=2663.68, samples=5 iops : min= 2, max= 8, avg= 3.40, stdev= 2.61, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.14%, sys=17.93%, ctx=222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181529: Sun Sep 13 09:57:46 2026 read: IOPS=1, BW=1791KiB/s (1834kB/s)(6144KiB/3431msec) clat (msec): min=73, max=313, avg=191.90, stdev=103.01 lat (msec): min=73, max=313, avg=191.91, stdev=103.01 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 236], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1939, max= 4096, per=60.01%, avg=3377.00, stdev=1245.34, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1791KiB/s (1834kB/s)(6144KiB/3431msec); 0 zone resets clat (msec): min=71, max=1208, avg=367.44, stdev=423.22 lat (msec): min=71, max=1208, avg=367.52, stdev=423.22 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 220], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1939, max= 3650, per=30.73%, avg=2421.25, stdev=820.78, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=14.49%, ctx=83, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181530: Sun Sep 13 09:57:46 2026 read: IOPS=1, BW=1407KiB/s (1441kB/s)(5120KiB/3639msec) clat (msec): min=22, max=131, avg=69.73, stdev=40.94 lat (msec): min=22, max=131, avg=69.73, stdev=40.94 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], | 30.00th=[ 47], 40.00th=[ 47], 50.00th=[ 71], 60.00th=[ 71], | 70.00th=[ 78], 80.00th=[ 78], 90.00th=[ 132], 95.00th=[ 132], | 99.00th=[ 132], 99.50th=[ 132], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 2048, max= 6144, per=72.79%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1970KiB/s (2017kB/s)(7168KiB/3639msec); 0 zone resets clat (msec): min=57, max=1183, avg=454.15, stdev=409.06 lat (msec): min=57, max=1183, avg=454.22, stdev=409.05 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 58], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 388], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 776], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1723, max= 6144, per=35.29%, avg=2780.40, stdev=1884.98, samples=5 iops : min= 1, max= 6, avg= 2.40, stdev= 2.07, samples=5 lat (msec) : 50=16.67%, 100=33.33%, 250=16.67%, 500=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=16.52%, ctx=143, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5628KiB/s (5763kB/s), 564KiB/s-2285KiB/s (578kB/s-2340kB/s), io=20.0MiB (20.0MB), run=3137-3639msec WRITE: bw=7879KiB/s (8068kB/s), 1632KiB/s-2820KiB/s (1671kB/s-2888kB/s), io=28.0MiB (29.4MB), run=3137-3639msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181536: Sun Sep 13 09:57:54 2026 read: IOPS=1, BW=5780KiB/s (5919kB/s)(12.0MiB/2126msec) clat (msec): min=221, max=1015, avg=701.17, stdev=422.28 lat (msec): min=221, max=1015, avg=701.17, stdev=422.28 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.24%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181537: Sun Sep 13 09:57:54 2026 read: IOPS=0, BW=1848KiB/s (1893kB/s)(4096KiB/2216msec) clat (nsec): min=619850k, max=619850k, avg=619850253.00, stdev= 0.00 lat (nsec): min=619852k, max=619852k, avg=619852171.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3697KiB/s (3785kB/s)(8192KiB/2216msec); 0 zone resets clat (msec): min=356, max=1218, avg=787.46, stdev=609.27 lat (msec): min=357, max=1218, avg=787.87, stdev=609.30 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8078, max= 8078, per=54.63%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=15.21%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181538: Sun Sep 13 09:57:54 2026 write: IOPS=1, BW=7099KiB/s (7269kB/s)(12.0MiB/1731msec); 0 zone resets clat (msec): min=153, max=998, avg=565.80, stdev=422.81 lat (msec): min=154, max=998, avg=566.13, stdev=422.73 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7420, max= 8192, per=52.79%, avg=7806.00, stdev=545.89, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=19.02%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181539: Sun Sep 13 09:57:54 2026 write: IOPS=2, BW=9069KiB/s (9286kB/s)(12.0MiB/1355msec); 0 zone resets clat (msec): min=200, max=889, avg=444.56, stdev=385.61 lat (msec): min=201, max=889, avg=444.92, stdev=385.53 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8031, max= 8031, per=54.31%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=27.62%, ctx=129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7394KiB/s (7571kB/s), 1848KiB/s-5780KiB/s (1893kB/s-5919kB/s), io=16.0MiB (16.8MB), run=2126-2216msec WRITE: bw=14.4MiB/s (15.1MB/s), 3697KiB/s-9069KiB/s (3785kB/s-9286kB/s), io=32.0MiB (33.6MB), run=1355-2216msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181541: Sun Sep 13 09:57:54 2026 read: IOPS=1, BW=8187KiB/s (8383kB/s)(12.0MiB/1501msec) clat (msec): min=466, max=536, avg=494.34, stdev=37.05 lat (msec): min=466, max=536, avg=494.34, stdev=37.05 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 5580, max= 8192, per=85.44%, avg=6886.00, stdev=1846.96, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=53.53%, ctx=2602, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181542: Sun Sep 13 09:57:54 2026 read: IOPS=0, BW=2015KiB/s (2063kB/s)(4096KiB/2033msec) clat (nsec): min=457143k, max=457143k, avg=457143050.00, stdev= 0.00 lat (nsec): min=457146k, max=457146k, avg=457145813.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 5595, max= 5595, per=69.43%, avg=5595.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4030KiB/s (4126kB/s)(8192KiB/2033msec); 0 zone resets clat (msec): min=578, max=971, avg=775.06, stdev=278.36 lat (msec): min=578, max=972, avg=775.32, stdev=278.39 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=50.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.45%, ctx=986, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181543: Sun Sep 13 09:57:54 2026 write: IOPS=1, BW=6123KiB/s (6270kB/s)(12.0MiB/2007msec); 0 zone resets clat (msec): min=244, max=888, avg=662.09, stdev=362.28 lat (msec): min=244, max=888, avg=662.35, stdev=362.26 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8192, max= 8192, per=50.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.01%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181544: Sun Sep 13 09:57:54 2026 write: IOPS=1, BW=7203KiB/s (7376kB/s)(12.0MiB/1706msec); 0 zone resets clat (msec): min=172, max=933, avg=559.81, stdev=380.43 lat (msec): min=173, max=933, avg=560.11, stdev=380.39 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5483, max= 5483, per=34.02%, avg=5483.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.54%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8059KiB/s (8252kB/s), 2015KiB/s-8187KiB/s (2063kB/s-8383kB/s), io=16.0MiB (16.8MB), run=1501-2033msec WRITE: bw=15.7MiB/s (16.5MB/s), 4030KiB/s-7203KiB/s (4126kB/s-7376kB/s), io=32.0MiB (33.6MB), run=1706-2033msec