== sanity test 398b: DIO and buffer IO race ============== 23:08:56 (1763352536) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.64319 s, 13.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183316: Sun Nov 16 23:10:23 2025 read: IOPS=20, BW=81.6KiB/s (83.6kB/s)(5992KiB/73398msec) clat (usec): min=125, max=673462, avg=27088.06, stdev=22616.51 lat (usec): min=126, max=673463, avg=27089.22, stdev=22616.56 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 7701], 10.00th=[ 10945], 20.00th=[ 14353], | 30.00th=[ 17957], 40.00th=[ 20841], 50.00th=[ 23987], 60.00th=[ 28181], | 70.00th=[ 32375], 80.00th=[ 37487], 90.00th=[ 44827], 95.00th=[ 54264], | 99.00th=[ 81265], 99.50th=[ 92799], 99.90th=[104334], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 14, max= 142, per=25.24%, avg=81.01, stdev=23.08, samples=145 iops : min= 3, max= 35, avg=19.66, stdev= 5.82, samples=145 write: IOPS=21, BW=85.8KiB/s (87.8kB/s)(6296KiB/73398msec); 0 zone resets clat (usec): min=791, max=162122, avg=20650.83, stdev=19458.74 lat (usec): min=792, max=162125, avg=20652.24, stdev=19458.75 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1319], 10.00th=[ 1876], 20.00th=[ 3261], | 30.00th=[ 5997], 40.00th=[ 12125], 50.00th=[ 16057], 60.00th=[ 20579], | 70.00th=[ 26084], 80.00th=[ 34866], 90.00th=[ 47449], 95.00th=[ 58459], | 99.00th=[ 87557], 99.50th=[ 93848], 99.90th=[126354], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 24, max= 175, per=25.58%, avg=85.94, stdev=26.50, samples=144 iops : min= 6, max= 43, avg=20.90, stdev= 6.60, samples=144 lat (usec) : 250=0.72%, 500=1.04%, 750=0.20%, 1000=0.23% lat (msec) : 2=5.37%, 4=6.41%, 10=8.24%, 20=26.53%, 50=44.01% lat (msec) : 100=7.00%, 250=0.23%, 750=0.03% cpu : usr=0.13%, sys=12.21%, ctx=7350, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183317: Sun Nov 16 23:10:23 2025 read: IOPS=20, BW=80.6KiB/s (82.5kB/s)(5940KiB/73689msec) clat (usec): min=128, max=196513, avg=27338.24, stdev=15733.71 lat (usec): min=129, max=196515, avg=27339.50, stdev=15733.81 clat percentiles (usec): | 1.00th=[ 223], 5.00th=[ 10421], 10.00th=[ 12911], 20.00th=[ 15533], | 30.00th=[ 18482], 40.00th=[ 21103], 50.00th=[ 24249], 60.00th=[ 27657], | 70.00th=[ 31851], 80.00th=[ 37487], 90.00th=[ 45876], 95.00th=[ 53216], | 99.00th=[ 77071], 99.50th=[ 85459], 99.90th=[137364], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 7, max= 143, per=24.95%, avg=80.08, stdev=22.27, samples=146 iops : min= 1, max= 35, avg=19.43, stdev= 5.58, samples=146 write: IOPS=21, BW=86.1KiB/s (88.2kB/s)(6348KiB/73689msec); 0 zone resets clat (usec): min=925, max=656618, avg=20649.21, stdev=24786.55 lat (usec): min=926, max=656618, avg=20651.92, stdev=24785.87 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1254], 10.00th=[ 1745], 20.00th=[ 2835], | 30.00th=[ 5145], 40.00th=[ 10421], 50.00th=[ 15795], 60.00th=[ 20317], | 70.00th=[ 27132], 80.00th=[ 35390], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 79168], 99.50th=[ 87557], 99.90th=[120062], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 151, per=25.44%, avg=85.47, stdev=25.43, samples=146 iops : min= 1, max= 37, avg=20.77, stdev= 6.36, samples=146 lat (usec) : 250=0.52%, 500=0.42%, 750=0.10%, 1000=0.26% lat (msec) : 2=6.28%, 4=7.06%, 10=7.68%, 20=26.07%, 50=44.14% lat (msec) : 100=7.10%, 250=0.33%, 750=0.03% cpu : usr=0.13%, sys=12.17%, ctx=7202, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183318: Sun Nov 16 23:10:23 2025 read: IOPS=20, BW=80.7KiB/s (82.6kB/s)(6028KiB/74715msec) clat (usec): min=126, max=675878, avg=27527.58, stdev=23769.28 lat (usec): min=127, max=675879, avg=27528.97, stdev=23769.38 clat percentiles (usec): | 1.00th=[ 200], 5.00th=[ 8848], 10.00th=[ 11731], 20.00th=[ 14615], | 30.00th=[ 17433], 40.00th=[ 20055], 50.00th=[ 23462], 60.00th=[ 26870], | 70.00th=[ 31589], 80.00th=[ 37487], 90.00th=[ 46400], 95.00th=[ 58983], | 99.00th=[ 90702], 99.50th=[100140], 99.90th=[145753], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 31, max= 151, per=25.11%, avg=80.61, stdev=22.14, samples=147 iops : min= 7, max= 37, avg=19.55, stdev= 5.50, samples=147 write: IOPS=20, BW=83.8KiB/s (85.8kB/s)(6260KiB/74715msec); 0 zone resets clat (usec): min=1005, max=119959, avg=21037.35, stdev=19129.18 lat (usec): min=1006, max=119961, avg=21041.04, stdev=19128.94 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1319], 10.00th=[ 1844], 20.00th=[ 3228], | 30.00th=[ 5997], 40.00th=[ 11863], 50.00th=[ 16450], 60.00th=[ 21103], | 70.00th=[ 28181], 80.00th=[ 36439], 90.00th=[ 48497], 95.00th=[ 57410], | 99.00th=[ 80217], 99.50th=[ 93848], 99.90th=[110625], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 16, max= 174, per=24.69%, avg=82.96, stdev=28.33, samples=148 iops : min= 4, max= 43, avg=20.16, stdev= 7.11, samples=148 lat (usec) : 250=0.68%, 500=0.81%, 750=0.20%, 1000=0.03% lat (msec) : 2=5.70%, 4=6.61%, 10=7.91%, 20=27.08%, 50=42.45% lat (msec) : 100=8.14%, 250=0.36%, 750=0.03% cpu : usr=0.09%, sys=12.23%, ctx=7377, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183319: Sun Nov 16 23:10:23 2025 read: IOPS=20, BW=82.6KiB/s (84.6kB/s)(6052KiB/73296msec) clat (usec): min=108, max=211220, avg=26736.07, stdev=15980.88 lat (usec): min=109, max=211220, avg=26739.85, stdev=15976.81 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 8356], 10.00th=[ 11863], 20.00th=[ 15008], | 30.00th=[ 17957], 40.00th=[ 20841], 50.00th=[ 23725], 60.00th=[ 27395], | 70.00th=[ 31851], 80.00th=[ 36963], 90.00th=[ 45876], 95.00th=[ 54264], | 99.00th=[ 80217], 99.50th=[ 88605], 99.90th=[139461], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 23, max= 135, per=25.98%, avg=83.41, stdev=20.99, samples=143 iops : min= 5, max= 33, avg=20.26, stdev= 5.29, samples=143 write: IOPS=21, BW=85.1KiB/s (87.1kB/s)(6236KiB/73296msec); 0 zone resets clat (usec): min=907, max=695708, avg=20874.33, stdev=25875.08 lat (usec): min=908, max=695710, avg=20876.37, stdev=25874.83 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1254], 10.00th=[ 1647], 20.00th=[ 2900], | 30.00th=[ 5342], 40.00th=[ 10945], 50.00th=[ 15926], 60.00th=[ 20317], | 70.00th=[ 26608], 80.00th=[ 35390], 90.00th=[ 49021], 95.00th=[ 56886], | 99.00th=[ 81265], 99.50th=[ 96994], 99.90th=[130548], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 24, max= 151, per=25.37%, avg=85.25, stdev=26.36, samples=144 iops : min= 6, max= 37, avg=20.73, stdev= 6.63, samples=144 lat (usec) : 250=0.91%, 500=0.88%, 750=0.03%, 1000=0.33% lat (msec) : 2=6.15%, 4=7.00%, 10=7.36%, 20=25.88%, 50=43.52% lat (msec) : 100=7.62%, 250=0.29%, 750=0.03% cpu : usr=0.11%, sys=12.34%, ctx=7258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=321KiB/s (329kB/s), 80.6KiB/s-82.6KiB/s (82.5kB/s-84.6kB/s), io=23.4MiB (24.6MB), run=73296-74715msec WRITE: bw=336KiB/s (345kB/s), 83.8KiB/s-86.1KiB/s (85.8kB/s-88.2kB/s), io=24.6MiB (25.7MB), run=73296-74715msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183321: Sun Nov 16 23:10:45 2025 read: IOPS=15, BW=62.8KiB/s (64.3kB/s)(5992KiB/95482msec) clat (msec): min=5, max=686, avg=24.47, stdev=26.73 lat (msec): min=5, max=686, avg=24.48, stdev=26.73 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 69], | 99.00th=[ 104], 99.50th=[ 116], 99.90th=[ 207], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 215, per=25.20%, avg=62.76, stdev=38.47, samples=187 iops : min= 3, max= 53, avg=15.07, stdev= 9.63, samples=187 write: IOPS=16, BW=65.9KiB/s (67.5kB/s)(6296KiB/95482msec); 0 zone resets clat (msec): min=7, max=227, avg=37.23, stdev=24.03 lat (msec): min=7, max=227, avg=37.23, stdev=24.03 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 123], 99.50th=[ 140], 99.90th=[ 182], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 167, per=25.13%, avg=65.59, stdev=35.88, samples=188 iops : min= 1, max= 41, avg=15.79, stdev= 9.00, samples=188 lat (msec) : 10=9.67%, 20=33.30%, 50=39.26%, 100=15.98%, 250=1.76% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=4.63%, ctx=5032, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183322: Sun Nov 16 23:10:45 2025 read: IOPS=15, BW=61.8KiB/s (63.3kB/s)(5940KiB/96133msec) clat (msec): min=4, max=676, avg=25.05, stdev=27.08 lat (msec): min=4, max=676, avg=25.06, stdev=27.08 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 102], 99.50th=[ 110], 99.90th=[ 182], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 207, per=24.75%, avg=61.64, stdev=40.77, samples=190 iops : min= 1, max= 51, avg=14.79, stdev=10.21, samples=190 write: IOPS=16, BW=66.0KiB/s (67.6kB/s)(6348KiB/96133msec); 0 zone resets clat (msec): min=7, max=228, avg=37.00, stdev=25.61 lat (msec): min=7, max=228, avg=37.00, stdev=25.61 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 71], 95.00th=[ 90], | 99.00th=[ 129], 99.50th=[ 146], 99.90th=[ 176], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 7, max= 207, per=25.25%, avg=65.91, stdev=39.09, samples=190 iops : min= 1, max= 51, avg=15.86, stdev= 9.79, samples=190 lat (msec) : 10=10.16%, 20=33.85%, 50=37.14%, 100=16.67%, 250=2.15% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=4.46%, ctx=4997, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183323: Sun Nov 16 23:10:45 2025 read: IOPS=15, BW=63.0KiB/s (64.5kB/s)(6028KiB/95646msec) clat (msec): min=5, max=223, avg=24.76, stdev=21.84 lat (msec): min=5, max=223, avg=24.76, stdev=21.84 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 37], 90.00th=[ 55], 95.00th=[ 71], | 99.00th=[ 106], 99.50th=[ 117], 99.90th=[ 207], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 239, per=25.28%, avg=62.94, stdev=38.50, samples=189 iops : min= 1, max= 59, avg=15.12, stdev= 9.65, samples=189 write: IOPS=16, BW=65.4KiB/s (67.0kB/s)(6260KiB/95646msec); 0 zone resets clat (msec): min=7, max=667, avg=37.14, stdev=29.07 lat (msec): min=7, max=667, avg=37.14, stdev=29.07 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 70], 95.00th=[ 85], | 99.00th=[ 125], 99.50th=[ 144], 99.90th=[ 180], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 15, max= 183, per=25.02%, avg=65.29, stdev=37.93, samples=189 iops : min= 3, max= 45, avg=15.71, stdev= 9.50, samples=189 lat (msec) : 10=10.09%, 20=33.11%, 50=39.13%, 100=15.95%, 250=1.69% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=4.53%, ctx=4947, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183324: Sun Nov 16 23:10:45 2025 read: IOPS=15, BW=63.5KiB/s (64.0kB/s)(6052KiB/95371msec) clat (msec): min=4, max=207, avg=24.44, stdev=20.37 lat (msec): min=4, max=207, avg=24.44, stdev=20.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 55], 95.00th=[ 69], | 99.00th=[ 90], 99.50th=[ 105], 99.90th=[ 142], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 7, max= 215, per=25.56%, avg=63.64, stdev=39.52, samples=187 iops : min= 1, max= 53, avg=15.30, stdev= 9.91, samples=187 write: IOPS=16, BW=65.4KiB/s (66.0kB/s)(6236KiB/95371msec); 0 zone resets clat (msec): min=8, max=687, avg=37.33, stdev=29.49 lat (msec): min=8, max=687, avg=37.33, stdev=29.49 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 71], 95.00th=[ 84], | 99.00th=[ 127], 99.50th=[ 150], 99.90th=[ 180], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 183, per=24.92%, avg=65.05, stdev=37.70, samples=188 iops : min= 3, max= 45, avg=15.65, stdev= 9.44, samples=188 lat (msec) : 10=10.12%, 20=32.88%, 50=39.68%, 100=15.66%, 250=1.63% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=4.57%, ctx=5005, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=250KiB/s (256kB/s), 61.8KiB/s-63.5KiB/s (63.3kB/s-64.0kB/s), io=23.4MiB (24.6MB), run=95371-96133msec WRITE: bw=262KiB/s (268kB/s), 65.4KiB/s-66.0KiB/s (66.0kB/s-67.6kB/s), io=24.6MiB (25.7MB), run=95371-96133msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183353: Sun Nov 16 23:11:14 2025 read: IOPS=17, BW=274KiB/s (281kB/s)(5920KiB/21606msec) clat (usec): min=149, max=132704, avg=31157.23, stdev=19405.63 lat (usec): min=150, max=132706, avg=31158.49, stdev=19405.69 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 289], 10.00th=[ 11863], 20.00th=[ 16450], | 30.00th=[ 21103], 40.00th=[ 24511], 50.00th=[ 28443], 60.00th=[ 32113], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 52691], 95.00th=[ 64750], | 99.00th=[100140], 99.50th=[111674], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 155, max= 448, per=25.71%, avg=269.95, stdev=83.46, samples=42 iops : min= 9, max= 28, avg=16.10, stdev= 5.30, samples=42 write: IOPS=18, BW=295KiB/s (302kB/s)(6368KiB/21606msec); 0 zone resets clat (usec): min=1403, max=114534, avg=25180.18, stdev=22437.85 lat (usec): min=1405, max=114536, avg=25183.45, stdev=22436.93 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2089], 10.00th=[ 2900], 20.00th=[ 5342], | 30.00th=[ 8291], 40.00th=[ 13435], 50.00th=[ 19792], 60.00th=[ 24511], | 70.00th=[ 31851], 80.00th=[ 43254], 90.00th=[ 56361], 95.00th=[ 70779], | 99.00th=[ 98042], 99.50th=[102237], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 94, max= 544, per=26.61%, avg=294.05, stdev=88.71, samples=42 iops : min= 5, max= 34, avg=17.62, stdev= 5.65, samples=42 lat (usec) : 250=2.08%, 500=0.78%, 750=0.13% lat (msec) : 2=2.47%, 4=5.99%, 10=9.77%, 20=17.45%, 50=47.79% lat (msec) : 100=12.63%, 250=0.91% cpu : usr=0.12%, sys=12.19%, ctx=1951, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183354: Sun Nov 16 23:11:14 2025 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22803msec) clat (usec): min=131, max=117940, avg=31845.17, stdev=18607.24 lat (usec): min=132, max=117940, avg=31846.33, stdev=18607.23 clat percentiles (usec): | 1.00th=[ 186], 5.00th=[ 355], 10.00th=[ 12649], 20.00th=[ 18482], | 30.00th=[ 22152], 40.00th=[ 25297], 50.00th=[ 30016], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 45351], 90.00th=[ 52691], 95.00th=[ 62129], | 99.00th=[ 89654], 99.50th=[117965], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 28, max= 446, per=24.03%, avg=252.27, stdev=92.96, samples=45 iops : min= 1, max= 27, avg=15.00, stdev= 5.89, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22803msec); 0 zone resets clat (usec): min=1357, max=172152, avg=27135.27, stdev=25641.02 lat (usec): min=1359, max=172154, avg=27137.45, stdev=25641.01 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1795], 10.00th=[ 2343], 20.00th=[ 4178], | 30.00th=[ 7963], 40.00th=[ 14877], 50.00th=[ 20841], 60.00th=[ 27395], | 70.00th=[ 34866], 80.00th=[ 45876], 90.00th=[ 61080], 95.00th=[ 76022], | 99.00th=[107480], 99.50th=[127402], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 95, max= 512, per=25.93%, avg=286.56, stdev=92.49, samples=45 iops : min= 5, max= 32, avg=17.18, stdev= 5.84, samples=45 lat (usec) : 250=1.43%, 500=1.56%, 750=0.52% lat (msec) : 2=3.65%, 4=6.64%, 10=7.42%, 20=16.41%, 50=46.88% lat (msec) : 100=14.06%, 250=1.43% cpu : usr=0.09%, sys=11.40%, ctx=1946, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183355: Sun Nov 16 23:11:14 2025 read: IOPS=17, BW=278KiB/s (284kB/s)(6256KiB/22543msec) clat (usec): min=112, max=153692, avg=32535.74, stdev=21188.62 lat (usec): min=112, max=153693, avg=32537.05, stdev=21188.68 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 297], 10.00th=[ 12649], 20.00th=[ 17171], | 30.00th=[ 20317], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 33162], | 70.00th=[ 39584], 80.00th=[ 46400], 90.00th=[ 57934], 95.00th=[ 69731], | 99.00th=[ 92799], 99.50th=[149947], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 126, max= 510, per=26.37%, avg=276.93, stdev=83.13, samples=44 iops : min= 7, max= 31, avg=16.55, stdev= 5.24, samples=44 write: IOPS=16, BW=268KiB/s (274kB/s)(6032KiB/22543msec); 0 zone resets clat (usec): min=1471, max=104011, avg=25567.41, stdev=21608.33 lat (usec): min=1473, max=104013, avg=25571.24, stdev=21610.85 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2278], 10.00th=[ 3458], 20.00th=[ 6390], | 30.00th=[ 10159], 40.00th=[ 15139], 50.00th=[ 20317], 60.00th=[ 26346], | 70.00th=[ 33817], 80.00th=[ 42206], 90.00th=[ 56886], 95.00th=[ 69731], | 99.00th=[ 96994], 99.50th=[101188], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 93, max= 478, per=23.74%, avg=262.30, stdev=80.85, samples=44 iops : min= 5, max= 29, avg=15.61, stdev= 5.11, samples=44 lat (usec) : 250=1.56%, 500=1.30%, 750=0.52%, 1000=0.13% lat (msec) : 2=1.43%, 4=5.60%, 10=8.20%, 20=20.18%, 50=46.61% lat (msec) : 100=13.80%, 250=0.65% cpu : usr=0.11%, sys=11.72%, ctx=1979, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183356: Sun Nov 16 23:11:14 2025 read: IOPS=17, BW=279KiB/s (285kB/s)(6032KiB/21640msec) clat (usec): min=133, max=170584, avg=31005.20, stdev=20928.95 lat (usec): min=134, max=170586, avg=31006.58, stdev=20928.90 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 172], 10.00th=[ 367], 20.00th=[ 17171], | 30.00th=[ 21627], 40.00th=[ 25560], 50.00th=[ 28443], 60.00th=[ 32637], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 53216], 95.00th=[ 63177], | 99.00th=[ 91751], 99.50th=[149947], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 93, max= 447, per=26.41%, avg=277.36, stdev=83.14, samples=42 iops : min= 5, max= 27, avg=16.57, stdev= 5.20, samples=42 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21640msec); 0 zone resets clat (usec): min=1274, max=162054, avg=25126.85, stdev=22447.40 lat (usec): min=1276, max=162056, avg=25129.09, stdev=22447.46 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2114], 10.00th=[ 2966], 20.00th=[ 5473], | 30.00th=[ 8979], 40.00th=[ 13960], 50.00th=[ 19792], 60.00th=[ 24773], | 70.00th=[ 32637], 80.00th=[ 40633], 90.00th=[ 56361], 95.00th=[ 67634], | 99.00th=[ 96994], 99.50th=[106431], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 126, max= 512, per=26.05%, avg=287.81, stdev=92.03, samples=42 iops : min= 7, max= 32, avg=17.24, stdev= 5.88, samples=42 lat (usec) : 250=3.52%, 500=2.21%, 750=0.26% lat (msec) : 2=1.95%, 4=5.21%, 10=9.51%, 20=14.97%, 50=48.44% lat (msec) : 100=13.15%, 250=0.78% cpu : usr=0.16%, sys=11.72%, ctx=1836, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1050KiB/s (1076kB/s), 252KiB/s-279KiB/s (258kB/s-285kB/s), io=23.4MiB (24.5MB), run=21606-22803msec WRITE: bw=1105KiB/s (1132kB/s), 268KiB/s-295KiB/s (274kB/s-302kB/s), io=24.6MiB (25.8MB), run=21606-22803msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183357: Sun Nov 16 23:11:20 2025 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28295msec) clat (msec): min=5, max=140, avg=29.37, stdev=25.62 lat (msec): min=5, max=140, avg=29.38, stdev=25.62 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 85], | 99.00th=[ 129], 99.50th=[ 136], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 31, max= 669, per=24.03%, avg=201.38, stdev=132.34, samples=55 iops : min= 1, max= 41, avg=11.82, stdev= 8.32, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6368KiB/28295msec); 0 zone resets clat (msec): min=9, max=201, avg=43.61, stdev=29.08 lat (msec): min=9, max=201, avg=43.61, stdev=29.08 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 65], 90.00th=[ 87], 95.00th=[ 102], | 99.00th=[ 138], 99.50th=[ 188], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 542, per=25.04%, avg=220.58, stdev=133.82, samples=55 iops : min= 1, max= 33, avg=13.04, stdev= 8.40, samples=55 lat (msec) : 10=7.16%, 20=27.60%, 50=41.02%, 100=20.44%, 250=3.78% cpu : usr=0.07%, sys=3.94%, ctx=1288, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183358: Sun Nov 16 23:11:20 2025 read: IOPS=12, BW=201KiB/s (206kB/s)(5744KiB/28573msec) clat (msec): min=5, max=127, avg=30.13, stdev=25.64 lat (msec): min=5, max=127, avg=30.13, stdev=25.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 90], | 99.00th=[ 111], 99.50th=[ 123], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 28, max= 605, per=23.63%, avg=198.04, stdev=135.32, samples=56 iops : min= 1, max= 37, avg=11.61, stdev= 8.52, samples=56 write: IOPS=14, BW=229KiB/s (235kB/s)(6544KiB/28573msec); 0 zone resets clat (msec): min=9, max=196, avg=42.90, stdev=29.24 lat (msec): min=9, max=196, avg=42.90, stdev=29.24 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 54], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 102], | 99.00th=[ 150], 99.50th=[ 157], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 606, per=25.43%, avg=224.04, stdev=134.77, samples=56 iops : min= 1, max= 37, avg=13.25, stdev= 8.44, samples=56 lat (msec) : 10=6.64%, 20=27.34%, 50=39.84%, 100=21.74%, 250=4.43% cpu : usr=0.12%, sys=4.19%, ctx=1355, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183359: Sun Nov 16 23:11:20 2025 read: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28221msec) clat (msec): min=6, max=131, avg=27.68, stdev=23.56 lat (msec): min=6, max=131, avg=27.68, stdev=23.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 63], 95.00th=[ 82], | 99.00th=[ 106], 99.50th=[ 125], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 31, max= 695, per=26.12%, avg=218.85, stdev=159.28, samples=55 iops : min= 1, max= 43, avg=12.93, stdev=10.03, samples=55 write: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28221msec); 0 zone resets clat (msec): min=9, max=199, avg=45.80, stdev=32.64 lat (msec): min=9, max=199, avg=45.80, stdev=32.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 93], 95.00th=[ 113], | 99.00th=[ 157], 99.50th=[ 199], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 63, max= 637, per=23.61%, avg=207.96, stdev=129.01, samples=55 iops : min= 3, max= 39, avg=12.24, stdev= 8.10, samples=55 lat (msec) : 10=7.94%, 20=29.82%, 50=37.63%, 100=20.18%, 250=4.43% cpu : usr=0.12%, sys=4.09%, ctx=1319, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183360: Sun Nov 16 23:11:20 2025 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28058msec) clat (msec): min=5, max=116, avg=27.56, stdev=22.13 lat (msec): min=5, max=116, avg=27.56, stdev=22.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 78], | 99.00th=[ 105], 99.50th=[ 107], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 28, max= 574, per=25.37%, avg=212.64, stdev=137.40, samples=55 iops : min= 1, max= 35, avg=12.53, stdev= 8.64, samples=55 write: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28058msec); 0 zone resets clat (msec): min=10, max=197, avg=44.56, stdev=31.74 lat (msec): min=10, max=197, avg=44.56, stdev=31.74 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 88], 95.00th=[ 111], | 99.00th=[ 155], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 63, max= 733, per=25.05%, avg=220.65, stdev=133.86, samples=55 iops : min= 3, max= 45, avg=13.04, stdev= 8.43, samples=55 lat (msec) : 10=5.08%, 20=30.34%, 50=41.28%, 100=19.53%, 250=3.78% cpu : usr=0.12%, sys=4.20%, ctx=1329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=838KiB/s (858kB/s), 201KiB/s-222KiB/s (206kB/s-227kB/s), io=23.4MiB (24.5MB), run=28058-28573msec WRITE: bw=882KiB/s (903kB/s), 214KiB/s-229KiB/s (219kB/s-235kB/s), io=24.6MiB (25.8MB), run=28058-28573msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183372: Sun Nov 16 23:11:29 2025 read: IOPS=2, BW=2525KiB/s (2585kB/s)(7168KiB/2839msec) clat (usec): min=651, max=401955, avg=146935.35, stdev=140532.98 lat (usec): min=652, max=401956, avg=146936.96, stdev=140532.85 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 1352], | 30.00th=[105382], 40.00th=[105382], 50.00th=[137364], 60.00th=[141558], | 70.00th=[141558], 80.00th=[242222], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2048, max= 5446, per=62.57%, avg=3860.33, stdev=1710.30, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1803KiB/s (1847kB/s)(5120KiB/2839msec); 0 zone resets clat (msec): min=155, max=633, avg=349.33, stdev=210.68 lat (msec): min=155, max=633, avg=349.40, stdev=210.67 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1878, max= 4096, per=30.89%, avg=2668.33, stdev=1238.76, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.04%, sys=31.82%, ctx=343, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183374: Sun Nov 16 23:11:29 2025 read: IOPS=0, BW=617KiB/s (632kB/s)(2048KiB/3319msec) clat (usec): min=792, max=139300, avg=70046.65, stdev=97939.94 lat (usec): min=793, max=139302, avg=70048.32, stdev=97940.47 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 791], 50.00th=[ 791], 60.00th=[139461], | 70.00th=[139461], 80.00th=[139461], 90.00th=[139461], 95.00th=[139461], | 99.00th=[139461], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 1855, max= 2031, per=31.49%, avg=1943.00, stdev=124.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3085KiB/s (3159kB/s)(10.0MiB/3319msec); 0 zone resets clat (msec): min=90, max=557, avg=299.34, stdev=172.91 lat (msec): min=90, max=557, avg=299.40, stdev=172.91 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 95], | 30.00th=[ 134], 40.00th=[ 209], 50.00th=[ 247], 60.00th=[ 309], | 70.00th=[ 401], 80.00th=[ 422], 90.00th=[ 531], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1878, max= 6144, per=42.19%, avg=3644.00, stdev=1752.70, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 1.87, samples=5 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=33.42%, ctx=134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183375: Sun Nov 16 23:11:29 2025 read: IOPS=2, BW=2427KiB/s (2485kB/s)(6144KiB/2532msec) clat (usec): min=599, max=160319, avg=104226.62, stdev=64498.27 lat (usec): min=601, max=160320, avg=104227.96, stdev=64498.33 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 54789], | 30.00th=[ 54789], 40.00th=[106431], 50.00th=[106431], 60.00th=[147850], | 70.00th=[154141], 80.00th=[154141], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 4063, max= 4087, per=66.05%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2427KiB/s (2485kB/s)(6144KiB/2532msec); 0 zone resets clat (msec): min=124, max=472, avg=286.54, stdev=127.23 lat (msec): min=124, max=472, avg=286.61, stdev=127.23 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 330], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1835, max= 4063, per=28.42%, avg=2454.75, stdev=1075.91, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.20%, sys=31.49%, ctx=232, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183376: Sun Nov 16 23:11:29 2025 read: IOPS=1, BW=1583KiB/s (1621kB/s)(5120KiB/3234msec) clat (usec): min=886, max=245715, avg=88104.87, stdev=120586.09 lat (usec): min=888, max=245716, avg=88106.24, stdev=120585.66 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 889], 10.00th=[ 889], 20.00th=[ 889], | 30.00th=[ 889], 40.00th=[ 889], 50.00th=[ 1729], 60.00th=[ 1729], | 70.00th=[191890], 80.00th=[191890], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 4063, max= 4096, per=66.12%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2216KiB/s (2270kB/s)(7168KiB/3234msec); 0 zone resets clat (msec): min=128, max=696, avg=374.24, stdev=177.76 lat (msec): min=128, max=696, avg=374.32, stdev=177.74 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 243], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 359], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 439], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2031, max= 3757, per=28.59%, avg=2469.75, stdev=858.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=16.67% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=27.87%, ctx=128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6171KiB/s (6319kB/s), 617KiB/s-2525KiB/s (632kB/s-2585kB/s), io=20.0MiB (20.0MB), run=2532-3319msec WRITE: bw=8639KiB/s (8846kB/s), 1803KiB/s-3085KiB/s (1847kB/s-3159kB/s), io=28.0MiB (29.4MB), run=2532-3319msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183369: Sun Nov 16 23:11:30 2025 read: IOPS=2, BW=2993KiB/s (3065kB/s)(7168KiB/2395msec) clat (msec): min=48, max=457, avg=184.26, stdev=147.78 lat (msec): min=48, max=457, avg=184.26, stdev=147.78 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 122], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 300], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 4031, max= 5535, per=84.18%, avg=4783.00, stdev=1063.49, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2138KiB/s (2189kB/s)(5120KiB/2395msec); 0 zone resets clat (msec): min=96, max=353, avg=212.20, stdev=107.50 lat (msec): min=97, max=353, avg=212.27, stdev=107.50 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2015, max= 4079, per=34.10%, avg=2712.33, stdev=1183.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=10.48%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183370: Sun Nov 16 23:11:30 2025 read: IOPS=0, BW=568KiB/s (582kB/s)(2048KiB/3604msec) clat (msec): min=102, max=275, avg=188.85, stdev=122.68 lat (msec): min=102, max=275, avg=188.85, stdev=122.68 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1848, max= 2039, per=34.20%, avg=1943.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2841KiB/s (2909kB/s)(10.0MiB/3604msec); 0 zone resets clat (msec): min=88, max=883, avg=306.28, stdev=235.10 lat (msec): min=88, max=883, avg=306.54, stdev=235.12 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 112], | 30.00th=[ 136], 40.00th=[ 169], 50.00th=[ 226], 60.00th=[ 284], | 70.00th=[ 347], 80.00th=[ 397], 90.00th=[ 426], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2039, max= 6119, per=45.98%, avg=3657.40, stdev=2214.41, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=16.10%, ctx=162, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183371: Sun Nov 16 23:11:30 2025 read: IOPS=1, BW=1928KiB/s (1975kB/s)(6144KiB/3186msec) clat (msec): min=61, max=586, avg=200.35, stdev=194.57 lat (msec): min=61, max=586, avg=200.35, stdev=194.57 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2039, max= 4087, per=59.87%, avg=3401.67, stdev=1180.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1928KiB/s (1975kB/s)(6144KiB/3186msec); 0 zone resets clat (msec): min=84, max=552, avg=308.58, stdev=175.68 lat (msec): min=84, max=552, avg=308.66, stdev=175.69 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 313], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2015, max= 4079, per=37.36%, avg=2971.75, stdev=1096.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=9.42%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183373: Sun Nov 16 23:11:30 2025 read: IOPS=1, BW=1680KiB/s (1721kB/s)(5120KiB/3047msec) clat (msec): min=75, max=300, avg=145.60, stdev=91.32 lat (msec): min=75, max=300, avg=145.60, stdev=91.32 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 103], 60.00th=[ 103], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2039, max= 6119, per=71.79%, avg=4079.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2352KiB/s (2409kB/s)(7168KiB/3047msec); 0 zone resets clat (msec): min=75, max=500, avg=303.89, stdev=144.30 lat (msec): min=75, max=500, avg=303.97, stdev=144.29 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 226], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 300], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 460], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1921, max= 4031, per=33.50%, avg=2665.00, stdev=1184.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=16.68%, ctx=235, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5683KiB/s (5819kB/s), 568KiB/s-2993KiB/s (582kB/s-3065kB/s), io=20.0MiB (20.0MB), run=2395-3604msec WRITE: bw=7956KiB/s (8147kB/s), 1928KiB/s-2841KiB/s (1975kB/s-2909kB/s), io=28.0MiB (29.4MB), run=2395-3604msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183383: Sun Nov 16 23:11:38 2025 read: IOPS=1, BW=6664KiB/s (6824kB/s)(12.0MiB/1844msec) clat (msec): min=505, max=738, avg=599.46, stdev=123.19 lat (msec): min=505, max=738, avg=599.47, stdev=123.19 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8175, max= 8192, per=92.10%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=8.57%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183384: Sun Nov 16 23:11:38 2025 read: IOPS=0, BW=2264KiB/s (2319kB/s)(4096KiB/1809msec) clat (nsec): min=136431k, max=136431k, avg=136430959.00, stdev= 0.00 lat (nsec): min=136433k, max=136433k, avg=136433129.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 138], 95.00th=[ 138], | 99.00th=[ 138], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 6077, max= 6077, per=68.40%, avg=6077.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4528KiB/s (4637kB/s)(8192KiB/1809msec); 0 zone resets clat (msec): min=629, max=957, avg=793.71, stdev=232.30 lat (msec): min=629, max=958, avg=794.06, stdev=232.28 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=54.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.06%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183385: Sun Nov 16 23:11:38 2025 write: IOPS=1, BW=5657KiB/s (5793kB/s)(12.0MiB/2172msec); 0 zone resets clat (msec): min=140, max=1103, avg=706.02, stdev=503.28 lat (msec): min=140, max=1104, avg=706.36, stdev=503.32 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8192, per=54.25%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=9.86%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183386: Sun Nov 16 23:11:38 2025 write: IOPS=1, BW=6812KiB/s (6975kB/s)(12.0MiB/1804msec); 0 zone resets clat (msec): min=145, max=1168, avg=566.64, stdev=534.80 lat (msec): min=145, max=1168, avg=567.12, stdev=534.71 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min=12011, max=12011, per=79.62%, avg=12011.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.25%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8885KiB/s (9098kB/s), 2264KiB/s-6664KiB/s (2319kB/s-6824kB/s), io=16.0MiB (16.8MB), run=1809-1844msec WRITE: bw=14.7MiB/s (15.4MB/s), 4528KiB/s-6812KiB/s (4637kB/s-6975kB/s), io=32.0MiB (33.6MB), run=1804-2172msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183387: Sun Nov 16 23:11:39 2025 read: IOPS=1, BW=7119KiB/s (7290kB/s)(12.0MiB/1726msec) clat (msec): min=508, max=569, avg=544.00, stdev=31.74 lat (msec): min=508, max=569, avg=544.00, stdev=31.74 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8015, max= 8192, per=92.44%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.06%, sys=29.68%, ctx=656, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183388: Sun Nov 16 23:11:39 2025 read: IOPS=0, BW=2192KiB/s (2244kB/s)(4096KiB/1869msec) clat (nsec): min=498051k, max=498051k, avg=498051353.00, stdev= 0.00 lat (nsec): min=498053k, max=498053k, avg=498053473.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 6450, max= 6450, per=73.58%, avg=6450.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4383KiB/s (4488kB/s)(8192KiB/1869msec); 0 zone resets clat (msec): min=476, max=771, avg=623.98, stdev=208.98 lat (msec): min=476, max=771, avg=624.26, stdev=208.89 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=55.25%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.05%, sys=9.48%, ctx=211, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183389: Sun Nov 16 23:11:39 2025 write: IOPS=1, BW=5560KiB/s (5694kB/s)(12.0MiB/2210msec); 0 zone resets clat (msec): min=102, max=1434, avg=729.39, stdev=669.10 lat (msec): min=103, max=1434, avg=729.65, stdev=669.12 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8015, max= 8192, per=54.65%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=7.15%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183390: Sun Nov 16 23:11:39 2025 write: IOPS=1, BW=6686KiB/s (6846kB/s)(12.0MiB/1838msec); 0 zone resets clat (msec): min=440, max=870, avg=593.50, stdev=240.25 lat (msec): min=440, max=870, avg=593.83, stdev=240.26 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 6671, max= 8192, per=50.12%, avg=7431.50, stdev=1075.51, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.05%, sys=10.56%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8766KiB/s (8977kB/s), 2192KiB/s-7119KiB/s (2244kB/s-7290kB/s), io=16.0MiB (16.8MB), run=1726-1869msec WRITE: bw=14.5MiB/s (15.2MB/s), 4383KiB/s-6686KiB/s (4488kB/s-6846kB/s), io=32.0MiB (33.6MB), run=1838-2210msec