== sanity test 398b: DIO and buffer IO race ============== 13:11:38 (1788282698) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.45608 s, 14.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159712: Tue Sep 1 13:12:54 2026 read: IOPS=23, BW=93.1KiB/s (95.3kB/s)(5992KiB/64367msec) clat (usec): min=41, max=794104, avg=22540.85, stdev=23513.43 lat (usec): min=41, max=794104, avg=22541.40, stdev=23513.43 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 6521], 10.00th=[ 9896], 20.00th=[ 13042], | 30.00th=[ 15139], 40.00th=[ 17433], 50.00th=[ 19530], 60.00th=[ 22676], | 70.00th=[ 26608], 80.00th=[ 30802], 90.00th=[ 37487], 95.00th=[ 43254], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[139461], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 6, max= 168, per=25.06%, avg=92.98, stdev=25.59, samples=128 iops : min= 1, max= 42, avg=22.79, stdev= 6.39, samples=128 write: IOPS=24, BW=97.8KiB/s (100kB/s)(6296KiB/64367msec); 0 zone resets clat (usec): min=636, max=115470, avg=19242.69, stdev=14648.39 lat (usec): min=637, max=115471, avg=19244.17, stdev=14649.29 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 2999], 10.00th=[ 4359], 20.00th=[ 5997], | 30.00th=[ 8455], 40.00th=[ 13042], 50.00th=[ 16450], 60.00th=[ 19792], | 70.00th=[ 23987], 80.00th=[ 30802], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[104334], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 39, max= 192, per=25.54%, avg=99.11, stdev=29.07, samples=126 iops : min= 9, max= 48, avg=24.32, stdev= 7.33, samples=126 lat (usec) : 50=0.03%, 100=0.07%, 250=1.79%, 500=0.26%, 750=0.20% lat (usec) : 1000=0.55% lat (msec) : 2=0.55%, 4=2.96%, 10=15.72%, 20=34.38%, 50=40.49% lat (msec) : 100=2.86%, 250=0.10%, 1000=0.03% cpu : usr=0.05%, sys=29.75%, ctx=9553, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159713: Tue Sep 1 13:12:54 2026 read: IOPS=22, BW=91.9KiB/s (94.1kB/s)(5940KiB/64663msec) clat (usec): min=59, max=99406, avg=22284.33, stdev=11683.01 lat (usec): min=59, max=99406, avg=22284.91, stdev=11683.03 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 7242], 10.00th=[10683], 20.00th=[13566], | 30.00th=[15664], 40.00th=[17957], 50.00th=[20317], 60.00th=[23200], | 70.00th=[26870], 80.00th=[30278], 90.00th=[36963], 95.00th=[43254], | 99.00th=[60031], 99.50th=[71828], 99.90th=[83362], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 6, max= 167, per=24.84%, avg=92.15, stdev=24.48, samples=127 iops : min= 1, max= 41, avg=22.57, stdev= 6.15, samples=127 write: IOPS=24, BW=98.2KiB/s (101kB/s)(6348KiB/64663msec); 0 zone resets clat (usec): min=684, max=792476, avg=19685.35, stdev=24448.70 lat (usec): min=684, max=792476, avg=19686.00, stdev=24448.70 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 3294], 10.00th=[ 4555], 20.00th=[ 6194], | 30.00th=[ 8848], 40.00th=[ 12911], 50.00th=[ 16188], 60.00th=[ 19792], | 70.00th=[ 23987], 80.00th=[ 29754], 90.00th=[ 38011], 95.00th=[ 44827], | 99.00th=[ 71828], 99.50th=[ 83362], 99.90th=[133694], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 24, max= 216, per=25.31%, avg=98.20, stdev=29.56, samples=127 iops : min= 6, max= 54, avg=24.09, stdev= 7.42, samples=127 lat (usec) : 100=0.20%, 250=1.33%, 500=0.13%, 750=0.26%, 1000=0.26% lat (msec) : 2=0.65%, 4=2.64%, 10=15.49%, 20=33.79%, 50=42.22% lat (msec) : 100=2.90%, 250=0.10%, 1000=0.03% cpu : usr=0.06%, sys=29.81%, ctx=9644, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159714: Tue Sep 1 13:12:54 2026 read: IOPS=23, BW=94.7KiB/s (96.0kB/s)(6028KiB/63636msec) clat (usec): min=30, max=783945, avg=22311.96, stdev=23143.59 lat (usec): min=31, max=783945, avg=22312.57, stdev=23143.59 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 3556], 10.00th=[ 9503], 20.00th=[ 12911], | 30.00th=[ 15008], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 22938], | 70.00th=[ 26346], 80.00th=[ 30278], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[112722], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 6, max= 192, per=25.48%, avg=94.53, stdev=28.35, samples=126 iops : min= 1, max= 48, avg=23.17, stdev= 7.16, samples=126 write: IOPS=24, BW=98.4KiB/s (101kB/s)(6260KiB/63636msec); 0 zone resets clat (usec): min=662, max=172623, avg=18972.95, stdev=14845.23 lat (usec): min=663, max=172624, avg=18973.73, stdev=14845.27 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 3130], 10.00th=[ 4424], 20.00th=[ 5866], | 30.00th=[ 8094], 40.00th=[ 12256], 50.00th=[ 15664], 60.00th=[ 19792], | 70.00th=[ 24249], 80.00th=[ 30016], 90.00th=[ 39584], 95.00th=[ 46400], | 99.00th=[ 64750], 99.50th=[ 73925], 99.90th=[106431], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 8, max= 232, per=25.26%, avg=98.00, stdev=30.93, samples=126 iops : min= 2, max= 58, avg=24.04, stdev= 7.71, samples=126 lat (usec) : 50=0.26%, 100=0.16%, 250=1.63%, 500=0.26%, 750=0.46% lat (usec) : 1000=0.29% lat (msec) : 2=0.68%, 4=2.83%, 10=16.44%, 20=32.58%, 50=41.57% lat (msec) : 100=2.70%, 250=0.10%, 1000=0.03% cpu : usr=0.04%, sys=29.56%, ctx=9500, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159715: Tue Sep 1 13:12:54 2026 read: IOPS=23, BW=93.0KiB/s (96.2kB/s)(6052KiB/64392msec) clat (usec): min=34, max=119324, avg=21668.34, stdev=12085.34 lat (usec): min=35, max=119325, avg=21668.98, stdev=12085.33 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 5932], 10.00th=[ 10421], 20.00th=[ 13042], | 30.00th=[ 15139], 40.00th=[ 16909], 50.00th=[ 20055], 60.00th=[ 22676], | 70.00th=[ 25822], 80.00th=[ 29754], 90.00th=[ 35390], 95.00th=[ 40633], | 99.00th=[ 60031], 99.50th=[ 72877], 99.90th=[114820], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 23, max= 192, per=25.69%, avg=95.30, stdev=26.20, samples=126 iops : min= 5, max= 48, avg=23.37, stdev= 6.58, samples=126 write: IOPS=24, BW=96.8KiB/s (99.2kB/s)(6236KiB/64392msec); 0 zone resets clat (usec): min=638, max=809763, avg=20077.29, stdev=25181.02 lat (usec): min=639, max=809765, avg=20077.92, stdev=25181.05 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 3458], 10.00th=[ 4359], 20.00th=[ 5800], | 30.00th=[ 8586], 40.00th=[ 13304], 50.00th=[ 16909], 60.00th=[ 20317], | 70.00th=[ 24511], 80.00th=[ 30802], 90.00th=[ 39060], 95.00th=[ 45876], | 99.00th=[ 69731], 99.50th=[ 88605], 99.90th=[145753], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 8, max= 176, per=25.06%, avg=97.24, stdev=28.43, samples=127 iops : min= 2, max= 44, avg=23.86, stdev= 7.14, samples=127 lat (usec) : 50=0.03%, 100=0.16%, 250=1.60%, 500=0.33%, 750=0.36% lat (usec) : 1000=0.33% lat (msec) : 2=0.52%, 4=2.64%, 10=15.33%, 20=33.43%, 50=42.25% lat (msec) : 100=2.77%, 250=0.23%, 1000=0.03% cpu : usr=0.05%, sys=29.53%, ctx=9594, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=371KiB/s (380kB/s), 91.9KiB/s-94.7KiB/s (94.1kB/s-96.0kB/s), io=23.4MiB (24.6MB), run=63636-64663msec WRITE: bw=389KiB/s (398kB/s), 96.8KiB/s-98.4KiB/s (99.2kB/s-101kB/s), io=24.6MiB (25.7MB), run=63636-64663msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159717: Tue Sep 1 13:13:14 2026 read: IOPS=17, BW=70.8KiB/s (72.5kB/s)(5992KiB/84597msec) clat (msec): min=2, max=795, avg=19.06, stdev=26.77 lat (msec): min=2, max=795, avg=19.06, stdev=26.77 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 57], | 99.00th=[ 90], 99.50th=[ 100], 99.90th=[ 130], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 15, max= 240, per=25.07%, avg=70.94, stdev=46.27, samples=167 iops : min= 3, max= 60, avg=17.37, stdev=11.72, samples=167 write: IOPS=18, BW=74.4KiB/s (76.2kB/s)(6296KiB/84597msec); 0 zone resets clat (msec): min=12, max=198, avg=35.43, stdev=20.86 lat (msec): min=12, max=198, avg=35.43, stdev=20.86 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 62], 95.00th=[ 74], | 99.00th=[ 112], 99.50th=[ 144], 99.90th=[ 180], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 15, max= 176, per=25.33%, avg=74.98, stdev=41.93, samples=166 iops : min= 3, max= 44, avg=18.38, stdev=10.67, samples=166 lat (msec) : 4=5.11%, 10=14.68%, 20=24.38%, 50=42.71%, 100=12.21% lat (msec) : 250=0.88%, 1000=0.03% cpu : usr=0.06%, sys=10.68%, ctx=6215, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159718: Tue Sep 1 13:13:14 2026 read: IOPS=17, BW=70.2KiB/s (71.8kB/s)(5940KiB/84670msec) clat (msec): min=2, max=779, avg=19.09, stdev=26.88 lat (msec): min=2, max=779, avg=19.09, stdev=26.88 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 163], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 248, per=24.83%, avg=70.27, stdev=47.60, samples=167 iops : min= 1, max= 62, avg=17.20, stdev=12.04, samples=167 write: IOPS=18, BW=74.0KiB/s (76.8kB/s)(6348KiB/84670msec); 0 zone resets clat (msec): min=11, max=172, avg=35.31, stdev=20.27 lat (msec): min=11, max=172, avg=35.31, stdev=20.27 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 105], 99.50th=[ 136], 99.90th=[ 169], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 8, max= 176, per=25.33%, avg=74.96, stdev=42.62, samples=167 iops : min= 2, max= 44, avg=18.38, stdev=10.84, samples=167 lat (msec) : 4=5.60%, 10=13.87%, 20=25.49%, 50=41.54%, 100=12.57% lat (msec) : 250=0.91%, 1000=0.03% cpu : usr=0.06%, sys=10.60%, ctx=6110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159719: Tue Sep 1 13:13:14 2026 read: IOPS=17, BW=71.3KiB/s (72.0kB/s)(6028KiB/84581msec) clat (msec): min=2, max=162, avg=18.79, stdev=17.74 lat (msec): min=2, max=162, avg=18.79, stdev=17.74 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 84], 99.50th=[ 96], 99.90th=[ 133], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 15, max= 256, per=25.54%, avg=72.28, stdev=44.30, samples=165 iops : min= 3, max= 64, avg=17.70, stdev=11.23, samples=165 write: IOPS=18, BW=74.0KiB/s (75.8kB/s)(6260KiB/84581msec); 0 zone resets clat (msec): min=11, max=790, avg=35.77, stdev=27.96 lat (msec): min=11, max=790, avg=35.77, stdev=27.96 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 110], 99.50th=[ 133], 99.90th=[ 186], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 23, max= 184, per=25.03%, avg=74.10, stdev=43.78, samples=167 iops : min= 5, max= 46, avg=18.16, stdev=11.13, samples=167 lat (msec) : 4=4.85%, 10=14.78%, 20=24.97%, 50=42.06%, 100=12.47% lat (msec) : 250=0.85%, 1000=0.03% cpu : usr=0.06%, sys=10.53%, ctx=6130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159720: Tue Sep 1 13:13:14 2026 read: IOPS=17, BW=71.9KiB/s (73.6kB/s)(6052KiB/84195msec) clat (msec): min=2, max=177, avg=18.68, stdev=18.28 lat (msec): min=2, max=177, avg=18.69, stdev=18.28 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 94], 99.50th=[ 100], 99.90th=[ 134], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 272, per=25.75%, avg=72.88, stdev=46.71, samples=164 iops : min= 1, max= 68, avg=17.85, stdev=11.83, samples=164 write: IOPS=18, BW=74.1KiB/s (75.8kB/s)(6236KiB/84195msec); 0 zone resets clat (msec): min=11, max=802, avg=35.70, stdev=28.21 lat (msec): min=11, max=802, avg=35.70, stdev=28.21 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 110], 99.50th=[ 138], 99.90th=[ 199], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 16, max= 192, per=25.05%, avg=74.16, stdev=43.76, samples=166 iops : min= 4, max= 48, avg=18.17, stdev=11.11, samples=166 lat (msec) : 4=5.73%, 10=14.00%, 20=25.26%, 50=41.73%, 100=12.43% lat (msec) : 250=0.81%, 1000=0.03% cpu : usr=0.06%, sys=10.75%, ctx=6111, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=284KiB/s (290kB/s), 70.2KiB/s-71.9KiB/s (71.8kB/s-73.6kB/s), io=23.4MiB (24.6MB), run=84195-84670msec WRITE: bw=297KiB/s (304kB/s), 74.0KiB/s-74.0KiB/s (75.8kB/s-76.8kB/s), io=24.6MiB (25.7MB), run=84195-84670msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159743: Tue Sep 1 13:13:35 2026 read: IOPS=24, BW=390KiB/s (400kB/s)(5920KiB/15166msec) clat (usec): min=81, max=138526, avg=20457.36, stdev=12875.50 lat (usec): min=81, max=138527, avg=20458.00, stdev=12875.67 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 157], 10.00th=[ 6456], 20.00th=[ 11994], | 30.00th=[ 14353], 40.00th=[ 16581], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 25297], 80.00th=[ 28967], 90.00th=[ 35390], 95.00th=[ 39584], | 99.00th=[ 54789], 99.50th=[ 59507], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 223, max= 704, per=24.93%, avg=389.97, stdev=124.79, samples=30 iops : min= 13, max= 44, avg=23.83, stdev= 7.94, samples=30 write: IOPS=26, BW=420KiB/s (430kB/s)(6368KiB/15166msec); 0 zone resets clat (usec): min=991, max=119221, avg=18923.70, stdev=13595.97 lat (usec): min=991, max=119222, avg=18924.60, stdev=13595.97 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 4424], 10.00th=[ 5276], 20.00th=[ 7767], | 30.00th=[ 10159], 40.00th=[ 12911], 50.00th=[ 15926], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 27919], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 57934], 99.50th=[ 87557], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 191, max= 672, per=25.51%, avg=419.83, stdev=131.38, samples=30 iops : min= 11, max= 42, avg=25.70, stdev= 8.36, samples=30 lat (usec) : 100=0.52%, 250=3.91%, 500=0.13%, 1000=0.26% lat (msec) : 2=0.39%, 4=1.56%, 10=15.63%, 20=36.07%, 50=39.45% lat (msec) : 100=1.82%, 250=0.26% cpu : usr=0.08%, sys=32.83%, ctx=2844, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159744: Tue Sep 1 13:13:35 2026 read: IOPS=23, BW=380KiB/s (389kB/s)(5744KiB/15135msec) clat (usec): min=33, max=85307, avg=21412.79, stdev=12845.41 lat (usec): min=34, max=85307, avg=21413.33, stdev=12845.45 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 219], 10.00th=[ 9110], 20.00th=[12125], | 30.00th=[14484], 40.00th=[16909], 50.00th=[19006], 60.00th=[21890], | 70.00th=[24511], 80.00th=[30278], 90.00th=[39060], 95.00th=[45876], | 99.00th=[61080], 99.50th=[74974], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 190, max= 640, per=24.48%, avg=382.93, stdev=121.44, samples=29 iops : min= 11, max= 40, avg=23.38, stdev= 7.68, samples=29 write: IOPS=27, BW=432KiB/s (443kB/s)(6544KiB/15135msec); 0 zone resets clat (usec): min=945, max=82350, avg=18146.70, stdev=13331.02 lat (usec): min=946, max=82352, avg=18147.57, stdev=13331.07 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 3752], 10.00th=[ 4555], 20.00th=[ 6915], | 30.00th=[ 9372], 40.00th=[11338], 50.00th=[14746], 60.00th=[18220], | 70.00th=[22414], 80.00th=[28443], 90.00th=[37487], 95.00th=[42206], | 99.00th=[57934], 99.50th=[69731], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 191, max= 768, per=26.32%, avg=433.17, stdev=140.78, samples=29 iops : min= 11, max= 48, avg=26.55, stdev= 8.93, samples=29 lat (usec) : 50=0.13%, 100=0.39%, 250=2.21%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.04%, 4=2.21%, 10=17.84%, 20=35.03%, 50=37.37% lat (msec) : 100=3.12% cpu : usr=0.04%, sys=33.20%, ctx=2988, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159745: Tue Sep 1 13:13:35 2026 read: IOPS=25, BW=409KiB/s (418kB/s)(6256KiB/15308msec) clat (usec): min=35, max=82151, avg=20925.37, stdev=13361.15 lat (usec): min=35, max=82151, avg=20925.89, stdev=13361.16 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 169], 10.00th=[ 5669], 20.00th=[11338], | 30.00th=[14091], 40.00th=[16319], 50.00th=[19006], 60.00th=[22152], | 70.00th=[25822], 80.00th=[29754], 90.00th=[36963], 95.00th=[45351], | 99.00th=[70779], 99.50th=[73925], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 127, max= 704, per=26.02%, avg=406.90, stdev=123.75, samples=30 iops : min= 7, max= 44, avg=24.90, stdev= 7.87, samples=30 write: IOPS=24, BW=394KiB/s (403kB/s)(6032KiB/15308msec); 0 zone resets clat (usec): min=891, max=76618, avg=18756.52, stdev=12002.13 lat (usec): min=891, max=76621, avg=18757.41, stdev=12002.23 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 4113], 10.00th=[ 5080], 20.00th=[ 8455], | 30.00th=[11076], 40.00th=[13829], 50.00th=[16712], 60.00th=[20317], | 70.00th=[22938], 80.00th=[27132], 90.00th=[35390], 95.00th=[41681], | 99.00th=[60556], 99.50th=[64226], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 222, max= 704, per=23.39%, avg=385.07, stdev=134.10, samples=30 iops : min= 13, max= 44, avg=23.50, stdev= 8.48, samples=30 lat (usec) : 50=0.26%, 100=0.13%, 250=3.26%, 500=0.52%, 1000=0.39% lat (msec) : 2=0.52%, 4=1.95%, 10=13.41%, 20=35.94%, 50=41.41% lat (msec) : 100=2.21% cpu : usr=0.07%, sys=32.74%, ctx=3017, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159746: Tue Sep 1 13:13:35 2026 read: IOPS=25, BW=402KiB/s (412kB/s)(6032KiB/15002msec) clat (usec): min=84, max=68935, avg=19376.68, stdev=12299.21 lat (usec): min=84, max=68935, avg=19378.39, stdev=12301.31 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 159], 10.00th=[ 265], 20.00th=[10683], | 30.00th=[13435], 40.00th=[15926], 50.00th=[18220], 60.00th=[20055], | 70.00th=[23200], 80.00th=[28181], 90.00th=[34866], 95.00th=[41681], | 99.00th=[55313], 99.50th=[65799], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 159, max= 640, per=25.56%, avg=399.83, stdev=132.04, samples=29 iops : min= 9, max= 40, avg=24.45, stdev= 8.42, samples=29 write: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/15002msec); 0 zone resets clat (usec): min=995, max=118400, avg=19509.18, stdev=14498.87 lat (usec): min=996, max=118400, avg=19510.06, stdev=14498.93 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 4146], 10.00th=[ 5014], 20.00th=[ 8225], | 30.00th=[ 9896], 40.00th=[ 12649], 50.00th=[ 16188], 60.00th=[ 19792], | 70.00th=[ 23462], 80.00th=[ 28967], 90.00th=[ 37487], 95.00th=[ 44827], | 99.00th=[ 62129], 99.50th=[ 95945], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 160, max= 638, per=25.32%, avg=416.79, stdev=120.22, samples=29 iops : min= 10, max= 39, avg=25.52, stdev= 7.61, samples=29 lat (usec) : 100=0.26%, 250=4.56%, 500=0.78%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.52%, 4=1.56%, 10=16.15%, 20=35.55%, 50=37.24% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.06%, sys=32.90%, ctx=2796, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1565KiB/s (1602kB/s), 380KiB/s-409KiB/s (389kB/s-418kB/s), io=23.4MiB (24.5MB), run=15002-15308msec WRITE: bw=1646KiB/s (1686kB/s), 394KiB/s-432KiB/s (403kB/s-443kB/s), io=24.6MiB (25.8MB), run=15002-15308msec fio: pid=159751, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=159748: Tue Sep 1 13:13:40 2026 read: IOPS=18, BW=300KiB/s (307kB/s)(5920KiB/19746msec) clat (msec): min=3, max=121, avg=17.24, stdev=16.49 lat (msec): min=3, max=121, avg=17.24, stdev=16.49 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 52], | 99.00th=[ 86], 99.50th=[ 106], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 95, max= 640, per=26.90%, avg=299.41, stdev=157.99, samples=39 iops : min= 5, max= 40, avg=18.13, stdev=10.13, samples=39 write: IOPS=20, BW=322KiB/s (330kB/s)(6368KiB/19746msec); 0 zone resets clat (msec): min=12, max=165, avg=33.46, stdev=18.17 lat (msec): min=12, max=165, avg=33.46, stdev=18.17 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 92], 99.50th=[ 112], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 127, max= 640, per=27.27%, avg=323.74, stdev=151.39, samples=39 iops : min= 7, max= 40, avg=19.67, stdev= 9.72, samples=39 lat (msec) : 4=1.82%, 10=19.14%, 20=24.87%, 50=43.62%, 100=9.90% lat (msec) : 250=0.65% cpu : usr=0.05%, sys=12.60%, ctx=1713, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159749: Tue Sep 1 13:13:40 2026 read: IOPS=17, BW=288KiB/s (294kB/s)(5744KiB/19973msec) clat (msec): min=3, max=101, avg=18.14, stdev=17.61 lat (msec): min=3, max=101, avg=18.14, stdev=17.61 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 42], 95.00th=[ 64], | 99.00th=[ 82], 99.50th=[ 95], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 32, max= 704, per=25.65%, avg=285.46, stdev=166.01, samples=39 iops : min= 2, max= 44, avg=17.26, stdev=10.63, samples=39 write: IOPS=20, BW=328KiB/s (336kB/s)(6544KiB/19973msec); 0 zone resets clat (msec): min=12, max=167, avg=32.78, stdev=19.44 lat (msec): min=12, max=167, avg=32.78, stdev=19.44 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 104], 99.50th=[ 134], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 127, max= 736, per=26.92%, avg=319.54, stdev=160.29, samples=39 iops : min= 7, max= 46, avg=19.38, stdev=10.30, samples=39 lat (msec) : 4=2.47%, 10=16.80%, 20=27.60%, 50=42.45%, 100=9.90% lat (msec) : 250=0.78% cpu : usr=0.07%, sys=12.57%, ctx=1685, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159750: Tue Sep 1 13:13:40 2026 read: IOPS=19, BW=318KiB/s (325kB/s)(6256KiB/19685msec) clat (msec): min=2, max=110, avg=17.32, stdev=16.27 lat (msec): min=2, max=110, avg=17.32, stdev=16.27 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 38], 95.00th=[ 51], | 99.00th=[ 82], 99.50th=[ 91], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 95, max= 1024, per=28.59%, avg=318.16, stdev=206.63, samples=38 iops : min= 5, max= 64, avg=19.29, stdev=13.11, samples=38 write: IOPS=19, BW=306KiB/s (314kB/s)(6032KiB/19685msec); 0 zone resets clat (msec): min=12, max=141, avg=34.12, stdev=18.97 lat (msec): min=12, max=141, avg=34.12, stdev=18.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 75], | 99.00th=[ 107], 99.50th=[ 126], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 95, max= 640, per=25.37%, avg=301.16, stdev=141.10, samples=38 iops : min= 5, max= 40, avg=18.24, stdev= 9.07, samples=38 lat (msec) : 4=2.73%, 10=18.62%, 20=25.00%, 50=43.75%, 100=9.24% lat (msec) : 250=0.65% cpu : usr=0.05%, sys=12.63%, ctx=1716, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=159751: Tue Sep 1 13:13:40 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(4320KiB/17413msec) clat (msec): min=3, max=105, avg=24.56, stdev=20.31 lat (msec): min=3, max=105, avg=24.56, stdev=20.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 95], 99.50th=[ 99], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 99, max= 672, per=22.59%, avg=251.38, stdev=110.94, samples=34 iops : min= 6, max= 42, avg=15.06, stdev= 6.99, samples=34 write: IOPS=17, BW=274KiB/s (280kB/s)(4768KiB/17413msec); 0 zone resets clat (msec): min=14, max=137, avg=35.99, stdev=18.18 lat (msec): min=14, max=137, avg=36.00, stdev=18.18 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 126, max= 605, per=22.71%, avg=269.59, stdev=126.12, samples=34 iops : min= 7, max= 37, avg=16.18, stdev= 8.12, samples=34 lat (msec) : 4=1.23%, 10=10.37%, 20=20.21%, 50=52.20%, 100=15.29% lat (msec) : 250=0.53% cpu : usr=0.06%, sys=12.59%, ctx=1277, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=271,298,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1114KiB/s (1140kB/s), 248KiB/s-318KiB/s (254kB/s-325kB/s), io=21.7MiB (22.8MB), run=17413-19973msec WRITE: bw=1187KiB/s (1216kB/s), 274KiB/s-328KiB/s (280kB/s-336kB/s), io=23.2MiB (24.3MB), run=17413-19973msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159765: Tue Sep 1 13:13:55 2026 read: IOPS=1, BW=1312KiB/s (1344kB/s)(7168KiB/5463msec) clat (msec): min=210, max=1460, avg=499.81, stdev=438.47 lat (msec): min=210, max=1460, avg=499.82, stdev=438.47 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 224], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 321], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 506], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1768, max= 4096, per=79.37%, avg=2375.60, stdev=967.95, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 write: IOPS=0, BW=937KiB/s (960kB/s)(5120KiB/5463msec); 0 zone resets clat (msec): min=258, max=489, avg=368.77, stdev=90.95 lat (msec): min=258, max=489, avg=368.83, stdev=90.94 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2031, max= 4079, per=64.89%, avg=2719.33, stdev=1177.54, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=47.14%, ctx=1586, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159766: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=299KiB/s (307kB/s)(2048KiB/6841msec) clat (msec): min=194, max=319, avg=257.01, stdev=88.41 lat (msec): min=194, max=319, avg=257.01, stdev=88.41 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1750, max= 2031, per=63.16%, avg=1890.50, stdev=198.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1497KiB/s (1533kB/s)(10.0MiB/6841msec); 0 zone resets clat (msec): min=254, max=2012, avg=621.34, stdev=511.99 lat (msec): min=254, max=2012, avg=621.40, stdev=512.00 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 292], | 30.00th=[ 334], 40.00th=[ 380], 50.00th=[ 506], 60.00th=[ 523], | 70.00th=[ 558], 80.00th=[ 625], 90.00th=[ 735], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 1943, max= 4096, per=62.31%, avg=2611.29, stdev=1014.84, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.46, samples=7 lat (msec) : 250=8.33%, 500=41.67%, 750=41.67%, >=2000=8.33% cpu : usr=0.03%, sys=37.40%, ctx=455, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159767: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=988KiB/s (1012kB/s)(6144KiB/6218msec) clat (usec): min=495, max=440989, avg=190306.20, stdev=212004.36 lat (usec): min=496, max=440990, avg=190307.09, stdev=212004.15 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 685], | 30.00th=[ 685], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[308282], | 70.00th=[387974], 80.00th=[387974], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 2039, max= 4087, per=85.34%, avg=2554.25, stdev=1021.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=988KiB/s (1012kB/s)(6144KiB/6218msec); 0 zone resets clat (msec): min=180, max=2655, avg=835.52, stdev=935.98 lat (msec): min=180, max=2655, avg=835.56, stdev=935.99 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 575], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1943, max= 4096, per=72.62%, avg=3043.50, stdev=1210.89, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=27.84%, ctx=520, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159768: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=776KiB/s (795kB/s)(5120KiB/6594msec) clat (usec): min=553, max=399172, avg=140508.58, stdev=194637.83 lat (usec): min=553, max=399172, avg=140509.17, stdev=194637.79 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 627], 40.00th=[ 627], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[299893], 80.00th=[299893], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2031, max= 5829, per=100.00%, avg=3930.00, stdev=2685.59, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1087KiB/s (1113kB/s)(7168KiB/6594msec); 0 zone resets clat (msec): min=358, max=2506, avg=827.26, stdev=756.79 lat (msec): min=358, max=2506, avg=827.34, stdev=756.79 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 430], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 514], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 844], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2031, max= 2048, per=48.72%, avg=2041.80, stdev= 7.12, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=25.00% lat (msec) : 500=33.33%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=28.21%, ctx=235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2994KiB/s (3066kB/s), 299KiB/s-1312KiB/s (307kB/s-1344kB/s), io=20.0MiB (20.0MB), run=5463-6841msec WRITE: bw=4191KiB/s (4292kB/s), 937KiB/s-1497KiB/s (960kB/s-1533kB/s), io=28.0MiB (29.4MB), run=5463-6841msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159761: Tue Sep 1 13:13:55 2026 read: IOPS=1, BW=1444KiB/s (1479kB/s)(7168KiB/4963msec) clat (msec): min=67, max=1088, avg=456.23, stdev=433.69 lat (msec): min=67, max=1088, avg=456.23, stdev=433.69 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 117], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 288], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 1045], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2043, max= 5233, per=96.37%, avg=2843.00, stdev=1593.34, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1032KiB/s (1056kB/s)(5120KiB/4963msec); 0 zone resets clat (msec): min=146, max=633, avg=351.62, stdev=182.57 lat (msec): min=146, max=633, avg=351.69, stdev=182.58 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1965, max= 3878, per=60.16%, avg=2484.75, stdev=929.66, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=11.14%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159762: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=295KiB/s (302kB/s)(2048KiB/6941msec) clat (msec): min=100, max=1602, avg=851.33, stdev=1062.25 lat (msec): min=100, max=1602, avg=851.33, stdev=1062.25 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1738, max= 2043, per=64.08%, avg=1890.50, stdev=215.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1475KiB/s (1511kB/s)(10.0MiB/6941msec); 0 zone resets clat (msec): min=46, max=1940, avg=514.27, stdev=580.02 lat (msec): min=46, max=1940, avg=514.34, stdev=580.01 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 128], | 30.00th=[ 132], 40.00th=[ 190], 50.00th=[ 249], 60.00th=[ 397], | 70.00th=[ 409], 80.00th=[ 625], 90.00th=[ 1028], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1965, max= 4087, per=67.80%, avg=2800.00, stdev=1082.39, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=25.00% cpu : usr=0.00%, sys=13.62%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159763: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=922KiB/s (944kB/s)(6144KiB/6667msec) clat (msec): min=158, max=664, avg=425.54, stdev=242.58 lat (msec): min=158, max=664, avg=425.55, stdev=242.58 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 600], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1939, max= 2048, per=68.28%, avg=2014.40, stdev=44.13, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=922KiB/s (944kB/s)(6144KiB/6667msec); 0 zone resets clat (msec): min=122, max=2158, avg=680.27, stdev=756.56 lat (msec): min=122, max=2158, avg=680.38, stdev=756.52 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 542], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1939, max= 4055, per=69.80%, avg=2882.75, stdev=1055.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=33.33%, 500=16.67%, 750=41.67%, >=2000=8.33% cpu : usr=0.02%, sys=11.18%, ctx=208, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159764: Tue Sep 1 13:13:55 2026 read: IOPS=0, BW=833KiB/s (853kB/s)(5120KiB/6147msec) clat (msec): min=218, max=813, avg=406.61, stdev=255.96 lat (msec): min=218, max=813, avg=406.62, stdev=255.96 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1965, max= 2048, per=68.40%, avg=2017.75, stdev=38.05, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1166KiB/s (1194kB/s)(7168KiB/6147msec); 0 zone resets clat (msec): min=156, max=1955, avg=585.13, stdev=623.62 lat (msec): min=156, max=1955, avg=585.23, stdev=623.60 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 257], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 330], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 642], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1809, max= 4087, per=66.98%, avg=2766.40, stdev=1116.26, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=13.28%, ctx=416, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2951KiB/s (3021kB/s), 295KiB/s-1444KiB/s (302kB/s-1479kB/s), io=20.0MiB (20.0MB), run=4963-6941msec WRITE: bw=4131KiB/s (4230kB/s), 922KiB/s-1475KiB/s (944kB/s-1511kB/s), io=28.0MiB (29.4MB), run=4963-6941msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159779: Tue Sep 1 13:14:05 2026 read: IOPS=1, BW=4362KiB/s (4467kB/s)(12.0MiB/2817msec) clat (msec): min=862, max=1018, avg=932.66, stdev=79.13 lat (msec): min=862, max=1018, avg=932.66, stdev=79.13 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7641, max= 8175, per=100.00%, avg=7908.00, stdev=377.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=55.86%, ctx=2683, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159780: Tue Sep 1 13:14:05 2026 read: IOPS=0, BW=1364KiB/s (1396kB/s)(4096KiB/3004msec) clat (nsec): min=726539k, max=726539k, avg=726539149.00, stdev= 0.00 lat (nsec): min=726541k, max=726541k, avg=726540537.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2727KiB/s (2792kB/s)(8192KiB/3004msec); 0 zone resets clat (msec): min=526, max=1717, avg=1121.53, stdev=842.14 lat (msec): min=526, max=1717, avg=1121.80, stdev=842.12 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8192, max= 8192, per=89.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=20.48%, ctx=758, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159781: Tue Sep 1 13:14:05 2026 write: IOPS=0, BW=3439KiB/s (3522kB/s)(12.0MiB/3573msec); 0 zone resets clat (msec): min=335, max=2071, avg=1180.01, stdev=868.95 lat (msec): min=335, max=2071, avg=1180.36, stdev=868.80 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 7641, max= 8192, per=86.32%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=12.57%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159782: Tue Sep 1 13:14:05 2026 write: IOPS=0, BW=3937KiB/s (4032kB/s)(12.0MiB/3121msec); 0 zone resets clat (msec): min=421, max=1527, avg=1008.93, stdev=555.98 lat (msec): min=422, max=1527, avg=1009.15, stdev=555.90 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 5720, max= 8192, per=75.85%, avg=6956.00, stdev=1747.97, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=18.24%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5454KiB/s (5585kB/s), 1364KiB/s-4362KiB/s (1396kB/s-4467kB/s), io=16.0MiB (16.8MB), run=2817-3004msec WRITE: bw=9171KiB/s (9391kB/s), 2727KiB/s-3937KiB/s (2792kB/s-4032kB/s), io=32.0MiB (33.6MB), run=3004-3573msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159774: Tue Sep 1 13:14:05 2026 read: IOPS=0, BW=3851KiB/s (3943kB/s)(12.0MiB/3191msec) clat (msec): min=489, max=1326, avg=1029.93, stdev=468.64 lat (msec): min=489, max=1326, avg=1029.94, stdev=468.64 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=18.28%, ctx=150, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159775: Tue Sep 1 13:14:05 2026 read: IOPS=0, BW=1091KiB/s (1117kB/s)(4096KiB/3755msec) clat (nsec): min=1588.7M, max=1588.7M, avg=1588741466.00, stdev= 0.00 lat (nsec): min=1588.7M, max=1588.7M, avg=1588742808.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1586], 5.00th=[ 1586], 10.00th=[ 1586], 20.00th=[ 1586], | 30.00th=[ 1586], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2182KiB/s (2234kB/s)(8192KiB/3755msec); 0 zone resets clat (msec): min=1006, max=1056, avg=1031.54, stdev=34.97 lat (msec): min=1007, max=1056, avg=1031.78, stdev=34.74 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8192, max= 8192, per=96.06%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=15.56%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159776: Tue Sep 1 13:14:05 2026 write: IOPS=0, BW=3198KiB/s (3275kB/s)(12.0MiB/3842msec); 0 zone resets clat (msec): min=335, max=2639, avg=1247.11, stdev=1224.70 lat (msec): min=336, max=2639, avg=1247.40, stdev=1224.55 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8192, max= 8192, per=96.06%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=12.03%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159777: Tue Sep 1 13:14:05 2026 write: IOPS=1, BW=4642KiB/s (4754kB/s)(12.0MiB/2647msec); 0 zone resets clat (msec): min=225, max=1899, avg=849.65, stdev=914.70 lat (msec): min=225, max=1899, avg=849.90, stdev=914.75 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7953, max= 8192, per=94.66%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.07%, ctx=138, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4363KiB/s (4468kB/s), 1091KiB/s-3851KiB/s (1117kB/s-3943kB/s), io=16.0MiB (16.8MB), run=3191-3755msec WRITE: bw=8529KiB/s (8734kB/s), 2182KiB/s-4642KiB/s (2234kB/s-4754kB/s), io=32.0MiB (33.6MB), run=2647-3842msec