== sanity test 398b: DIO and buffer IO race ============== 00:31:56 (1783139516) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.54492 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144643: Sat Jul 4 00:35:19 2026 read: IOPS=8, BW=32.0KiB/s (33.8kB/s)(5992KiB/181742msec) clat (usec): min=30, max=574963, avg=42465.03, stdev=36515.43 lat (usec): min=30, max=574965, avg=42472.92, stdev=36514.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 840], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[179307], 99.90th=[549454], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 103, per=35.71%, avg=46.42, stdev=19.32, samples=252 iops : min= 1, max= 25, avg=10.94, stdev= 4.84, samples=252 write: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6296KiB/181742msec); 0 zone resets clat (usec): min=1168, max=54159k, avg=74843.06, stdev=1364688.95 lat (usec): min=1170, max=54159k, avg=74846.02, stdev=1364688.90 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1631], 10.00th=[ 2802], | 20.00th=[ 5342], 30.00th=[ 9896], 40.00th=[ 20055], | 50.00th=[ 31589], 60.00th=[ 41157], 70.00th=[ 52691], | 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[ 114820], | 99.00th=[ 177210], 99.50th=[ 191890], 99.90th=[ 371196], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 143, per=36.15%, avg=49.16, stdev=20.06, samples=250 iops : min= 1, max= 35, avg=11.62, stdev= 5.05, samples=250 lat (usec) : 50=0.16%, 100=3.48%, 250=1.01%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=3.68%, 4=4.17%, 10=8.07%, 20=9.15%, 50=38.25% lat (msec) : 100=25.55%, 250=6.02%, 500=0.10%, 750=0.07%, >=2000=0.03% cpu : usr=0.06%, sys=4.39%, ctx=7035, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144644: Sat Jul 4 00:35:19 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(5940KiB/183823msec) clat (usec): min=32, max=810424, avg=42990.36, stdev=39223.33 lat (usec): min=33, max=810427, avg=43003.95, stdev=39223.37 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 10552], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[177210], 99.90th=[505414], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 103, per=35.12%, avg=45.65, stdev=18.72, samples=253 iops : min= 1, max= 25, avg=10.74, stdev= 4.70, samples=253 write: IOPS=8, BW=34.5KiB/s (35.4kB/s)(6348KiB/183823msec); 0 zone resets clat (usec): min=1205, max=54133k, avg=75309.61, stdev=1358498.88 lat (usec): min=1206, max=54133k, avg=75314.43, stdev=1358498.75 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1696], 10.00th=[ 2835], | 20.00th=[ 5538], 30.00th=[ 9896], 40.00th=[ 19268], | 50.00th=[ 30802], 60.00th=[ 41157], 70.00th=[ 53740], | 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[ 121111], | 99.00th=[ 189793], 99.50th=[ 246416], 99.90th=[ 471860], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 143, per=35.42%, avg=48.17, stdev=21.41, samples=256 iops : min= 1, max= 35, avg=11.36, stdev= 5.39, samples=256 lat (usec) : 50=0.29%, 100=3.45%, 250=0.49%, 500=0.03%, 750=0.16% lat (msec) : 2=3.65%, 4=3.84%, 10=8.40%, 20=9.57%, 50=37.70% lat (msec) : 100=26.07%, 250=5.96%, 500=0.29%, 750=0.03%, 1000=0.03% lat (msec) : >=2000=0.03% cpu : usr=0.06%, sys=4.29%, ctx=7139, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144645: Sat Jul 4 00:35:19 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6028KiB/183540msec) clat (usec): min=37, max=315834, avg=41465.77, stdev=31399.62 lat (usec): min=37, max=315836, avg=41470.42, stdev=31401.07 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 206], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[198181], 99.90th=[274727], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 135, per=35.56%, avg=46.22, stdev=19.62, samples=255 iops : min= 1, max= 33, avg=10.87, stdev= 4.92, samples=255 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6260KiB/183540msec); 0 zone resets clat (usec): min=1098, max=54258k, avg=77133.35, stdev=1371251.51 lat (usec): min=1099, max=54258k, avg=77135.76, stdev=1371251.46 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1713], 10.00th=[ 2835], | 20.00th=[ 5800], 30.00th=[ 11338], 40.00th=[ 22676], | 50.00th=[ 33162], 60.00th=[ 43779], 70.00th=[ 55313], | 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[ 116917], | 99.00th=[ 170918], 99.50th=[ 231736], 99.90th=[ 1019216], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 151, per=35.43%, avg=48.19, stdev=19.47, samples=254 iops : min= 1, max= 37, avg=11.37, stdev= 4.90, samples=254 lat (usec) : 50=0.29%, 100=3.78%, 250=0.94%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=3.32%, 4=3.91%, 10=7.58%, 20=8.53%, 50=38.54% lat (msec) : 100=26.86%, 250=5.73%, 500=0.20%, 2000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=4.31%, ctx=7200, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144646: Sat Jul 4 00:35:19 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6052KiB/182879msec) clat (usec): min=32, max=851195, avg=42054.67, stdev=38330.06 lat (usec): min=32, max=851196, avg=42060.07, stdev=38332.59 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 281], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[198181], 99.90th=[367002], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 95, per=36.07%, avg=46.90, stdev=19.20, samples=251 iops : min= 1, max= 23, avg=11.05, stdev= 4.83, samples=251 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6236KiB/182879msec); 0 zone resets clat (usec): min=1108, max=54227k, avg=76283.47, stdev=1372968.55 lat (usec): min=1109, max=54227k, avg=76286.00, stdev=1372968.52 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1696], 10.00th=[ 2802], | 20.00th=[ 5735], 30.00th=[ 10159], 40.00th=[ 20055], | 50.00th=[ 31851], 60.00th=[ 41681], 70.00th=[ 53216], | 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[ 120062], | 99.00th=[ 179307], 99.50th=[ 206570], 99.90th=[ 396362], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 110, per=35.67%, avg=48.51, stdev=19.44, samples=250 iops : min= 1, max= 27, avg=11.45, stdev= 4.88, samples=250 lat (usec) : 50=0.42%, 100=3.81%, 250=0.68%, 500=0.39%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.06%, 4=4.46%, 10=8.01%, 20=9.34%, 50=37.83% lat (msec) : 100=25.03%, 250=6.51%, 500=0.26%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=4.44%, ctx=7098, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=131KiB/s (134kB/s), 32.3KiB/s-33.1KiB/s (33.1kB/s-33.9kB/s), io=23.4MiB (24.6MB), run=181742-183823msec WRITE: bw=137KiB/s (140kB/s), 34.1KiB/s-34.6KiB/s (34.9kB/s-35.5kB/s), io=24.6MiB (25.7MB), run=181742-183823msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144638: Sat Jul 4 00:37:32 2026 read: IOPS=4, BW=19.0KiB/s (19.5kB/s)(5992KiB/314970msec) clat (msec): min=5, max=598, avg=34.04, stdev=36.47 lat (msec): min=5, max=598, avg=34.05, stdev=36.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 102], | 99.00th=[ 176], 99.50th=[ 224], 99.90th=[ 296], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 88, per=34.43%, avg=25.82, stdev=17.17, samples=450 iops : min= 1, max= 22, avg= 5.86, stdev= 4.35, samples=450 write: IOPS=4, BW=19.0KiB/s (20.5kB/s)(6296KiB/314970msec); 0 zone resets clat (msec): min=34, max=54370, avg=167.45, stdev=1368.61 lat (msec): min=34, max=54370, avg=167.46, stdev=1368.61 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 213], 95.00th=[ 262], | 99.00th=[ 347], 99.50th=[ 397], 99.90th=[ 617], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 56, per=29.94%, avg=23.66, stdev=10.67, samples=514 iops : min= 1, max= 14, avg= 5.31, stdev= 2.77, samples=514 lat (msec) : 10=2.57%, 20=19.40%, 50=18.55%, 100=23.80%, 250=32.42% lat (msec) : 500=3.12%, 750=0.10%, >=2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5366, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144639: Sat Jul 4 00:37:32 2026 read: IOPS=4, BW=18.8KiB/s (19.2kB/s)(5940KiB/316426msec) clat (msec): min=5, max=864, avg=34.28, stdev=43.00 lat (msec): min=5, max=864, avg=34.28, stdev=43.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 176], 99.50th=[ 220], 99.90th=[ 659], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 96, per=34.27%, avg=25.70, stdev=17.01, samples=448 iops : min= 1, max= 24, avg= 5.83, stdev= 4.32, samples=448 write: IOPS=5, BW=20.1KiB/s (20.5kB/s)(6348KiB/316426msec); 0 zone resets clat (msec): min=29, max=54378, avg=167.05, stdev=1363.04 lat (msec): min=29, max=54378, avg=167.05, stdev=1363.04 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 693], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 64, per=30.14%, avg=23.81, stdev=10.69, samples=515 iops : min= 1, max= 16, avg= 5.35, stdev= 2.77, samples=515 lat (msec) : 10=2.57%, 20=20.18%, 50=17.42%, 100=23.31%, 250=33.85% lat (msec) : 500=2.51%, 750=0.10%, 1000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144640: Sat Jul 4 00:37:32 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6028KiB/312538msec) clat (msec): min=5, max=466, avg=34.51, stdev=33.16 lat (msec): min=5, max=466, avg=34.52, stdev=33.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 79], 95.00th=[ 102], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 296], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 95, per=33.52%, avg=25.14, stdev=17.24, samples=464 iops : min= 1, max= 23, avg= 5.69, stdev= 4.36, samples=464 write: IOPS=5, BW=20.0KiB/s (20.5kB/s)(6260KiB/312538msec); 0 zone resets clat (msec): min=31, max=54294, avg=166.20, stdev=1370.85 lat (msec): min=31, max=54294, avg=166.21, stdev=1370.85 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 355], 99.50th=[ 477], 99.90th=[ 995], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=30.23%, avg=23.88, stdev=11.34, samples=506 iops : min= 1, max= 13, avg= 5.37, stdev= 2.93, samples=506 lat (msec) : 10=2.96%, 20=18.39%, 50=18.36%, 100=26.66%, 250=30.96% lat (msec) : 500=2.47%, 750=0.13%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5371, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144641: Sat Jul 4 00:37:32 2026 read: IOPS=4, BW=19.2KiB/s (19.7kB/s)(6052KiB/314941msec) clat (msec): min=5, max=660, avg=34.71, stdev=39.70 lat (msec): min=5, max=660, avg=34.71, stdev=39.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 180], 99.50th=[ 211], 99.90th=[ 634], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 104, per=34.60%, avg=25.95, stdev=18.23, samples=452 iops : min= 1, max= 26, avg= 5.88, stdev= 4.65, samples=452 write: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6236KiB/314941msec); 0 zone resets clat (msec): min=30, max=54371, avg=168.06, stdev=1375.26 lat (msec): min=30, max=54371, avg=168.07, stdev=1375.26 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 338], 99.50th=[ 393], 99.90th=[ 978], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 48, per=30.01%, avg=23.71, stdev=10.60, samples=508 iops : min= 1, max= 12, avg= 5.33, stdev= 2.74, samples=508 lat (msec) : 10=2.77%, 20=19.21%, 50=18.55%, 100=24.19%, 250=32.26% lat (msec) : 500=2.86%, 750=0.10%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5413, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=75.9KiB/s (77.7kB/s), 18.8KiB/s-19.3KiB/s (19.2kB/s-19.8kB/s), io=23.4MiB (24.6MB), run=312538-316426msec WRITE: bw=79.4KiB/s (81.4kB/s), 19.8KiB/s-20.1KiB/s (20.3kB/s-20.5kB/s), io=24.6MiB (25.7MB), run=312538-316426msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144711: Sat Jul 4 00:38:18 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5920KiB/33453msec) clat (usec): min=36, max=212949, avg=46562.78, stdev=36127.46 lat (usec): min=36, max=212950, avg=46564.49, stdev=36127.48 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 16909], | 30.00th=[ 28967], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[170918], 99.50th=[196084], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 30, max= 415, per=25.82%, avg=174.77, stdev=72.44, samples=65 iops : min= 1, max= 25, avg=10.20, stdev= 4.53, samples=65 write: IOPS=11, BW=190KiB/s (195kB/s)(6368KiB/33453msec); 0 zone resets clat (usec): min=1552, max=387190, avg=39818.78, stdev=45974.93 lat (usec): min=1554, max=387193, avg=39821.37, stdev=45974.83 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2040], 10.00th=[ 2999], 20.00th=[ 6587], | 30.00th=[ 9896], 40.00th=[ 14746], 50.00th=[ 21103], 60.00th=[ 33424], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[127402], | 99.00th=[227541], 99.50th=[274727], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 362, per=27.01%, avg=192.30, stdev=76.47, samples=64 iops : min= 1, max= 22, avg=11.30, stdev= 4.87, samples=64 lat (usec) : 50=0.91%, 100=6.90%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=4.04%, 10=9.38%, 20=10.81%, 50=28.52% lat (msec) : 100=27.34%, 250=7.94%, 500=0.39% cpu : usr=0.07%, sys=5.63%, ctx=1484, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Sat Jul 4 00:38:18 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5744KiB/35354msec) clat (usec): min=38, max=412134, avg=46728.97, stdev=42734.13 lat (usec): min=38, max=412135, avg=46732.20, stdev=42736.17 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 396], | 30.00th=[ 27919], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 51643], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[164627], 99.50th=[295699], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 30, max= 448, per=25.20%, avg=170.63, stdev=90.12, samples=65 iops : min= 1, max= 28, avg= 9.92, stdev= 5.70, samples=65 write: IOPS=11, BW=185KiB/s (190kB/s)(6544KiB/35354msec); 0 zone resets clat (usec): min=1585, max=462306, avg=44545.72, stdev=65436.75 lat (usec): min=1588, max=462307, avg=44548.38, stdev=65436.53 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2040], 10.00th=[ 3228], 20.00th=[ 5735], | 30.00th=[ 9241], 40.00th=[ 13960], 50.00th=[ 21365], 60.00th=[ 33162], | 70.00th=[ 47449], 80.00th=[ 69731], 90.00th=[100140], 95.00th=[130548], | 99.00th=[346031], 99.50th=[442500], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 30, max= 476, per=25.69%, avg=182.93, stdev=102.21, samples=69 iops : min= 1, max= 29, avg=10.71, stdev= 6.44, samples=69 lat (usec) : 50=1.17%, 100=6.64%, 250=1.17%, 500=0.39%, 750=0.26% lat (msec) : 2=2.60%, 4=4.56%, 10=10.16%, 20=9.77%, 50=28.13% lat (msec) : 100=26.30%, 250=6.90%, 500=1.95% cpu : usr=0.08%, sys=5.41%, ctx=1470, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144713: Sat Jul 4 00:38:18 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34385msec) clat (usec): min=38, max=361805, avg=45799.55, stdev=37280.59 lat (usec): min=38, max=361806, avg=45802.57, stdev=37280.24 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 15008], | 30.00th=[ 27919], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[156238], 99.50th=[196084], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 31, max= 333, per=27.13%, avg=183.68, stdev=65.14, samples=66 iops : min= 1, max= 20, avg=10.77, stdev= 4.12, samples=66 write: IOPS=10, BW=175KiB/s (180kB/s)(6032KiB/34385msec); 0 zone resets clat (usec): min=1518, max=434570, avg=42607.52, stdev=49895.64 lat (usec): min=1520, max=434573, avg=42610.14, stdev=49895.64 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1991], 10.00th=[ 3949], 20.00th=[ 7308], | 30.00th=[ 10552], 40.00th=[ 14222], 50.00th=[ 24511], 60.00th=[ 38011], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[101188], 95.00th=[139461], | 99.00th=[231736], 99.50th=[329253], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 31, max= 384, per=24.16%, avg=172.04, stdev=73.95, samples=67 iops : min= 1, max= 24, avg=10.04, stdev= 4.73, samples=67 lat (usec) : 50=0.78%, 100=7.42%, 250=1.17%, 500=0.39% lat (msec) : 2=2.73%, 4=2.47%, 10=8.33%, 20=10.55%, 50=29.82% lat (msec) : 100=27.60%, 250=8.20%, 500=0.52% cpu : usr=0.10%, sys=5.67%, ctx=1517, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144714: Sat Jul 4 00:38:18 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32913msec) clat (usec): min=33, max=409452, avg=44589.02, stdev=40044.70 lat (usec): min=33, max=409453, avg=44590.51, stdev=40044.65 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 130], | 30.00th=[ 25560], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[168821], 99.50th=[181404], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 61, max= 476, per=27.71%, avg=187.56, stdev=81.28, samples=62 iops : min= 3, max= 29, avg=11.00, stdev= 5.14, samples=62 write: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32913msec); 0 zone resets clat (usec): min=1294, max=377546, avg=40766.62, stdev=50444.43 lat (usec): min=1296, max=377548, avg=40801.20, stdev=50434.54 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1958], 10.00th=[ 3228], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 14091], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 48497], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[267387], 99.50th=[346031], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 30, max= 478, per=26.39%, avg=187.87, stdev=91.30, samples=64 iops : min= 1, max= 29, avg=11.02, stdev= 5.76, samples=64 lat (usec) : 50=1.56%, 100=7.81%, 250=0.91%, 500=0.39%, 750=0.26% lat (msec) : 2=3.52%, 4=3.65%, 10=10.94%, 20=8.07%, 50=29.04% lat (msec) : 100=26.17%, 250=6.90%, 500=0.78% cpu : usr=0.09%, sys=5.29%, ctx=1367, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=677KiB/s (694kB/s), 162KiB/s-183KiB/s (166kB/s-188kB/s), io=23.4MiB (24.5MB), run=32913-35354msec WRITE: bw=713KiB/s (730kB/s), 175KiB/s-190KiB/s (180kB/s-195kB/s), io=24.6MiB (25.8MB), run=32913-35354msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Sat Jul 4 00:39:02 2026 read: IOPS=4, BW=75.1KiB/s (76.9kB/s)(5920KiB/78817msec) clat (msec): min=8, max=293, avg=46.35, stdev=42.64 lat (msec): min=8, max=293, avg=46.35, stdev=42.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 228], 99.50th=[ 249], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 415, per=28.79%, avg=86.95, stdev=58.00, samples=132 iops : min= 1, max= 25, avg= 4.71, stdev= 3.62, samples=132 write: IOPS=5, BW=80.8KiB/s (82.7kB/s)(6368KiB/78817msec); 0 zone resets clat (msec): min=57, max=541, avg=154.22, stdev=88.50 lat (msec): min=57, max=541, avg=154.23, stdev=88.49 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 126], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 199], 90.00th=[ 268], 95.00th=[ 368], | 99.00th=[ 493], 99.50th=[ 531], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 24, max= 160, per=25.67%, avg=81.64, stdev=39.12, samples=152 iops : min= 1, max= 10, avg= 4.36, stdev= 2.54, samples=152 lat (msec) : 10=0.39%, 20=9.24%, 50=26.82%, 100=20.96%, 250=36.46% lat (msec) : 500=5.73%, 750=0.39% cpu : usr=0.04%, sys=1.48%, ctx=1518, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144708: Sat Jul 4 00:39:02 2026 read: IOPS=4, BW=72.6KiB/s (74.4kB/s)(5744KiB/79073msec) clat (msec): min=8, max=347, avg=44.37, stdev=42.77 lat (msec): min=8, max=347, avg=44.37, stdev=42.77 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 129], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 24, max= 347, per=29.22%, avg=88.25, stdev=58.18, samples=127 iops : min= 1, max= 21, avg= 4.77, stdev= 3.73, samples=127 write: IOPS=5, BW=82.8KiB/s (84.7kB/s)(6544KiB/79073msec); 0 zone resets clat (msec): min=37, max=572, avg=153.93, stdev=89.27 lat (msec): min=37, max=574, avg=153.95, stdev=89.29 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 279], 95.00th=[ 347], | 99.00th=[ 489], 99.50th=[ 558], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 30, max= 191, per=26.50%, avg=84.28, stdev=40.89, samples=152 iops : min= 1, max= 11, avg= 4.53, stdev= 2.58, samples=152 lat (msec) : 10=0.39%, 20=10.55%, 50=25.00%, 100=19.79%, 250=36.72% lat (msec) : 500=7.16%, 750=0.39% cpu : usr=0.04%, sys=1.47%, ctx=1500, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144709: Sat Jul 4 00:39:02 2026 read: IOPS=5, BW=80.3KiB/s (82.3kB/s)(6256KiB/77861msec) clat (msec): min=8, max=441, avg=45.41, stdev=47.27 lat (msec): min=8, max=441, avg=45.41, stdev=47.27 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 100], 95.00th=[ 138], | 99.00th=[ 262], 99.50th=[ 342], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 349, per=30.57%, avg=92.31, stdev=66.37, samples=134 iops : min= 1, max= 21, avg= 5.02, stdev= 4.22, samples=134 write: IOPS=4, BW=77.5KiB/s (79.3kB/s)(6032KiB/77861msec); 0 zone resets clat (msec): min=47, max=535, avg=158.87, stdev=84.75 lat (msec): min=47, max=535, avg=158.88, stdev=84.75 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 100], | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 136], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 199], 90.00th=[ 275], 95.00th=[ 342], | 99.00th=[ 477], 99.50th=[ 527], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 30, max= 159, per=24.86%, avg=79.04, stdev=36.58, samples=150 iops : min= 1, max= 9, avg= 4.20, stdev= 2.33, samples=150 lat (msec) : 10=0.39%, 20=12.11%, 50=25.91%, 100=17.58%, 250=37.24% lat (msec) : 500=6.38%, 750=0.39% cpu : usr=0.03%, sys=1.49%, ctx=1496, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144710: Sat Jul 4 00:39:02 2026 read: IOPS=4, BW=77.6KiB/s (79.4kB/s)(6032KiB/77749msec) clat (msec): min=7, max=396, avg=46.48, stdev=46.46 lat (msec): min=7, max=396, avg=46.48, stdev=46.46 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 94], 95.00th=[ 153], | 99.00th=[ 236], 99.50th=[ 262], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 288, per=29.64%, avg=89.50, stdev=56.30, samples=131 iops : min= 1, max= 18, avg= 4.86, stdev= 3.60, samples=131 write: IOPS=5, BW=80.5KiB/s (82.4kB/s)(6256KiB/77749msec); 0 zone resets clat (msec): min=47, max=534, avg=153.85, stdev=83.20 lat (msec): min=47, max=534, avg=153.85, stdev=83.20 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 71], 10.00th=[ 84], 20.00th=[ 96], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 275], 95.00th=[ 338], | 99.00th=[ 447], 99.50th=[ 518], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 30, max= 159, per=25.65%, avg=81.58, stdev=36.69, samples=150 iops : min= 1, max= 9, avg= 4.36, stdev= 2.36, samples=150 lat (msec) : 10=0.26%, 20=9.51%, 50=27.99%, 100=18.75%, 250=37.24% lat (msec) : 500=5.86%, 750=0.39% cpu : usr=0.05%, sys=1.48%, ctx=1427, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=303KiB/s (310kB/s), 72.6KiB/s-80.3KiB/s (74.4kB/s-82.3kB/s), io=23.4MiB (24.5MB), run=77749-79073msec WRITE: bw=319KiB/s (326kB/s), 77.5KiB/s-82.8KiB/s (79.3kB/s-84.7kB/s), io=24.6MiB (25.8MB), run=77749-79073msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144737: Sat Jul 4 00:39:18 2026 read: IOPS=1, BW=1225KiB/s (1254kB/s)(7168KiB/5853msec) clat (usec): min=566, max=2874.1k, avg=511344.82, stdev=1045599.86 lat (usec): min=568, max=2874.1k, avg=511346.30, stdev=1045600.35 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], | 20.00th=[ 898], 30.00th=[ 117965], 40.00th=[ 117965], | 50.00th=[ 179307], 60.00th=[ 181404], 70.00th=[ 181404], | 80.00th=[ 225444], 90.00th=[2868904], 95.00th=[2868904], | 99.00th=[2868904], 99.50th=[2868904], 99.90th=[2868904], | 99.95th=[2868904], 99.99th=[2868904] bw ( KiB/s): min= 1969, max= 4096, per=92.74%, avg=3007.50, stdev=1172.07, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=875KiB/s (896kB/s)(5120KiB/5853msec); 0 zone resets clat (msec): min=156, max=806, avg=425.77, stdev=267.63 lat (msec): min=156, max=806, avg=425.87, stdev=267.69 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1973, max= 3938, per=58.36%, avg=2650.00, stdev=1115.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.81%, ctx=460, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144738: Sat Jul 4 00:39:18 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6314msec) clat (msec): min=234, max=271, avg=253.03, stdev=26.78 lat (msec): min=234, max=271, avg=253.04, stdev=26.77 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1418, max= 2023, per=53.05%, avg=1720.50, stdev=427.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1622KiB/s (1661kB/s)(10.0MiB/6314msec); 0 zone resets clat (msec): min=127, max=3178, avg=572.70, stdev=933.24 lat (msec): min=127, max=3178, avg=572.95, stdev=933.19 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 132], | 30.00th=[ 146], 40.00th=[ 161], 50.00th=[ 234], 60.00th=[ 255], | 70.00th=[ 279], 80.00th=[ 584], 90.00th=[ 625], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1957, max= 6119, per=67.04%, avg=3044.17, stdev=1721.77, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.97%, ctx=164, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144740: Sat Jul 4 00:39:18 2026 read: IOPS=1, BW=1176KiB/s (1205kB/s)(6144KiB/5223msec) clat (usec): min=646, max=214706, avg=112135.94, stdev=94753.00 lat (usec): min=647, max=214707, avg=112137.07, stdev=94753.05 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 26084], | 30.00th=[ 26084], 40.00th=[ 56361], 50.00th=[ 56361], 60.00th=[181404], | 70.00th=[193987], 80.00th=[193987], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2011, max= 4096, per=100.00%, avg=3395.33, stdev=1198.90, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1176KiB/s (1205kB/s)(6144KiB/5223msec); 0 zone resets clat (msec): min=126, max=3262, avg=735.55, stdev=1240.61 lat (msec): min=126, max=3263, avg=735.82, stdev=1240.54 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 2039, max= 4023, per=53.72%, avg=2439.40, stdev=885.27, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.75%, ctx=173, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144743: Sat Jul 4 00:39:18 2026 read: IOPS=0, BW=890KiB/s (911kB/s)(5120KiB/5752msec) clat (usec): min=893, max=222595, avg=73651.43, stdev=102944.57 lat (usec): min=895, max=222596, avg=73652.57, stdev=102944.38 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 898], | 30.00th=[ 1663], 40.00th=[ 1663], 50.00th=[ 1844], 60.00th=[ 1844], | 70.00th=[141558], 80.00th=[141558], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1246KiB/s (1276kB/s)(7168KiB/5752msec); 0 zone resets clat (msec): min=197, max=3228, avg=764.52, stdev=1098.44 lat (msec): min=197, max=3228, avg=764.91, stdev=1098.43 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 203], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 372], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 676], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1973, max= 4096, per=66.27%, avg=3009.50, stdev=1165.39, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.27%, ctx=194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3244KiB/s (3321kB/s), 324KiB/s-1225KiB/s (332kB/s-1254kB/s), io=20.0MiB (20.0MB), run=5223-6314msec WRITE: bw=4541KiB/s (4650kB/s), 875KiB/s-1622KiB/s (896kB/s-1661kB/s), io=28.0MiB (29.4MB), run=5223-6314msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144739: Sat Jul 4 00:39:19 2026 read: IOPS=0, BW=991KiB/s (1015kB/s)(7168KiB/7230msec) clat (msec): min=81, max=2530, avg=749.50, stdev=963.21 lat (msec): min=81, max=2530, avg=749.50, stdev=963.21 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 120], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 1569], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2023, max= 5930, per=100.00%, avg=3330.67, stdev=2251.10, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=708KiB/s (725kB/s)(5120KiB/7230msec); 0 zone resets clat (msec): min=158, max=560, avg=299.81, stdev=153.56 lat (msec): min=158, max=560, avg=300.16, stdev=153.56 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1976, max= 2043, per=53.09%, avg=2020.67, stdev=38.68, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.29%, ctx=95, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144741: Sat Jul 4 00:39:19 2026 read: IOPS=0, BW=272KiB/s (278kB/s)(2048KiB/7532msec) clat (msec): min=129, max=229, avg=179.31, stdev=71.08 lat (msec): min=129, max=229, avg=179.31, stdev=71.09 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1544, max= 2043, per=65.96%, avg=1793.50, stdev=352.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1360KiB/s (1392kB/s)(10.0MiB/7532msec); 0 zone resets clat (msec): min=83, max=3895, avg=695.07, stdev=1143.67 lat (msec): min=83, max=3895, avg=695.19, stdev=1143.66 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 134], | 30.00th=[ 192], 40.00th=[ 224], 50.00th=[ 296], 60.00th=[ 309], | 70.00th=[ 518], 80.00th=[ 550], 90.00th=[ 751], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1976, max= 4079, per=62.21%, avg=2367.83, stdev=838.68, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.78%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144742: Sat Jul 4 00:39:19 2026 read: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7107msec) clat (msec): min=107, max=787, avg=289.90, stdev=257.18 lat (msec): min=107, max=787, avg=289.91, stdev=257.18 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 279], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 4055, max= 4087, per=100.00%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7107msec); 0 zone resets clat (msec): min=128, max=3623, avg=812.18, stdev=1380.71 lat (msec): min=128, max=3623, avg=812.27, stdev=1380.71 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 271], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1976, max= 4096, per=66.70%, avg=2538.50, stdev=1038.79, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.48%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144744: Sat Jul 4 00:39:19 2026 read: IOPS=0, BW=688KiB/s (704kB/s)(5120KiB/7442msec) clat (msec): min=75, max=488, avg=221.99, stdev=178.41 lat (msec): min=75, max=488, avg=221.99, stdev=178.41 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1976, max= 4087, per=99.37%, avg=2702.00, stdev=1199.91, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=963KiB/s (986kB/s)(7168KiB/7442msec); 0 zone resets clat (msec): min=253, max=3669, avg=881.53, stdev=1239.65 lat (msec): min=253, max=3669, avg=881.84, stdev=1239.63 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 257], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 439], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 676], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1976, max= 4079, per=63.95%, avg=2433.80, stdev=920.12, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=3.33%, ctx=89, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2719KiB/s (2784kB/s), 272KiB/s-991KiB/s (278kB/s-1015kB/s), io=20.0MiB (20.0MB), run=7107-7532msec WRITE: bw=3807KiB/s (3898kB/s), 708KiB/s-1360KiB/s (725kB/s-1392kB/s), io=28.0MiB (29.4MB), run=7107-7532msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144755: Sat Jul 4 00:39:32 2026 read: IOPS=1, BW=5024KiB/s (5144kB/s)(12.0MiB/2446msec) clat (msec): min=742, max=913, avg=814.74, stdev=88.66 lat (msec): min=742, max=913, avg=814.74, stdev=88.66 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.74%, ctx=252, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144756: Sat Jul 4 00:39:32 2026 read: IOPS=0, BW=1444KiB/s (1479kB/s)(4096KiB/2836msec) clat (nsec): min=706488k, max=706488k, avg=706488054.00, stdev= 0.00 lat (nsec): min=706490k, max=706490k, avg=706489606.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2889KiB/s (2958kB/s)(8192KiB/2836msec); 0 zone resets clat (msec): min=935, max=1191, avg=1063.45, stdev=181.46 lat (msec): min=936, max=1192, avg=1064.34, stdev=180.78 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8078, max= 8078, per=89.52%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=5.54%, ctx=125, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144757: Sat Jul 4 00:39:32 2026 write: IOPS=0, BW=3384KiB/s (3465kB/s)(12.0MiB/3631msec); 0 zone resets clat (msec): min=1008, max=1519, avg=1209.51, stdev=272.53 lat (msec): min=1009, max=1520, avg=1209.92, stdev=272.45 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8126, max= 8159, per=90.23%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.62%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144758: Sat Jul 4 00:39:32 2026 write: IOPS=1, BW=4322KiB/s (4426kB/s)(12.0MiB/2843msec); 0 zone resets clat (msec): min=316, max=1838, avg=946.01, stdev=794.44 lat (msec): min=317, max=1840, avg=947.27, stdev=794.62 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8143, max= 8159, per=90.33%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.89%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5777KiB/s (5916kB/s), 1444KiB/s-5024KiB/s (1479kB/s-5144kB/s), io=16.0MiB (16.8MB), run=2446-2836msec WRITE: bw=9025KiB/s (9241kB/s), 2889KiB/s-4322KiB/s (2958kB/s-4426kB/s), io=32.0MiB (33.6MB), run=2836-3631msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144750: Sat Jul 4 00:39:33 2026 read: IOPS=1, BW=4207KiB/s (4308kB/s)(12.0MiB/2921msec) clat (msec): min=586, max=1338, avg=962.49, stdev=376.22 lat (msec): min=586, max=1338, avg=962.49, stdev=376.22 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 6481, max= 7515, per=100.00%, avg=6998.00, stdev=731.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.12%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144751: Sat Jul 4 00:39:33 2026 read: IOPS=0, BW=1037KiB/s (1062kB/s)(4096KiB/3948msec) clat (nsec): min=1259.6M, max=1259.6M, avg=1259579854.00, stdev= 0.00 lat (nsec): min=1259.7M, max=1259.7M, avg=1259702329.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7515, max= 7515, per=100.00%, avg=7515.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2075KiB/s (2125kB/s)(8192KiB/3948msec); 0 zone resets clat (msec): min=350, max=2276, avg=1313.44, stdev=1362.00 lat (msec): min=350, max=2277, avg=1314.35, stdev=1362.67 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8175, max= 8175, per=98.51%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.79%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144752: Sat Jul 4 00:39:33 2026 write: IOPS=1, BW=6737KiB/s (6899kB/s)(12.0MiB/1824msec); 0 zone resets clat (msec): min=306, max=1129, avg=587.83, stdev=469.07 lat (msec): min=307, max=1129, avg=588.32, stdev=469.03 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 6095, max= 8062, per=85.29%, avg=7078.50, stdev=1390.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.66%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144753: Sat Jul 4 00:39:33 2026 write: IOPS=1, BW=5287KiB/s (5414kB/s)(12.0MiB/2324msec); 0 zone resets clat (msec): min=318, max=1229, avg=766.52, stdev=455.91 lat (msec): min=318, max=1230, avg=767.49, stdev=455.90 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 6595, max= 8062, per=88.31%, avg=7328.50, stdev=1037.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.08%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4150KiB/s (4250kB/s), 1037KiB/s-4207KiB/s (1062kB/s-4308kB/s), io=16.0MiB (16.8MB), run=2921-3948msec WRITE: bw=8300KiB/s (8499kB/s), 2075KiB/s-6737KiB/s (2125kB/s-6899kB/s), io=32.0MiB (33.6MB), run=1824-3948msec