== sanity test 398b: DIO and buffer IO race ============== 00:06:12 (1788840372) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.02591 s, 10.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145078: Tue Sep 8 00:08:56 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5992KiB/144661msec) clat (usec): min=32, max=1020.3k, avg=48031.93, stdev=46119.96 lat (usec): min=32, max=1020.3k, avg=48039.07, stdev=46124.23 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 2802], | 20.00th=[ 20317], 30.00th=[ 27132], 40.00th=[ 32900], | 50.00th=[ 40633], 60.00th=[ 49546], 70.00th=[ 58459], | 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[ 107480], | 99.00th=[ 200279], 99.50th=[ 270533], 99.90th=[ 459277], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 120, per=24.94%, avg=41.15, stdev=20.04, samples=282 iops : min= 1, max= 30, avg= 9.65, stdev= 5.04, samples=282 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6296KiB/144661msec); 0 zone resets clat (usec): min=1003, max=569964, avg=45806.15, stdev=49179.21 lat (usec): min=1004, max=569966, avg=45807.93, stdev=49179.11 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1401], 20.00th=[ 3654], | 30.00th=[ 8094], 40.00th=[ 18744], 50.00th=[ 33162], 60.00th=[ 46924], | 70.00th=[ 61604], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[135267], | 99.00th=[189793], 99.50th=[235930], 99.90th=[434111], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 159, per=25.15%, avg=43.51, stdev=20.17, samples=281 iops : min= 1, max= 39, avg=10.24, stdev= 5.08, samples=281 lat (usec) : 50=0.42%, 100=4.13%, 250=0.07%, 500=0.07%, 750=0.03% lat (msec) : 2=6.71%, 4=4.20%, 10=6.51%, 20=8.11%, 50=31.22% lat (msec) : 100=28.55%, 250=9.44%, 500=0.49%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.32%, ctx=6409, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145079: Tue Sep 8 00:08:56 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(5940KiB/145095msec) clat (usec): min=32, max=522085, avg=46482.71, stdev=37200.58 lat (usec): min=32, max=522086, avg=46491.91, stdev=37199.64 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 1037], 20.00th=[ 20841], | 30.00th=[ 27132], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[154141], 99.50th=[175113], 99.90th=[513803], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 7, max= 111, per=24.92%, avg=41.11, stdev=18.93, samples=280 iops : min= 1, max= 27, avg= 9.64, stdev= 4.78, samples=280 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6348KiB/145095msec); 0 zone resets clat (usec): min=959, max=1021.8k, avg=47553.81, stdev=54634.06 lat (usec): min=959, max=1021.8k, avg=47556.69, stdev=54633.01 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1680], | 20.00th=[ 4752], 30.00th=[ 9765], 40.00th=[ 22152], | 50.00th=[ 35390], 60.00th=[ 49021], 70.00th=[ 62129], | 80.00th=[ 81265], 90.00th=[ 110625], 95.00th=[ 135267], | 99.00th=[ 212861], 99.50th=[ 258999], 99.90th=[ 497026], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 119, per=25.13%, avg=43.47, stdev=20.28, samples=283 iops : min= 1, max= 29, avg=10.23, stdev= 5.10, samples=283 lat (usec) : 50=0.55%, 100=3.81%, 250=0.39%, 750=0.03%, 1000=0.20% lat (msec) : 2=6.02%, 4=3.16%, 10=6.64%, 20=7.98%, 50=32.62% lat (msec) : 100=28.91%, 250=9.31%, 500=0.29%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.49%, ctx=6542, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145080: Tue Sep 8 00:08:56 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6028KiB/143657msec) clat (usec): min=29, max=427344, avg=47150.87, stdev=37616.57 lat (usec): min=29, max=427346, avg=47152.75, stdev=37616.24 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 161], 20.00th=[ 20055], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[160433], 99.50th=[189793], 99.90th=[375391], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 111, per=25.31%, avg=41.76, stdev=19.00, samples=280 iops : min= 1, max= 27, avg= 9.80, stdev= 4.76, samples=280 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6260KiB/143657msec); 0 zone resets clat (usec): min=1001, max=999572, avg=46056.32, stdev=52350.10 lat (usec): min=1001, max=999691, avg=46062.22, stdev=52353.49 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1680], | 20.00th=[ 4817], 30.00th=[ 10028], 40.00th=[ 21365], | 50.00th=[ 33817], 60.00th=[ 46400], 70.00th=[ 60031], | 80.00th=[ 79168], 90.00th=[ 108528], 95.00th=[ 133694], | 99.00th=[ 198181], 99.50th=[ 252707], 99.90th=[ 404751], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 96, per=24.88%, avg=43.05, stdev=19.52, samples=282 iops : min= 1, max= 24, avg=10.12, stdev= 4.93, samples=282 lat (usec) : 50=0.78%, 100=3.91%, 250=0.23%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.96%, 4=3.45%, 10=6.35%, 20=8.92%, 50=33.37% lat (msec) : 100=26.50%, 250=10.03%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=4.56%, ctx=6432, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145081: Tue Sep 8 00:08:56 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6052KiB/144127msec) clat (usec): min=34, max=1034.0k, avg=46632.01, stdev=43882.79 lat (usec): min=34, max=1034.0k, avg=46638.11, stdev=43887.40 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 243], | 20.00th=[ 21103], 30.00th=[ 26870], 40.00th=[ 32637], | 50.00th=[ 39060], 60.00th=[ 46400], 70.00th=[ 55837], | 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[ 105382], | 99.00th=[ 170918], 99.50th=[ 196084], 99.90th=[ 438305], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 104, per=25.52%, avg=42.10, stdev=19.52, samples=279 iops : min= 1, max= 26, avg= 9.89, stdev= 4.91, samples=279 write: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6236KiB/144127msec); 0 zone resets clat (usec): min=939, max=334622, avg=46788.16, stdev=48920.39 lat (usec): min=940, max=334624, avg=46790.43, stdev=48920.13 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1663], 20.00th=[ 4228], | 30.00th=[ 9241], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 47449], | 70.00th=[ 61604], 80.00th=[ 81265], 90.00th=[111674], 95.00th=[139461], | 99.00th=[212861], 99.50th=[261096], 99.90th=[325059], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 110, per=24.87%, avg=43.02, stdev=19.44, samples=281 iops : min= 1, max= 27, avg=10.12, stdev= 4.90, samples=281 lat (usec) : 50=0.42%, 100=4.13%, 250=0.39%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=5.73%, 4=3.94%, 10=6.12%, 20=8.24%, 50=33.43% lat (msec) : 100=27.60%, 250=9.24%, 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=4.37%, ctx=6428, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=165KiB/s (169kB/s), 40.9KiB/s-41.0KiB/s (41.9kB/s-42.0kB/s), io=23.4MiB (24.6MB), run=143657-145095msec WRITE: bw=173KiB/s (177kB/s), 43.3KiB/s-43.8KiB/s (44.3kB/s-44.8kB/s), io=24.6MiB (25.7MB), run=143657-145095msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Tue Sep 8 00:11:41 2026 read: IOPS=4, BW=19.3KiB/s (19.7kB/s)(5992KiB/311029msec) clat (msec): min=6, max=1068, avg=42.38, stdev=52.92 lat (msec): min=6, max=1068, avg=42.39, stdev=52.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 117], | 99.00th=[ 232], 99.50th=[ 355], 99.90th=[ 634], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 96, per=29.11%, avg=22.41, stdev=15.30, samples=514 iops : min= 1, max= 24, avg= 4.95, stdev= 3.86, samples=514 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6296KiB/311029msec); 0 zone resets clat (msec): min=40, max=611, avg=156.88, stdev=76.24 lat (msec): min=40, max=611, avg=156.88, stdev=76.24 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 251], 95.00th=[ 309], | 99.00th=[ 439], 99.50th=[ 506], 99.90th=[ 584], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 55, per=25.25%, avg=20.20, stdev= 9.15, samples=596 iops : min= 1, max= 13, avg= 4.40, stdev= 2.36, samples=596 lat (msec) : 10=2.15%, 20=12.92%, 50=22.62%, 100=18.65%, 250=38.05% lat (msec) : 500=5.24%, 750=0.33%, 2000=0.03% cpu : usr=0.04%, sys=1.00%, ctx=5231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Tue Sep 8 00:11:41 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(5940KiB/310930msec) clat (msec): min=5, max=1130, avg=41.38, stdev=51.57 lat (msec): min=5, max=1130, avg=41.38, stdev=51.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 112], | 99.00th=[ 218], 99.50th=[ 292], 99.90th=[ 634], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 103, per=29.66%, avg=22.84, stdev=15.11, samples=500 iops : min= 1, max= 25, avg= 5.06, stdev= 3.81, samples=500 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6348KiB/310930msec); 0 zone resets clat (msec): min=37, max=598, avg=156.82, stdev=77.76 lat (msec): min=37, max=598, avg=156.83, stdev=77.76 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 84], 20.00th=[ 99], | 30.00th=[ 110], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 253], 95.00th=[ 321], | 99.00th=[ 443], 99.50th=[ 485], 99.90th=[ 550], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 47, per=25.44%, avg=20.35, stdev= 9.03, samples=597 iops : min= 1, max= 11, avg= 4.44, stdev= 2.32, samples=597 lat (msec) : 10=2.12%, 20=12.92%, 50=22.40%, 100=19.04%, 250=37.79% lat (msec) : 500=5.40%, 750=0.29%, 2000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5351, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Tue Sep 8 00:11:41 2026 read: IOPS=4, BW=19.4KiB/s (19.8kB/s)(6028KiB/310979msec) clat (msec): min=6, max=427, avg=43.22, stdev=40.94 lat (msec): min=6, max=427, avg=43.22, stdev=40.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 126], | 99.00th=[ 192], 99.50th=[ 249], 99.90th=[ 351], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 96, per=28.68%, avg=22.09, stdev=14.96, samples=524 iops : min= 1, max= 24, avg= 4.87, stdev= 3.79, samples=524 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6260KiB/310979msec); 0 zone resets clat (msec): min=41, max=1280, avg=156.71, stdev=82.56 lat (msec): min=41, max=1280, avg=156.71, stdev=82.56 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 422], 99.50th=[ 493], 99.90th=[ 709], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 47, per=25.18%, avg=20.14, stdev= 9.34, samples=594 iops : min= 1, max= 11, avg= 4.38, stdev= 2.40, samples=594 lat (msec) : 10=1.73%, 20=11.98%, 50=22.98%, 100=20.08%, 250=37.43% lat (msec) : 500=5.57%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5358, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145076: Tue Sep 8 00:11:41 2026 read: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6052KiB/310715msec) clat (msec): min=5, max=645, avg=42.89, stdev=46.31 lat (msec): min=5, max=645, avg=42.89, stdev=46.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 236], 99.50th=[ 313], 99.90th=[ 527], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 95, per=29.37%, avg=22.61, stdev=15.74, samples=515 iops : min= 1, max= 23, avg= 5.01, stdev= 3.97, samples=515 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6236KiB/310715msec); 0 zone resets clat (msec): min=43, max=1338, avg=157.27, stdev=78.41 lat (msec): min=43, max=1338, avg=157.28, stdev=78.41 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 74], 10.00th=[ 84], 20.00th=[ 100], | 30.00th=[ 112], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 418], 99.50th=[ 456], 99.90th=[ 550], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 47, per=25.22%, avg=20.18, stdev= 8.91, samples=592 iops : min= 1, max= 11, avg= 4.39, stdev= 2.29, samples=592 lat (msec) : 10=2.15%, 20=12.47%, 50=22.17%, 100=19.30%, 250=38.28% lat (msec) : 500=5.44%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.2KiB/s (79.1kB/s), 19.1KiB/s-19.5KiB/s (19.6kB/s-19.9kB/s), io=23.4MiB (24.6MB), run=310715-311029msec WRITE: bw=80.8KiB/s (82.8kB/s), 20.1KiB/s-20.4KiB/s (20.6kB/s-20.9kB/s), io=24.6MiB (25.7MB), run=310715-311029msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145148: Tue Sep 8 00:12:21 2026 read: IOPS=12, BW=200KiB/s (204kB/s)(5920KiB/29644msec) clat (usec): min=33, max=410597, avg=39982.06, stdev=38318.25 lat (usec): min=33, max=410599, avg=39983.26, stdev=38318.25 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 330], | 30.00th=[ 22938], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[160433], 99.50th=[235930], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 62, max= 447, per=24.90%, avg=199.91, stdev=88.96, samples=58 iops : min= 3, max= 27, avg=11.71, stdev= 5.64, samples=58 write: IOPS=13, BW=215KiB/s (220kB/s)(6368KiB/29644msec); 0 zone resets clat (usec): min=1371, max=271262, avg=37249.00, stdev=40966.17 lat (usec): min=1373, max=271264, avg=37251.07, stdev=40966.01 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2933], 20.00th=[ 5669], | 30.00th=[ 8586], 40.00th=[ 14091], 50.00th=[ 22676], 60.00th=[ 32375], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[120062], | 99.00th=[179307], 99.50th=[210764], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 59, max= 414, per=25.56%, avg=216.02, stdev=79.38, samples=58 iops : min= 3, max= 25, avg=12.72, stdev= 4.97, samples=58 lat (usec) : 50=1.17%, 100=7.55%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=4.43%, 10=9.51%, 20=9.11%, 50=32.94% lat (msec) : 100=23.70%, 250=6.25%, 500=0.26% cpu : usr=0.08%, sys=5.50%, ctx=1468, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145149: Tue Sep 8 00:12:21 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(5744KiB/28516msec) clat (usec): min=34, max=373859, avg=40395.44, stdev=36082.58 lat (usec): min=34, max=373861, avg=40397.19, stdev=36083.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 71], 20.00th=[ 8586], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[179307], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 383, per=25.69%, avg=206.27, stdev=77.50, samples=55 iops : min= 1, max= 23, avg=12.11, stdev= 4.84, samples=55 write: IOPS=14, BW=229KiB/s (235kB/s)(6544KiB/28516msec); 0 zone resets clat (usec): min=1543, max=259284, avg=34164.95, stdev=39541.04 lat (usec): min=1544, max=259286, avg=34167.16, stdev=39541.03 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2540], 10.00th=[ 3228], 20.00th=[ 5604], | 30.00th=[ 8291], 40.00th=[ 11207], 50.00th=[ 18482], 60.00th=[ 30278], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[202376], 99.50th=[238027], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 441, per=27.17%, avg=229.57, stdev=92.03, samples=56 iops : min= 3, max= 27, avg=13.59, stdev= 5.85, samples=56 lat (usec) : 50=0.52%, 100=6.38%, 250=1.69%, 500=0.39%, 750=0.13% lat (msec) : 2=1.95%, 4=4.95%, 10=13.15%, 20=9.51%, 50=32.55% lat (msec) : 100=23.83%, 250=4.69%, 500=0.26% cpu : usr=0.09%, sys=5.65%, ctx=1490, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145150: Tue Sep 8 00:12:21 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29669msec) clat (usec): min=37, max=283247, avg=38881.82, stdev=32936.49 lat (usec): min=37, max=283248, avg=38883.01, stdev=32936.43 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 217], | 30.00th=[ 23725], 40.00th=[ 30540], 50.00th=[ 37487], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[196084], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 411, per=26.47%, avg=212.55, stdev=81.95, samples=58 iops : min= 3, max= 25, avg=12.52, stdev= 5.19, samples=58 write: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29669msec); 0 zone resets clat (usec): min=1444, max=253458, avg=38271.36, stdev=39654.21 lat (usec): min=1446, max=253460, avg=38273.73, stdev=39654.17 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2900], 20.00th=[ 5473], | 30.00th=[ 8979], 40.00th=[ 15270], 50.00th=[ 25822], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[115868], | 99.00th=[191890], 99.50th=[210764], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 63, max= 445, per=24.02%, avg=202.95, stdev=80.35, samples=58 iops : min= 3, max= 27, avg=11.90, stdev= 5.09, samples=58 lat (usec) : 50=1.43%, 100=7.81%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=3.12%, 4=3.65%, 10=9.24%, 20=8.20%, 50=36.46% lat (msec) : 100=23.18%, 250=5.34%, 500=0.26% cpu : usr=0.05%, sys=5.80%, ctx=1534, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145151: Tue Sep 8 00:12:21 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29808msec) clat (usec): min=34, max=299235, avg=37901.72, stdev=33649.35 lat (usec): min=34, max=299239, avg=37902.81, stdev=33649.43 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 123], | 30.00th=[ 22152], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[158335], 99.50th=[274727], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 402, per=25.43%, avg=204.19, stdev=86.68, samples=57 iops : min= 1, max= 25, avg=11.98, stdev= 5.50, samples=57 write: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29808msec); 0 zone resets clat (usec): min=1414, max=297554, avg=39593.74, stdev=47913.02 lat (usec): min=1416, max=297556, avg=39611.21, stdev=47903.62 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 2180], 20.00th=[ 4080], | 30.00th=[ 7242], 40.00th=[ 10814], 50.00th=[ 21365], 60.00th=[ 33424], | 70.00th=[ 49021], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[137364], | 99.00th=[217056], 99.50th=[278922], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 62, max= 574, per=24.65%, avg=208.26, stdev=98.89, samples=58 iops : min= 3, max= 35, avg=12.24, stdev= 6.21, samples=58 lat (usec) : 50=1.30%, 100=7.94%, 250=0.91%, 750=0.39% lat (msec) : 2=4.82%, 4=5.47%, 10=9.64%, 20=8.33%, 50=31.51% lat (msec) : 100=23.83%, 250=5.34%, 500=0.52% cpu : usr=0.06%, sys=5.58%, ctx=1422, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=804KiB/s (823kB/s), 200KiB/s-211KiB/s (204kB/s-216kB/s), io=23.4MiB (24.5MB), run=28516-29808msec WRITE: bw=845KiB/s (866kB/s), 203KiB/s-229KiB/s (208kB/s-235kB/s), io=24.6MiB (25.8MB), run=28516-29808msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145143: Tue Sep 8 00:13:04 2026 read: IOPS=5, BW=81.9KiB/s (83.9kB/s)(5920KiB/72281msec) clat (msec): min=6, max=293, avg=40.07, stdev=37.62 lat (msec): min=6, max=293, avg=40.07, stdev=37.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 111], | 99.00th=[ 209], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 256, per=27.46%, avg=90.05, stdev=53.34, samples=129 iops : min= 1, max= 16, avg= 4.84, stdev= 3.35, samples=129 write: IOPS=5, BW=88.1KiB/s (90.2kB/s)(6368KiB/72281msec); 0 zone resets clat (msec): min=42, max=445, avg=143.95, stdev=57.70 lat (msec): min=42, max=445, avg=143.95, stdev=57.70 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 121], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 218], 95.00th=[ 255], | 99.00th=[ 347], 99.50th=[ 393], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 191, per=25.97%, avg=89.59, stdev=35.86, samples=140 iops : min= 1, max= 11, avg= 4.80, stdev= 2.32, samples=140 lat (msec) : 10=1.69%, 20=12.37%, 50=24.09%, 100=18.49%, 250=40.23% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.12%, ctx=1278, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145144: Tue Sep 8 00:13:04 2026 read: IOPS=4, BW=78.7KiB/s (80.6kB/s)(5744KiB/72951msec) clat (msec): min=7, max=290, avg=38.66, stdev=38.63 lat (msec): min=7, max=290, avg=38.66, stdev=38.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 115], | 99.00th=[ 222], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 346, per=27.81%, avg=91.20, stdev=64.00, samples=123 iops : min= 1, max= 21, avg= 4.91, stdev= 4.02, samples=123 write: IOPS=5, BW=89.7KiB/s (91.9kB/s)(6544KiB/72951msec); 0 zone resets clat (msec): min=43, max=470, avg=144.27, stdev=62.62 lat (msec): min=43, max=470, avg=144.28, stdev=62.62 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 95], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 182], 90.00th=[ 226], 95.00th=[ 259], | 99.00th=[ 376], 99.50th=[ 393], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 31, max= 191, per=26.31%, avg=90.77, stdev=35.67, samples=141 iops : min= 1, max= 11, avg= 4.87, stdev= 2.32, samples=141 lat (msec) : 10=1.69%, 20=13.02%, 50=23.44%, 100=18.10%, 250=39.97% lat (msec) : 500=3.78% cpu : usr=0.03%, sys=1.13%, ctx=1286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145145: Tue Sep 8 00:13:04 2026 read: IOPS=5, BW=89.7KiB/s (91.9kB/s)(6256KiB/69712msec) clat (msec): min=7, max=335, avg=38.10, stdev=37.84 lat (msec): min=7, max=335, avg=38.10, stdev=37.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 110], | 99.00th=[ 197], 99.50th=[ 292], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 352, per=29.66%, avg=97.28, stdev=65.48, samples=127 iops : min= 1, max= 22, avg= 5.28, stdev= 4.17, samples=127 write: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6032KiB/69712msec); 0 zone resets clat (msec): min=46, max=511, avg=144.98, stdev=60.79 lat (msec): min=46, max=511, avg=144.98, stdev=60.79 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 228], 95.00th=[ 257], | 99.00th=[ 342], 99.50th=[ 388], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 30, max= 191, per=25.50%, avg=87.98, stdev=34.15, samples=135 iops : min= 1, max= 11, avg= 4.70, stdev= 2.21, samples=135 lat (msec) : 10=1.69%, 20=13.41%, 50=27.21%, 100=18.23%, 250=36.59% lat (msec) : 500=2.73%, 750=0.13% cpu : usr=0.04%, sys=1.15%, ctx=1267, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145146: Tue Sep 8 00:13:04 2026 read: IOPS=5, BW=83.4KiB/s (85.4kB/s)(6032KiB/72292msec) clat (msec): min=7, max=292, avg=39.33, stdev=37.67 lat (msec): min=7, max=292, avg=39.33, stdev=37.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 123], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 351, per=29.47%, avg=96.66, stdev=61.96, samples=122 iops : min= 1, max= 21, avg= 5.25, stdev= 3.98, samples=122 write: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6256KiB/72292msec); 0 zone resets clat (msec): min=47, max=465, avg=146.55, stdev=63.78 lat (msec): min=47, max=465, avg=146.56, stdev=63.78 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 230], 95.00th=[ 268], | 99.00th=[ 351], 99.50th=[ 443], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 30, max= 160, per=25.14%, avg=86.73, stdev=36.39, samples=142 iops : min= 1, max= 10, avg= 4.62, stdev= 2.37, samples=142 lat (msec) : 10=1.43%, 20=13.02%, 50=24.74%, 100=18.88%, 250=38.02% lat (msec) : 500=3.91% cpu : usr=0.04%, sys=1.08%, ctx=1218, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=328KiB/s (336kB/s), 78.7KiB/s-89.7KiB/s (80.6kB/s-91.9kB/s), io=23.4MiB (24.5MB), run=69712-72951msec WRITE: bw=345KiB/s (354kB/s), 86.5KiB/s-89.7KiB/s (88.6kB/s-91.9kB/s), io=24.6MiB (25.8MB), run=69712-72951msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145168: Tue Sep 8 00:13:23 2026 read: IOPS=1, BW=1282KiB/s (1313kB/s)(7168KiB/5590msec) clat (msec): min=90, max=347, avg=191.29, stdev=88.23 lat (msec): min=91, max=347, avg=191.29, stdev=88.23 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 114], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 207], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 232], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1984, max= 4711, per=100.00%, avg=3565.00, stdev=1414.59, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=916KiB/s (938kB/s)(5120KiB/5590msec); 0 zone resets clat (msec): min=381, max=1971, avg=814.08, stdev=654.29 lat (msec): min=382, max=1971, avg=814.24, stdev=654.24 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1961, max= 2039, per=48.40%, avg=2010.50, stdev=34.42, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=2.38%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145170: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=297KiB/s (304kB/s)(2048KiB/6901msec) clat (msec): min=183, max=376, avg=280.15, stdev=136.72 lat (msec): min=183, max=376, avg=280.15, stdev=136.72 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1539, max= 1984, per=59.37%, avg=1761.50, stdev=314.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1484KiB/s (1519kB/s)(10.0MiB/6901msec); 0 zone resets clat (msec): min=273, max=1906, avg=628.07, stdev=523.78 lat (msec): min=273, max=1906, avg=628.18, stdev=523.78 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 292], | 30.00th=[ 338], 40.00th=[ 397], 50.00th=[ 422], 60.00th=[ 430], | 70.00th=[ 460], 80.00th=[ 550], 90.00th=[ 1217], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 1539, max= 4007, per=53.07%, avg=2204.38, stdev=747.61, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.23%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145171: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=977KiB/s (1001kB/s)(6144KiB/6288msec) clat (msec): min=132, max=346, avg=237.79, stdev=92.10 lat (msec): min=132, max=346, avg=237.79, stdev=92.10 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 271], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1961, max= 2039, per=67.46%, avg=2001.40, stdev=31.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=977KiB/s (1001kB/s)(6144KiB/6288msec); 0 zone resets clat (msec): min=189, max=2231, avg=735.50, stdev=752.19 lat (msec): min=189, max=2231, avg=735.72, stdev=752.18 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 460], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1996, max= 4000, per=58.09%, avg=2413.00, stdev=887.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.64%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145172: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=832KiB/s (852kB/s)(5120KiB/6157msec) clat (msec): min=209, max=649, avg=353.45, stdev=177.25 lat (msec): min=209, max=649, avg=353.45, stdev=177.25 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 3923, max= 4079, per=100.00%, avg=4001.00, stdev=110.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1164KiB/s (1192kB/s)(7168KiB/6157msec); 0 zone resets clat (msec): min=210, max=1777, avg=606.94, stdev=533.22 lat (msec): min=210, max=1777, avg=607.05, stdev=533.22 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 313], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 439], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 642], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 1575, max= 4000, per=55.82%, avg=2318.80, stdev=958.42, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=16.67%, 500=58.33%, 750=16.67%, 2000=8.33% cpu : usr=0.03%, sys=2.24%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2968KiB/s (3039kB/s), 297KiB/s-1282KiB/s (304kB/s-1313kB/s), io=20.0MiB (20.0MB), run=5590-6901msec WRITE: bw=4155KiB/s (4254kB/s), 916KiB/s-1484KiB/s (938kB/s-1519kB/s), io=28.0MiB (29.4MB), run=5590-6901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145173: Tue Sep 8 00:13:23 2026 read: IOPS=1, BW=1304KiB/s (1335kB/s)(7168KiB/5499msec) clat (usec): min=591, max=323955, avg=202907.89, stdev=109715.28 lat (usec): min=592, max=323955, avg=202909.47, stdev=109715.22 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[141558], | 30.00th=[206570], 40.00th=[206570], 50.00th=[208667], 60.00th=[223347], | 70.00th=[223347], 80.00th=[316670], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1865, max= 4063, per=78.77%, avg=2361.60, stdev=953.78, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=931KiB/s (953kB/s)(5120KiB/5499msec); 0 zone resets clat (msec): min=182, max=1806, avg=753.57, stdev=659.09 lat (msec): min=182, max=1806, avg=753.71, stdev=659.07 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1865, max= 4047, per=62.62%, avg=2628.33, stdev=1229.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=7.88%, ctx=165, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145174: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=300KiB/s (307kB/s)(2048KiB/6830msec) clat (msec): min=260, max=2095, avg=1177.92, stdev=1297.89 lat (msec): min=260, max=2095, avg=1177.92, stdev=1297.89 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 2089], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 2035, max= 2039, per=67.95%, avg=2037.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1499KiB/s (1535kB/s)(10.0MiB/6830msec); 0 zone resets clat (msec): min=125, max=1174, avg=439.49, stdev=339.53 lat (msec): min=125, max=1174, avg=439.66, stdev=339.53 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 142], | 30.00th=[ 182], 40.00th=[ 205], 50.00th=[ 288], 60.00th=[ 380], | 70.00th=[ 523], 80.00th=[ 567], 90.00th=[ 810], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1865, max= 4079, per=61.40%, avg=2576.86, stdev=1027.66, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.58%, ctx=388, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145175: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=954KiB/s (976kB/s)(6144KiB/6443msec) clat (usec): min=494, max=351906, avg=182730.38, stdev=148224.69 lat (usec): min=495, max=351908, avg=182731.60, stdev=148224.39 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[221250], 50.00th=[221250], 60.00th=[235930], | 70.00th=[283116], 80.00th=[283116], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1980, max= 4047, per=100.00%, avg=3355.33, stdev=1191.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=954KiB/s (976kB/s)(6144KiB/6443msec); 0 zone resets clat (msec): min=175, max=2411, avg=834.36, stdev=818.30 lat (msec): min=175, max=2411, avg=834.45, stdev=818.32 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 726], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1865, max= 2039, per=47.27%, avg=1983.80, stdev=70.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=6.66%, ctx=181, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Tue Sep 8 00:13:23 2026 read: IOPS=0, BW=880KiB/s (901kB/s)(5120KiB/5819msec) clat (usec): min=391, max=350848, avg=123031.47, stdev=150600.34 lat (usec): min=393, max=350850, avg=123033.08, stdev=150600.56 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 392], | 30.00th=[ 2278], 40.00th=[ 2278], 50.00th=[ 63701], 60.00th=[ 63701], | 70.00th=[198181], 80.00th=[198181], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2019, max= 6071, per=100.00%, avg=4045.00, stdev=2865.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1232KiB/s (1261kB/s)(7168KiB/5819msec); 0 zone resets clat (msec): min=223, max=2027, avg=716.71, stdev=606.11 lat (msec): min=223, max=2027, avg=717.00, stdev=606.01 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 321], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 584], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 776], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 1753, max= 2039, per=46.66%, avg=1958.33, stdev=121.20, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=6.65%, ctx=200, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2999KiB/s (3071kB/s), 300KiB/s-1304KiB/s (307kB/s-1335kB/s), io=20.0MiB (20.0MB), run=5499-6830msec WRITE: bw=4198KiB/s (4299kB/s), 931KiB/s-1499KiB/s (953kB/s-1535kB/s), io=28.0MiB (29.4MB), run=5499-6830msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145184: Tue Sep 8 00:13:40 2026 read: IOPS=0, BW=2448KiB/s (2507kB/s)(12.0MiB/5020msec) clat (msec): min=373, max=2185, avg=1517.28, stdev=995.55 lat (msec): min=373, max=2185, avg=1517.29, stdev=995.55 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1989], 50.00th=[ 1989], 60.00th=[ 1989], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.05%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145185: Tue Sep 8 00:13:40 2026 read: IOPS=0, BW=1001KiB/s (1025kB/s)(4096KiB/4093msec) clat (nsec): min=477029k, max=477029k, avg=477028514.00, stdev= 0.00 lat (nsec): min=477033k, max=477033k, avg=477032832.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2001KiB/s (2050kB/s)(8192KiB/4093msec); 0 zone resets clat (msec): min=1375, max=1999, avg=1687.74, stdev=441.19 lat (msec): min=1376, max=2008, avg=1692.39, stdev=447.03 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.03%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Tue Sep 8 00:13:40 2026 write: IOPS=0, BW=3416KiB/s (3498kB/s)(12.0MiB/3597msec); 0 zone resets clat (msec): min=836, max=1404, avg=1125.23, stdev=284.25 lat (msec): min=836, max=1405, avg=1126.38, stdev=284.60 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.48%, ctx=135, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Tue Sep 8 00:13:40 2026 write: IOPS=1, BW=4524KiB/s (4633kB/s)(12.0MiB/2716msec); 0 zone resets clat (msec): min=462, max=1364, avg=831.97, stdev=472.45 lat (msec): min=463, max=1364, avg=832.74, stdev=471.86 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 5944, max= 8047, per=87.39%, avg=6995.50, stdev=1487.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.20%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3264KiB/s (3342kB/s), 1001KiB/s-2448KiB/s (1025kB/s-2507kB/s), io=16.0MiB (16.8MB), run=4093-5020msec WRITE: bw=8006KiB/s (8198kB/s), 2001KiB/s-4524KiB/s (2050kB/s-4633kB/s), io=32.0MiB (33.6MB), run=2716-4093msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Tue Sep 8 00:13:40 2026 read: IOPS=0, BW=3859KiB/s (3952kB/s)(12.0MiB/3184msec) clat (msec): min=726, max=1174, avg=988.72, stdev=233.91 lat (msec): min=726, max=1174, avg=988.72, stdev=233.91 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8015, max= 8062, per=100.00%, avg=8038.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=14.33%, ctx=345, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145189: Tue Sep 8 00:13:40 2026 read: IOPS=0, BW=837KiB/s (857kB/s)(4096KiB/4895msec) clat (nsec): min=1114.3M, max=1114.3M, avg=1114318980.00, stdev= 0.00 lat (nsec): min=1114.3M, max=1114.3M, avg=1114320942.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1674KiB/s (1714kB/s)(8192KiB/4895msec); 0 zone resets clat (msec): min=1149, max=2410, avg=1780.09, stdev=891.09 lat (msec): min=1150, max=2410, avg=1780.48, stdev=891.28 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.10%, sys=2.70%, ctx=137, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145190: Tue Sep 8 00:13:40 2026 write: IOPS=0, BW=2607KiB/s (2670kB/s)(12.0MiB/4713msec); 0 zone resets clat (msec): min=366, max=2278, avg=1498.48, stdev=1003.38 lat (msec): min=367, max=2279, avg=1498.82, stdev=1003.37 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1854], 50.00th=[ 1854], 60.00th=[ 1854], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.93%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145191: Tue Sep 8 00:13:40 2026 write: IOPS=0, BW=3046KiB/s (3119kB/s)(12.0MiB/4034msec); 0 zone resets clat (msec): min=369, max=2324, avg=1228.60, stdev=998.89 lat (msec): min=370, max=2325, avg=1230.76, stdev=998.73 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3347KiB/s (3427kB/s), 837KiB/s-3859KiB/s (857kB/s-3952kB/s), io=16.0MiB (16.8MB), run=3184-4895msec WRITE: bw=6694KiB/s (6855kB/s), 1674KiB/s-3046KiB/s (1714kB/s-3119kB/s), io=32.0MiB (33.6MB), run=4034-4895msec