== sanity test 398b: DIO and buffer IO race ============== 22:56:09 (1787194569) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.39287 s, 11.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144788: Wed Aug 19 22:58:03 2026 read: IOPS=15, BW=60.9KiB/s (62.4kB/s)(5992KiB/98365msec) clat (usec): min=32, max=767765, avg=32453.58, stdev=29769.53 lat (usec): min=32, max=767766, avg=32456.15, stdev=29768.65 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 8979], 20.00th=[ 15533], | 30.00th=[ 19530], 40.00th=[ 23200], 50.00th=[ 27919], 60.00th=[ 33162], | 70.00th=[ 39584], 80.00th=[ 46924], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[104334], 99.50th=[139461], 99.90th=[229639], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 134, per=25.44%, avg=60.80, stdev=23.75, samples=194 iops : min= 1, max= 33, avg=14.58, stdev= 6.00, samples=194 write: IOPS=16, BW=64.0KiB/s (65.5kB/s)(6296KiB/98365msec); 0 zone resets clat (usec): min=924, max=230426, avg=31361.62, stdev=32586.50 lat (usec): min=925, max=230427, avg=31364.12, stdev=32586.05 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1762], 20.00th=[ 3490], | 30.00th=[ 5997], 40.00th=[ 13829], 50.00th=[ 23725], 60.00th=[ 32113], | 70.00th=[ 40109], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[173016], 99.90th=[225444], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 143, per=25.65%, avg=64.13, stdev=24.39, samples=193 iops : min= 1, max= 35, avg=15.42, stdev= 6.13, samples=193 lat (usec) : 50=0.94%, 100=3.19%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.12%, 4=5.14%, 10=7.91%, 20=15.14%, 50=41.63% lat (msec) : 100=16.89%, 250=2.47%, 1000=0.03% cpu : usr=0.08%, sys=6.34%, ctx=6622, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144789: Wed Aug 19 22:58:03 2026 read: IOPS=15, BW=60.0KiB/s (61.5kB/s)(5940KiB/98935msec) clat (usec): min=34, max=452338, avg=32930.00, stdev=27811.67 lat (usec): min=34, max=452339, avg=32931.49, stdev=27811.84 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 71], 10.00th=[ 11469], 20.00th=[ 16188], | 30.00th=[ 19792], 40.00th=[ 23725], 50.00th=[ 27919], 60.00th=[ 32637], | 70.00th=[ 38536], 80.00th=[ 46400], 90.00th=[ 59507], 95.00th=[ 74974], | 99.00th=[110625], 99.50th=[141558], 99.90th=[404751], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 127, per=25.03%, avg=59.82, stdev=23.23, samples=195 iops : min= 1, max= 31, avg=14.34, stdev= 5.84, samples=195 write: IOPS=16, BW=64.2KiB/s (65.7kB/s)(6348KiB/98935msec); 0 zone resets clat (usec): min=877, max=674387, avg=31268.68, stdev=37080.34 lat (usec): min=878, max=674389, avg=31271.02, stdev=37080.48 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1188], 10.00th=[ 1582], 20.00th=[ 3392], | 30.00th=[ 6915], 40.00th=[ 13829], 50.00th=[ 22414], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[156238], 99.50th=[173016], 99.90th=[308282], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 176, per=25.45%, avg=63.63, stdev=29.69, samples=196 iops : min= 1, max= 44, avg=15.29, stdev= 7.45, samples=196 lat (usec) : 50=0.55%, 100=2.38%, 250=0.52%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.42% lat (msec) : 2=6.51%, 4=4.88%, 10=6.97%, 20=16.24%, 50=42.25% lat (msec) : 100=16.28%, 250=2.54%, 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=6.23%, ctx=6646, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144791: Wed Aug 19 22:58:03 2026 read: IOPS=15, BW=60.2KiB/s (61.6kB/s)(6028KiB/100177msec) clat (usec): min=31, max=301298, avg=31787.76, stdev=24782.01 lat (usec): min=31, max=301299, avg=31788.94, stdev=24782.02 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 7635], 20.00th=[ 15664], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26608], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 46924], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[122160], 99.50th=[137364], 99.90th=[229639], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 166, per=25.18%, avg=60.18, stdev=25.78, samples=196 iops : min= 1, max= 41, avg=14.42, stdev= 6.49, samples=196 write: IOPS=15, BW=62.5KiB/s (63.0kB/s)(6260KiB/100177msec); 0 zone resets clat (usec): min=851, max=756428, avg=33164.82, stdev=40263.97 lat (usec): min=852, max=756430, avg=33168.14, stdev=40264.09 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1745], 20.00th=[ 3326], | 30.00th=[ 6259], 40.00th=[ 15139], 50.00th=[ 23462], 60.00th=[ 32637], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[181404], 99.90th=[446694], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 159, per=24.81%, avg=62.03, stdev=24.91, samples=197 iops : min= 1, max= 39, avg=14.89, stdev= 6.27, samples=197 lat (usec) : 50=0.72%, 100=3.29%, 250=0.42%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.86%, 4=5.63%, 10=6.90%, 20=16.18%, 50=40.04% lat (msec) : 100=17.29%, 250=3.12%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=6.21%, ctx=6711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144793: Wed Aug 19 22:58:03 2026 read: IOPS=15, BW=60.7KiB/s (62.1kB/s)(6052KiB/99743msec) clat (usec): min=33, max=332397, avg=32434.32, stdev=24767.95 lat (usec): min=33, max=332398, avg=32437.66, stdev=24766.70 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 10683], 20.00th=[ 15926], | 30.00th=[ 19268], 40.00th=[ 23462], 50.00th=[ 27132], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 46924], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[112722], 99.50th=[139461], 99.90th=[244319], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 127, per=25.37%, avg=60.64, stdev=24.55, samples=194 iops : min= 1, max= 31, avg=14.55, stdev= 6.20, samples=194 write: IOPS=15, BW=62.5KiB/s (64.0kB/s)(6236KiB/99743msec); 0 zone resets clat (usec): min=876, max=814199, avg=32249.50, stdev=40177.49 lat (usec): min=877, max=814201, avg=32253.30, stdev=40177.41 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1156], 10.00th=[ 1549], 20.00th=[ 3130], | 30.00th=[ 6194], 40.00th=[ 13435], 50.00th=[ 22676], 60.00th=[ 31589], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[158335], 99.50th=[191890], 99.90th=[442500], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 158, per=24.97%, avg=62.43, stdev=25.94, samples=195 iops : min= 1, max= 39, avg=14.98, stdev= 6.53, samples=195 lat (usec) : 50=0.68%, 100=2.83%, 250=0.33%, 500=0.13%, 1000=0.23% lat (msec) : 2=6.51%, 4=5.34%, 10=7.19%, 20=16.41%, 50=40.01% lat (msec) : 100=17.55%, 250=2.67%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.98%, ctx=6716, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=240KiB/s (245kB/s), 60.0KiB/s-60.9KiB/s (61.5kB/s-62.4kB/s), io=23.4MiB (24.6MB), run=98365-100177msec WRITE: bw=251KiB/s (257kB/s), 62.5KiB/s-64.2KiB/s (63.0kB/s-65.7kB/s), io=24.6MiB (25.7MB), run=98365-100177msec fio: pid=144792, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144790: Wed Aug 19 22:59:59 2026 read: IOPS=6, BW=27.7KiB/s (28.4kB/s)(5992KiB/216114msec) clat (msec): min=5, max=778, avg=28.42, stdev=33.85 lat (msec): min=5, max=778, avg=28.43, stdev=33.85 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 57], 95.00th=[ 82], | 99.00th=[ 134], 99.50th=[ 178], 99.90th=[ 447], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 96, per=28.42%, avg=29.56, stdev=19.75, samples=394 iops : min= 1, max= 24, avg= 6.78, stdev= 5.00, samples=394 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6296KiB/216114msec); 0 zone resets clat (msec): min=34, max=484, avg=110.04, stdev=52.13 lat (msec): min=34, max=484, avg=110.04, stdev=52.13 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 99], 60.00th=[ 109], | 70.00th=[ 121], 80.00th=[ 142], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 292], 99.50th=[ 338], 99.90th=[ 481], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 63, per=26.66%, avg=28.79, stdev=11.62, samples=424 iops : min= 1, max= 15, avg= 6.58, stdev= 2.98, samples=424 lat (msec) : 10=6.51%, 20=19.01%, 50=18.98%, 100=29.65%, 250=24.84% lat (msec) : 500=0.98%, 1000=0.03% cpu : usr=0.05%, sys=1.38%, ctx=5530, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144792: Wed Aug 19 22:59:59 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(4428KiB/172433msec) clat (msec): min=5, max=686, avg=30.30, stdev=34.65 lat (msec): min=5, max=686, avg=30.30, stdev=34.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 88], | 99.00th=[ 144], 99.50th=[ 192], 99.90th=[ 249], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 88, per=26.71%, avg=27.78, stdev=18.65, samples=309 iops : min= 1, max= 22, avg= 6.33, stdev= 4.73, samples=309 write: IOPS=6, BW=27.5KiB/s (28.1kB/s)(4736KiB/172433msec); 0 zone resets clat (msec): min=34, max=506, avg=117.02, stdev=53.17 lat (msec): min=34, max=506, avg=117.03, stdev=53.17 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 105], 60.00th=[ 117], | 70.00th=[ 133], 80.00th=[ 155], 90.00th=[ 184], 95.00th=[ 211], | 99.00th=[ 300], 99.50th=[ 321], 99.90th=[ 485], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 56, per=25.05%, avg=27.05, stdev=11.23, samples=339 iops : min= 1, max= 14, avg= 6.14, stdev= 2.89, samples=339 lat (msec) : 10=5.02%, 20=19.90%, 50=16.71%, 100=28.01%, 250=29.10% lat (msec) : 500=1.13%, 750=0.09% cpu : usr=0.04%, sys=1.25%, ctx=3867, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1108,1184,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144794: Wed Aug 19 22:59:59 2026 read: IOPS=7, BW=28.0KiB/s (28.7kB/s)(6028KiB/215256msec) clat (msec): min=4, max=248, avg=29.50, stdev=27.07 lat (msec): min=4, max=248, avg=29.50, stdev=27.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 61], 95.00th=[ 79], | 99.00th=[ 138], 99.50th=[ 205], 99.90th=[ 234], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 7, max= 127, per=28.07%, avg=29.19, stdev=19.17, samples=401 iops : min= 1, max= 31, avg= 6.68, stdev= 4.85, samples=401 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6260KiB/215256msec); 0 zone resets clat (msec): min=32, max=739, avg=108.92, stdev=51.56 lat (msec): min=32, max=739, avg=108.93, stdev=51.56 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 97], 60.00th=[ 108], | 70.00th=[ 122], 80.00th=[ 140], 90.00th=[ 176], 95.00th=[ 203], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 426], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 56, per=26.44%, avg=28.55, stdev=12.04, samples=425 iops : min= 1, max= 14, avg= 6.52, stdev= 3.09, samples=425 lat (msec) : 10=5.47%, 20=18.65%, 50=19.30%, 100=31.80%, 250=23.76% lat (msec) : 500=0.98%, 750=0.03% cpu : usr=0.04%, sys=1.44%, ctx=5602, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144795: Wed Aug 19 22:59:59 2026 read: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6052KiB/215511msec) clat (msec): min=4, max=357, avg=29.02, stdev=27.17 lat (msec): min=4, max=357, avg=29.02, stdev=27.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 81], | 99.00th=[ 130], 99.50th=[ 167], 99.90th=[ 220], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 95, per=28.36%, avg=29.50, stdev=18.71, samples=399 iops : min= 1, max= 23, avg= 6.76, stdev= 4.73, samples=399 write: IOPS=7, BW=28.9KiB/s (29.6kB/s)(6236KiB/215511msec); 0 zone resets clat (msec): min=32, max=798, avg=109.85, stdev=53.60 lat (msec): min=32, max=798, avg=109.85, stdev=53.60 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 99], 60.00th=[ 109], | 70.00th=[ 121], 80.00th=[ 140], 90.00th=[ 171], 95.00th=[ 207], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 542], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 56, per=26.39%, avg=28.50, stdev=11.53, samples=425 iops : min= 1, max= 14, avg= 6.51, stdev= 2.97, samples=425 lat (msec) : 10=5.40%, 20=19.43%, 50=18.72%, 100=30.40%, 250=24.87% lat (msec) : 500=1.07%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.37%, ctx=5402, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (107kB/s), 25.7KiB/s-28.1KiB/s (26.3kB/s-28.8kB/s), io=21.0MiB (23.0MB), run=172433-216114msec WRITE: bw=109KiB/s (111kB/s), 27.5KiB/s-29.1KiB/s (28.1kB/s-29.8kB/s), io=22.0MiB (24.1MB), run=172433-216114msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144845: Wed Aug 19 23:00:32 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(5920KiB/24789msec) clat (usec): min=38, max=116542, avg=32119.85, stdev=25068.33 lat (usec): min=38, max=116544, avg=32120.89, stdev=25068.34 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 103], | 30.00th=[ 18220], 40.00th=[ 26084], 50.00th=[ 31851], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 54789], 90.00th=[ 65274], 95.00th=[ 76022], | 99.00th=[ 92799], 99.50th=[101188], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 95, max= 503, per=25.11%, avg=235.00, stdev=87.03, samples=48 iops : min= 5, max= 31, avg=14.00, stdev= 5.48, samples=48 write: IOPS=16, BW=257KiB/s (263kB/s)(6368KiB/24789msec); 0 zone resets clat (usec): min=1416, max=247436, avg=32254.56, stdev=33748.38 lat (usec): min=1416, max=247438, avg=32263.95, stdev=33743.57 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1893], 10.00th=[ 2802], 20.00th=[ 4817], | 30.00th=[ 7832], 40.00th=[ 12518], 50.00th=[ 21627], 60.00th=[ 30540], | 70.00th=[ 44303], 80.00th=[ 56361], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[240124], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 59, max= 638, per=25.91%, avg=255.19, stdev=105.27, samples=48 iops : min= 3, max= 39, avg=15.25, stdev= 6.63, samples=48 lat (usec) : 50=1.56%, 100=7.94%, 250=1.43%, 500=0.26%, 750=0.13% lat (msec) : 2=3.26%, 4=5.73%, 10=10.16%, 20=9.51%, 50=35.94% lat (msec) : 100=21.88%, 250=2.21% cpu : usr=0.04%, sys=6.20%, ctx=1442, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144846: Wed Aug 19 23:00:32 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(5744KiB/25570msec) clat (usec): min=36, max=315692, avg=38299.37, stdev=34330.63 lat (usec): min=36, max=315694, avg=38300.45, stdev=34330.62 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 881], | 30.00th=[ 22152], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[103285], | 99.00th=[166724], 99.50th=[168821], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 29, max= 480, per=23.65%, avg=221.32, stdev=104.79, samples=50 iops : min= 1, max= 30, avg=13.12, stdev= 6.60, samples=50 write: IOPS=15, BW=256KiB/s (262kB/s)(6544KiB/25570msec); 0 zone resets clat (usec): min=1431, max=256649, avg=28301.74, stdev=34323.87 lat (usec): min=1433, max=256651, avg=28303.67, stdev=34323.88 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 4686], | 30.00th=[ 7046], 40.00th=[ 10814], 50.00th=[ 15795], 60.00th=[ 22414], | 70.00th=[ 33424], 80.00th=[ 46924], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[177210], 99.50th=[229639], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 29, max= 539, per=25.49%, avg=251.12, stdev=111.93, samples=50 iops : min= 1, max= 33, avg=15.00, stdev= 6.94, samples=50 lat (usec) : 50=0.65%, 100=7.55%, 250=0.65%, 500=0.26%, 1000=0.26% lat (msec) : 2=3.12%, 4=5.73%, 10=11.46%, 20=12.37%, 50=35.81% lat (msec) : 100=18.10%, 250=3.78%, 500=0.26% cpu : usr=0.08%, sys=6.24%, ctx=1458, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144847: Wed Aug 19 23:00:32 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24800msec) clat (usec): min=39, max=145082, avg=34629.49, stdev=26719.66 lat (usec): min=40, max=145083, avg=34630.66, stdev=26719.81 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 5997], | 30.00th=[ 20579], 40.00th=[ 26084], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 82314], | 99.00th=[113771], 99.50th=[125305], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 29, max= 572, per=26.96%, avg=252.31, stdev=99.25, samples=48 iops : min= 1, max= 35, avg=15.08, stdev= 6.27, samples=48 write: IOPS=15, BW=243KiB/s (249kB/s)(6032KiB/24800msec); 0 zone resets clat (usec): min=1438, max=276670, avg=29155.02, stdev=36288.35 lat (usec): min=1440, max=276672, avg=29159.79, stdev=36291.40 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 2638], 20.00th=[ 4686], | 30.00th=[ 6194], 40.00th=[ 8717], 50.00th=[ 15795], 60.00th=[ 23200], | 70.00th=[ 33424], 80.00th=[ 49546], 90.00th=[ 71828], 95.00th=[ 93848], | 99.00th=[179307], 99.50th=[240124], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 472, per=24.40%, avg=240.37, stdev=96.87, samples=48 iops : min= 1, max= 29, avg=14.33, stdev= 6.09, samples=48 lat (usec) : 50=0.91%, 100=7.29%, 250=1.43%, 500=0.13%, 1000=0.39% lat (msec) : 2=2.73%, 4=6.12%, 10=12.63%, 20=10.29%, 50=35.03% lat (msec) : 100=20.31%, 250=2.60%, 500=0.13% cpu : usr=0.11%, sys=6.71%, ctx=1498, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144848: Wed Aug 19 23:00:32 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(6032KiB/24909msec) clat (usec): min=38, max=203036, avg=35197.52, stdev=28723.48 lat (usec): min=38, max=203038, avg=35200.86, stdev=28722.71 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 258], | 30.00th=[ 21103], 40.00th=[ 26346], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 58459], 90.00th=[ 69731], 95.00th=[ 81265], | 99.00th=[141558], 99.50th=[143655], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 510, per=26.06%, avg=243.96, stdev=85.10, samples=48 iops : min= 3, max= 31, avg=14.54, stdev= 5.37, samples=48 write: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24909msec); 0 zone resets clat (usec): min=1300, max=264552, avg=28886.31, stdev=31162.92 lat (usec): min=1302, max=264552, avg=28891.23, stdev=31165.62 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1745], 10.00th=[ 2638], 20.00th=[ 4228], | 30.00th=[ 7111], 40.00th=[ 11076], 50.00th=[ 18744], 60.00th=[ 25297], | 70.00th=[ 36439], 80.00th=[ 50594], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[119014], 99.50th=[191890], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 89, max= 509, per=25.36%, avg=249.76, stdev=98.06, samples=49 iops : min= 5, max= 31, avg=14.92, stdev= 6.13, samples=49 lat (usec) : 50=1.56%, 100=7.55%, 250=0.52%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=4.04%, 4=6.12%, 10=9.90%, 20=9.11%, 50=37.11% lat (msec) : 100=20.70%, 250=2.47%, 500=0.13% cpu : usr=0.07%, sys=6.23%, ctx=1480, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=937KiB/s (959kB/s), 225KiB/s-252KiB/s (230kB/s-258kB/s), io=23.4MiB (24.5MB), run=24789-25570msec WRITE: bw=986KiB/s (1009kB/s), 243KiB/s-257KiB/s (249kB/s-263kB/s), io=24.6MiB (25.8MB), run=24789-25570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144849: Wed Aug 19 23:01:06 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(5920KiB/58853msec) clat (msec): min=6, max=256, avg=33.26, stdev=34.20 lat (msec): min=6, max=256, avg=33.27, stdev=34.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 68], 95.00th=[ 94], | 99.00th=[ 205], 99.50th=[ 253], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 318, per=26.42%, avg=107.00, stdev=66.53, samples=108 iops : min= 1, max= 19, avg= 5.96, stdev= 4.14, samples=108 write: IOPS=6, BW=108KiB/s (111kB/s)(6368KiB/58853msec); 0 zone resets clat (msec): min=41, max=371, avg=115.56, stdev=57.23 lat (msec): min=41, max=371, avg=115.56, stdev=57.23 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 111], | 70.00th=[ 124], 80.00th=[ 144], 90.00th=[ 190], 95.00th=[ 239], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 223, per=25.91%, avg=110.38, stdev=47.61, samples=113 iops : min= 1, max= 13, avg= 6.18, stdev= 3.04, samples=113 lat (msec) : 10=3.39%, 20=18.88%, 50=18.23%, 100=31.77%, 250=25.26% lat (msec) : 500=2.47% cpu : usr=0.05%, sys=1.24%, ctx=1226, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144850: Wed Aug 19 23:01:06 2026 read: IOPS=6, BW=97.1KiB/s (99.5kB/s)(5744KiB/59125msec) clat (msec): min=7, max=218, avg=31.60, stdev=34.19 lat (msec): min=7, max=218, avg=31.60, stdev=34.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 68], 95.00th=[ 112], | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 29, max= 439, per=27.24%, avg=110.34, stdev=74.98, samples=103 iops : min= 1, max= 27, avg= 6.16, stdev= 4.70, samples=103 write: IOPS=6, BW=111KiB/s (113kB/s)(6544KiB/59125msec); 0 zone resets clat (msec): min=34, max=422, avg=116.48, stdev=59.48 lat (msec): min=34, max=422, avg=116.49, stdev=59.47 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 100], 60.00th=[ 109], | 70.00th=[ 127], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 236], | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 223, per=26.08%, avg=111.09, stdev=49.74, samples=116 iops : min= 1, max= 13, avg= 6.22, stdev= 3.18, samples=116 lat (msec) : 10=2.99%, 20=21.88%, 50=16.02%, 100=30.47%, 250=26.43% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.38%, ctx=1383, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144851: Wed Aug 19 23:01:06 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6256KiB/56915msec) clat (msec): min=6, max=269, avg=31.84, stdev=34.66 lat (msec): min=6, max=269, avg=31.85, stdev=34.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 74], 95.00th=[ 112], | 99.00th=[ 184], 99.50th=[ 249], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 384, per=29.92%, avg=121.18, stdev=82.36, samples=102 iops : min= 1, max= 24, avg= 6.84, stdev= 5.16, samples=102 write: IOPS=6, BW=106KiB/s (109kB/s)(6032KiB/56915msec); 0 zone resets clat (msec): min=39, max=378, avg=116.91, stdev=54.19 lat (msec): min=39, max=378, avg=116.92, stdev=54.19 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 116], | 70.00th=[ 129], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 224], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 192, per=25.30%, avg=107.77, stdev=45.79, samples=109 iops : min= 1, max= 12, avg= 6.00, stdev= 2.91, samples=109 lat (msec) : 10=4.04%, 20=23.05%, 50=17.45%, 100=26.82%, 250=27.08% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.40%, ctx=1392, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144852: Wed Aug 19 23:01:06 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6032KiB/56781msec) clat (msec): min=7, max=218, avg=31.72, stdev=29.81 lat (msec): min=7, max=218, avg=31.73, stdev=29.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 100], | 99.00th=[ 142], 99.50th=[ 192], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 349, per=29.02%, avg=117.55, stdev=72.16, samples=100 iops : min= 1, max= 21, avg= 6.63, stdev= 4.52, samples=100 write: IOPS=6, BW=110KiB/s (113kB/s)(6256KiB/56781msec); 0 zone resets clat (msec): min=41, max=328, avg=113.42, stdev=50.76 lat (msec): min=41, max=328, avg=113.43, stdev=50.76 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 112], | 70.00th=[ 125], 80.00th=[ 144], 90.00th=[ 190], 95.00th=[ 224], | 99.00th=[ 275], 99.50th=[ 317], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 224, per=26.04%, avg=110.95, stdev=47.37, samples=111 iops : min= 1, max= 14, avg= 6.20, stdev= 3.01, samples=111 lat (msec) : 10=2.86%, 20=21.48%, 50=17.45%, 100=31.12%, 250=26.17% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.41%, ctx=1292, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=405KiB/s (415kB/s), 97.1KiB/s-110KiB/s (99.5kB/s-113kB/s), io=23.4MiB (24.5MB), run=56781-59125msec WRITE: bw=426KiB/s (436kB/s), 106KiB/s-111KiB/s (109kB/s-113kB/s), io=24.6MiB (25.8MB), run=56781-59125msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144882: Wed Aug 19 23:01:21 2026 read: IOPS=1, BW=1152KiB/s (1180kB/s)(7168KiB/6221msec) clat (usec): min=469, max=3028.4k, avg=711340.73, stdev=1103252.33 lat (usec): min=471, max=3028.4k, avg=711342.16, stdev=1103252.39 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], | 20.00th=[ 750], 30.00th=[ 139461], 40.00th=[ 139461], | 50.00th=[ 189793], 60.00th=[ 421528], 70.00th=[ 421528], | 80.00th=[1199571], 90.00th=[3036677], 95.00th=[3036677], | 99.00th=[3036677], 99.50th=[3036677], 99.90th=[3036677], | 99.95th=[3036677], 99.99th=[3036677] bw ( KiB/s): min= 1965, max= 4047, per=79.23%, avg=2414.00, stdev=913.44, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=823KiB/s (843kB/s)(5120KiB/6221msec); 0 zone resets clat (msec): min=97, max=367, avg=213.63, stdev=117.96 lat (msec): min=98, max=367, avg=213.72, stdev=117.94 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1965, max= 3968, per=62.17%, avg=2652.00, stdev=1140.06, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.92%, ctx=547, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144883: Wed Aug 19 23:01:21 2026 read: IOPS=0, BW=305KiB/s (312kB/s)(2048KiB/6721msec) clat (msec): min=159, max=184, avg=171.59, stdev=17.79 lat (msec): min=159, max=184, avg=171.59, stdev=17.79 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 1420, max= 2039, per=56.76%, avg=1729.50, stdev=437.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1524KiB/s (1560kB/s)(10.0MiB/6721msec); 0 zone resets clat (msec): min=108, max=2348, avg=623.70, stdev=712.41 lat (msec): min=109, max=2349, avg=623.86, stdev=712.54 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 128], | 30.00th=[ 205], 40.00th=[ 232], 50.00th=[ 245], 60.00th=[ 372], | 70.00th=[ 558], 80.00th=[ 684], 90.00th=[ 1351], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1965, max= 4087, per=76.20%, avg=3250.60, stdev=1138.32, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=9.66%, ctx=206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144885: Wed Aug 19 23:01:21 2026 read: IOPS=1, BW=1139KiB/s (1167kB/s)(6144KiB/5393msec) clat (usec): min=598, max=246612, avg=120694.14, stdev=106392.43 lat (usec): min=599, max=246613, avg=120695.30, stdev=106392.38 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[119014], 50.00th=[119014], 60.00th=[127402], | 70.00th=[229639], 80.00th=[229639], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 1965, max= 8175, per=100.00%, avg=5070.00, stdev=4391.13, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1139KiB/s (1167kB/s)(6144KiB/5393msec); 0 zone resets clat (msec): min=147, max=2240, avg=771.89, stdev=918.67 lat (msec): min=147, max=2240, avg=771.97, stdev=918.69 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 226], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2043, max= 3930, per=63.41%, avg=2705.25, stdev=892.02, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=66.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.42%, ctx=178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144887: Wed Aug 19 23:01:21 2026 read: IOPS=0, BW=842KiB/s (862kB/s)(5120KiB/6084msec) clat (usec): min=901, max=2085.8k, avg=536328.70, stdev=871069.44 lat (usec): min=903, max=2085.8k, avg=536329.95, stdev=871069.42 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], | 20.00th=[ 906], 30.00th=[ 141558], 40.00th=[ 141558], | 50.00th=[ 221250], 60.00th=[ 221250], 70.00th=[ 231736], | 80.00th=[ 231736], 90.00th=[2088764], 95.00th=[2088764], | 99.00th=[2088764], 99.50th=[2088764], 99.90th=[2088764], | 99.95th=[2088764], 99.99th=[2088764] bw ( KiB/s): min= 3930, max= 4079, per=100.00%, avg=4004.50, stdev=105.36, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1178KiB/s (1206kB/s)(7168KiB/6084msec); 0 zone resets clat (msec): min=153, max=1555, avg=480.39, stdev=486.29 lat (msec): min=153, max=1555, avg=480.47, stdev=486.29 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 178], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 338], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 468], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1868, max= 4096, per=58.73%, avg=2505.50, stdev=1063.06, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.70%, ctx=461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3047KiB/s (3120kB/s), 305KiB/s-1152KiB/s (312kB/s-1180kB/s), io=20.0MiB (20.0MB), run=5393-6721msec WRITE: bw=4266KiB/s (4368kB/s), 823KiB/s-1524KiB/s (843kB/s-1560kB/s), io=28.0MiB (29.4MB), run=5393-6721msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Wed Aug 19 23:01:22 2026 read: IOPS=1, BW=1030KiB/s (1054kB/s)(7168KiB/6961msec) clat (msec): min=47, max=2040, avg=784.11, stdev=739.22 lat (msec): min=47, max=2040, avg=784.11, stdev=739.22 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 49], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 885], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1150], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 2035, max= 3828, per=84.51%, avg=2486.25, stdev=894.51, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=736KiB/s (753kB/s)(5120KiB/6961msec); 0 zone resets clat (msec): min=103, max=511, avg=246.19, stdev=165.75 lat (msec): min=103, max=511, avg=246.26, stdev=165.74 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2039, max= 4087, per=74.38%, avg=3063.00, stdev=1448.15, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=16.67%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.36%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Wed Aug 19 23:01:22 2026 read: IOPS=0, BW=303KiB/s (311kB/s)(2048KiB/6749msec) clat (msec): min=118, max=172, avg=145.58, stdev=37.92 lat (msec): min=118, max=172, avg=145.58, stdev=37.92 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1456, max= 2023, per=59.13%, avg=1739.50, stdev=400.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1517KiB/s (1554kB/s)(10.0MiB/6749msec); 0 zone resets clat (msec): min=137, max=2407, avg=638.89, stdev=724.05 lat (msec): min=137, max=2407, avg=639.00, stdev=724.06 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 144], | 30.00th=[ 251], 40.00th=[ 255], 50.00th=[ 317], 60.00th=[ 359], | 70.00th=[ 542], 80.00th=[ 567], 90.00th=[ 1418], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1914, max= 4079, per=57.15%, avg=2353.50, stdev=846.67, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.62%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144884: Wed Aug 19 23:01:22 2026 read: IOPS=0, BW=937KiB/s (960kB/s)(6144KiB/6556msec) clat (msec): min=77, max=207, avg=150.90, stdev=49.10 lat (msec): min=77, max=207, avg=150.90, stdev=49.10 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 161], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2023, max= 4047, per=86.23%, avg=2537.00, stdev=1006.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=937KiB/s (960kB/s)(6144KiB/6556msec); 0 zone resets clat (msec): min=126, max=2237, avg=912.64, stdev=871.11 lat (msec): min=126, max=2237, avg=912.73, stdev=871.12 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 693], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1505, max= 2039, per=46.80%, avg=1927.40, stdev=236.22, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144886: Wed Aug 19 23:01:22 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(5120KiB/6848msec) clat (msec): min=113, max=441, avg=251.15, stdev=155.67 lat (msec): min=113, max=441, avg=251.15, stdev=155.67 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2023, max= 3828, per=89.39%, avg=2630.00, stdev=1037.53, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1047KiB/s (1072kB/s)(7168KiB/6848msec); 0 zone resets clat (msec): min=139, max=1793, avg=788.57, stdev=681.03 lat (msec): min=139, max=1793, avg=788.72, stdev=681.11 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 226], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 600], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 1670], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 2031, max= 4087, per=59.42%, avg=2447.00, stdev=916.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.37%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2942KiB/s (3013kB/s), 303KiB/s-1030KiB/s (311kB/s-1054kB/s), io=20.0MiB (20.0MB), run=6556-6961msec WRITE: bw=4119KiB/s (4218kB/s), 736KiB/s-1517KiB/s (753kB/s-1554kB/s), io=28.0MiB (29.4MB), run=6556-6961msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144897: Wed Aug 19 23:01:35 2026 read: IOPS=1, BW=4737KiB/s (4851kB/s)(12.0MiB/2594msec) clat (msec): min=701, max=920, avg=831.95, stdev=115.22 lat (msec): min=701, max=920, avg=831.95, stdev=115.22 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8047, max= 8159, per=100.00%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.93%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Wed Aug 19 23:01:35 2026 read: IOPS=0, BW=1307KiB/s (1338kB/s)(4096KiB/3134msec) clat (nsec): min=1339.4M, max=1339.4M, avg=1339434775.00, stdev= 0.00 lat (nsec): min=1339.4M, max=1339.4M, avg=1339436949.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2614KiB/s (2677kB/s)(8192KiB/3134msec); 0 zone resets clat (msec): min=721, max=911, avg=816.35, stdev=134.72 lat (msec): min=721, max=912, avg=816.78, stdev=134.70 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8126, max= 8126, per=77.72%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.21%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Wed Aug 19 23:01:35 2026 write: IOPS=1, BW=4106KiB/s (4204kB/s)(12.0MiB/2993msec); 0 zone resets clat (msec): min=319, max=1299, avg=937.67, stdev=537.56 lat (msec): min=320, max=1299, avg=938.10, stdev=537.56 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8078, max= 8078, per=77.26%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.05%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Wed Aug 19 23:01:35 2026 write: IOPS=1, BW=4247KiB/s (4349kB/s)(12.0MiB/2893msec); 0 zone resets clat (msec): min=604, max=1176, avg=912.17, stdev=288.93 lat (msec): min=604, max=1177, avg=912.56, stdev=288.95 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8078, max= 8126, per=77.49%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.29%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5228KiB/s (5353kB/s), 1307KiB/s-4737KiB/s (1338kB/s-4851kB/s), io=16.0MiB (16.8MB), run=2594-3134msec WRITE: bw=10.2MiB/s (10.7MB/s), 2614KiB/s-4247KiB/s (2677kB/s-4349kB/s), io=32.0MiB (33.6MB), run=2893-3134msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144895: Wed Aug 19 23:01:35 2026 read: IOPS=1, BW=4861KiB/s (4977kB/s)(12.0MiB/2528msec) clat (msec): min=751, max=860, avg=807.45, stdev=54.55 lat (msec): min=751, max=860, avg=807.45, stdev=54.55 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=17.89%, ctx=506, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144896: Wed Aug 19 23:01:35 2026 read: IOPS=0, BW=1390KiB/s (1423kB/s)(4096KiB/2947msec) clat (nsec): min=834299k, max=834299k, avg=834299475.00, stdev= 0.00 lat (nsec): min=834301k, max=834301k, avg=834300965.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2780KiB/s (2846kB/s)(8192KiB/2947msec); 0 zone resets clat (msec): min=567, max=1456, avg=1012.09, stdev=628.67 lat (msec): min=568, max=1456, avg=1012.50, stdev=628.47 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8094, max= 8094, per=91.57%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.25%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Wed Aug 19 23:01:35 2026 write: IOPS=0, BW=3315KiB/s (3394kB/s)(12.0MiB/3707msec); 0 zone resets clat (msec): min=239, max=2254, avg=1182.29, stdev=1013.62 lat (msec): min=239, max=2255, avg=1183.11, stdev=1014.21 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8192, per=92.13%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.59%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Wed Aug 19 23:01:35 2026 write: IOPS=1, BW=4546KiB/s (4655kB/s)(12.0MiB/2703msec); 0 zone resets clat (msec): min=490, max=1496, avg=863.96, stdev=550.82 lat (msec): min=491, max=1497, avg=864.56, stdev=550.93 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8094, max= 8126, per=91.75%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.37%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5560KiB/s (5693kB/s), 1390KiB/s-4861KiB/s (1423kB/s-4977kB/s), io=16.0MiB (16.8MB), run=2528-2947msec WRITE: bw=8839KiB/s (9052kB/s), 2780KiB/s-4546KiB/s (2846kB/s-4655kB/s), io=32.0MiB (33.6MB), run=2703-3707msec