== sanity test 398b: DIO and buffer IO race ============== 09:44:04 (1787838244) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.40637 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144747: Thu Aug 27 09:46:26 2026 read: IOPS=12, BW=49.5KiB/s (50.6kB/s)(5992KiB/121162msec) clat (usec): min=34, max=690382, avg=39955.18, stdev=40058.10 lat (usec): min=34, max=690384, avg=39956.74, stdev=40058.06 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 1450], 20.00th=[ 18220], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[162530], 99.50th=[233833], 99.90th=[591397], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=49.50, stdev=20.58, samples=236 iops : min= 1, max= 29, avg=11.75, stdev= 5.17, samples=236 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6296KiB/121162msec); 0 zone resets clat (usec): min=789, max=312683, avg=38638.78, stdev=38766.11 lat (usec): min=791, max=312684, avg=38640.41, stdev=38766.11 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1483], 20.00th=[ 3884], | 30.00th=[ 7963], 40.00th=[ 19268], 50.00th=[ 29230], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[162530], 99.50th=[193987], 99.90th=[229639], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 111, per=25.48%, avg=51.97, stdev=21.53, samples=236 iops : min= 1, max= 27, avg=12.37, stdev= 5.44, samples=236 lat (usec) : 50=0.94%, 100=3.68%, 250=0.13%, 500=0.10%, 1000=0.29% lat (msec) : 2=6.51%, 4=3.78%, 10=6.51%, 20=10.35%, 50=38.61% lat (msec) : 100=23.40%, 250=5.44%, 500=0.20%, 750=0.07% cpu : usr=0.07%, sys=4.69%, ctx=6100, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144748: Thu Aug 27 09:46:26 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(5940KiB/122946msec) clat (usec): min=27, max=706041, avg=40501.15, stdev=34957.94 lat (usec): min=27, max=706045, avg=40502.44, stdev=34958.09 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 147], 20.00th=[ 17957], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[152044], 99.50th=[179307], 99.90th=[217056], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 103, per=24.91%, avg=48.58, stdev=20.30, samples=237 iops : min= 1, max= 25, avg=11.51, stdev= 5.12, samples=237 write: IOPS=12, BW=51.6KiB/s (52.9kB/s)(6348KiB/122946msec); 0 zone resets clat (usec): min=904, max=590795, avg=39200.28, stdev=44782.88 lat (usec): min=905, max=590796, avg=39203.13, stdev=44783.98 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1336], 20.00th=[ 3425], | 30.00th=[ 7701], 40.00th=[ 17171], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[179307], 99.50th=[229639], 99.90th=[530580], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 148, per=25.20%, avg=51.41, stdev=22.01, samples=239 iops : min= 1, max= 37, avg=12.22, stdev= 5.52, samples=239 lat (usec) : 50=0.88%, 100=3.71%, 250=0.42%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=6.97%, 4=4.69%, 10=5.99%, 20=10.90%, 50=36.13% lat (msec) : 100=23.96%, 250=5.76%, 500=0.13%, 750=0.10% cpu : usr=0.07%, sys=4.86%, ctx=6284, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144749: Thu Aug 27 09:46:26 2026 read: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6028KiB/119691msec) clat (usec): min=28, max=334200, avg=38334.15, stdev=30564.62 lat (usec): min=29, max=334202, avg=38336.22, stdev=30564.20 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 88], 20.00th=[ 16319], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[133694], 99.50th=[158335], 99.90th=[274727], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 135, per=25.93%, avg=50.56, stdev=21.96, samples=233 iops : min= 1, max= 33, avg=12.01, stdev= 5.50, samples=233 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6260KiB/119691msec); 0 zone resets clat (usec): min=734, max=900207, avg=39249.97, stdev=46384.19 lat (usec): min=735, max=900209, avg=39261.24, stdev=46386.83 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1254], 20.00th=[ 2933], | 30.00th=[ 6915], 40.00th=[ 17171], 50.00th=[ 28181], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[181404], 99.50th=[206570], 99.90th=[325059], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 110, per=25.71%, avg=52.44, stdev=21.87, samples=233 iops : min= 1, max= 27, avg=12.48, stdev= 5.46, samples=233 lat (usec) : 50=1.01%, 100=4.07%, 250=0.46%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=8.20%, 4=3.74%, 10=6.09%, 20=10.87%, 50=35.87% lat (msec) : 100=23.18%, 250=5.92%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.65%, ctx=6138, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144750: Thu Aug 27 09:46:26 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6052KiB/121219msec) clat (usec): min=32, max=382356, avg=38737.89, stdev=30563.47 lat (usec): min=32, max=382358, avg=38739.05, stdev=30563.50 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 70], 20.00th=[ 16909], | 30.00th=[ 22676], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[131597], 99.50th=[175113], 99.90th=[278922], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 123, per=25.77%, avg=50.24, stdev=21.69, samples=235 iops : min= 1, max= 30, avg=11.93, stdev= 5.47, samples=235 write: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6236KiB/121219msec); 0 zone resets clat (usec): min=745, max=859268, avg=39836.30, stdev=48148.67 lat (usec): min=747, max=859272, avg=39837.81, stdev=48148.71 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1336], 20.00th=[ 3359], | 30.00th=[ 7570], 40.00th=[ 17695], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[119014], | 99.00th=[189793], 99.50th=[242222], 99.90th=[438305], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 118, per=25.25%, avg=51.50, stdev=20.05, samples=236 iops : min= 1, max= 29, avg=12.25, stdev= 5.05, samples=236 lat (usec) : 50=1.24%, 100=4.23%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.19%, 4=4.07%, 10=6.18%, 20=9.70%, 50=38.18% lat (msec) : 100=22.72%, 250=5.60%, 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=4.83%, ctx=6185, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=195KiB/s (200kB/s), 48.3KiB/s-50.4KiB/s (49.5kB/s-51.6kB/s), io=23.4MiB (24.6MB), run=119691-122946msec WRITE: bw=204KiB/s (209kB/s), 51.4KiB/s-52.3KiB/s (52.7kB/s-53.6kB/s), io=24.6MiB (25.7MB), run=119691-122946msec fio: pid=144746, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144743: Thu Aug 27 09:48:42 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5992KiB/259185msec) clat (msec): min=5, max=733, avg=37.61, stdev=38.38 lat (msec): min=5, max=733, avg=37.61, stdev=38.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 99], | 99.00th=[ 188], 99.50th=[ 236], 99.90th=[ 334], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 88, per=31.63%, avg=24.99, stdev=17.27, samples=464 iops : min= 1, max= 22, avg= 5.63, stdev= 4.35, samples=464 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6296KiB/259185msec); 0 zone resets clat (msec): min=32, max=619, avg=128.59, stdev=66.97 lat (msec): min=32, max=619, avg=128.59, stdev=66.97 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 380], 99.50th=[ 401], 99.90th=[ 542], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 56, per=28.76%, avg=24.16, stdev=11.12, samples=503 iops : min= 1, max= 14, avg= 5.42, stdev= 2.85, samples=503 lat (msec) : 10=2.64%, 20=12.92%, 50=25.03%, 100=26.76%, 250=29.85% lat (msec) : 500=2.70%, 750=0.10% cpu : usr=0.04%, sys=1.18%, ctx=5738, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144744: Thu Aug 27 09:48:42 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(5940KiB/259379msec) clat (msec): min=5, max=764, avg=36.70, stdev=37.76 lat (msec): min=5, max=764, avg=36.71, stdev=37.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 167], 99.50th=[ 203], 99.90th=[ 401], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 102, per=32.80%, avg=25.91, stdev=17.35, samples=443 iops : min= 1, max= 25, avg= 5.86, stdev= 4.39, samples=443 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6348KiB/259379msec); 0 zone resets clat (msec): min=31, max=621, avg=128.80, stdev=64.83 lat (msec): min=31, max=621, avg=128.80, stdev=64.83 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 114], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 351], 99.50th=[ 397], 99.90th=[ 600], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 64, per=28.62%, avg=24.04, stdev=11.19, samples=509 iops : min= 1, max= 16, avg= 5.39, stdev= 2.85, samples=509 lat (msec) : 10=3.19%, 20=12.70%, 50=24.48%, 100=26.07%, 250=30.89% lat (msec) : 500=2.57%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5706, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144745: Thu Aug 27 09:48:42 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6028KiB/258775msec) clat (msec): min=5, max=509, avg=37.16, stdev=34.70 lat (msec): min=5, max=509, avg=37.16, stdev=34.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 334], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 111, per=31.88%, avg=25.19, stdev=17.05, samples=463 iops : min= 1, max= 27, avg= 5.68, stdev= 4.30, samples=463 write: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6260KiB/258775msec); 0 zone resets clat (msec): min=34, max=871, avg=129.26, stdev=68.17 lat (msec): min=34, max=871, avg=129.26, stdev=68.17 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 176], 90.00th=[ 218], 95.00th=[ 249], | 99.00th=[ 347], 99.50th=[ 409], 99.90th=[ 600], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 64, per=28.89%, avg=24.27, stdev=11.28, samples=498 iops : min= 1, max= 16, avg= 5.45, stdev= 2.88, samples=498 lat (msec) : 10=2.51%, 20=13.61%, 50=24.38%, 100=26.92%, 250=29.92% lat (msec) : 500=2.54%, 750=0.10%, 1000=0.03% cpu : usr=0.03%, sys=1.17%, ctx=5754, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144746: Thu Aug 27 09:48:42 2026 read: IOPS=4, BW=17.8KiB/s (18.2kB/s)(2772KiB/155807msec) clat (msec): min=6, max=512, avg=49.90, stdev=47.44 lat (msec): min=6, max=512, avg=49.90, stdev=47.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 58], 80.00th=[ 75], 90.00th=[ 100], 95.00th=[ 126], | 99.00th=[ 230], 99.50th=[ 262], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 95, per=26.39%, avg=20.85, stdev=14.98, samples=254 iops : min= 1, max= 23, avg= 4.57, stdev= 3.77, samples=254 write: IOPS=4, BW=18.5KiB/s (18.0kB/s)(2888KiB/155807msec); 0 zone resets clat (msec): min=46, max=860, avg=167.30, stdev=80.51 lat (msec): min=46, max=860, avg=167.31, stdev=80.51 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 102], | 30.00th=[ 117], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 178], | 70.00th=[ 197], 80.00th=[ 224], 90.00th=[ 264], 95.00th=[ 300], | 99.00th=[ 447], 99.50th=[ 493], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 47, per=22.06%, avg=18.53, stdev= 9.01, samples=296 iops : min= 1, max= 11, avg= 3.98, stdev= 2.29, samples=296 lat (msec) : 10=1.77%, 20=10.45%, 50=19.77%, 100=21.82%, 250=39.27% lat (msec) : 500=6.57%, 750=0.21%, 1000=0.07% cpu : usr=0.02%, sys=0.78%, ctx=2035, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=694,722,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=79.9KiB/s (81.8kB/s), 17.8KiB/s-23.3KiB/s (18.2kB/s-23.9kB/s), io=20.2MiB (21.2MB), run=155807-259379msec WRITE: bw=84.0KiB/s (86.0kB/s), 18.5KiB/s-24.5KiB/s (18.0kB/s-25.1kB/s), io=21.3MiB (22.3MB), run=155807-259379msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Thu Aug 27 09:49:22 2026 read: IOPS=12, BW=206KiB/s (210kB/s)(5920KiB/28801msec) clat (usec): min=28, max=174106, avg=40325.61, stdev=31452.47 lat (usec): min=29, max=174107, avg=40326.95, stdev=31452.50 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 5276], | 30.00th=[ 26084], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[100140], | 99.00th=[149947], 99.50th=[166724], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 381, per=24.73%, avg=202.07, stdev=86.68, samples=56 iops : min= 1, max= 23, avg=11.88, stdev= 5.51, samples=56 write: IOPS=13, BW=221KiB/s (226kB/s)(6368KiB/28801msec); 0 zone resets clat (usec): min=1297, max=316908, avg=34378.00, stdev=40190.39 lat (usec): min=1299, max=316910, avg=34380.19, stdev=40190.32 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1762], 10.00th=[ 2311], 20.00th=[ 4359], | 30.00th=[ 6849], 40.00th=[ 11207], 50.00th=[ 19530], 60.00th=[ 30016], | 70.00th=[ 43254], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[108528], | 99.00th=[177210], 99.50th=[233833], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 508, per=25.54%, avg=219.64, stdev=107.14, samples=56 iops : min= 1, max= 31, avg=12.98, stdev= 6.78, samples=56 lat (usec) : 50=1.30%, 100=6.64%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=4.43%, 4=5.99%, 10=9.90%, 20=8.07%, 50=33.20% lat (msec) : 100=23.83%, 250=5.47%, 500=0.13% cpu : usr=0.08%, sys=5.02%, ctx=1317, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144803: Thu Aug 27 09:49:22 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5744KiB/27764msec) clat (usec): min=39, max=258940, avg=43221.59, stdev=34544.81 lat (usec): min=39, max=258942, avg=43222.96, stdev=34544.88 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 16450], | 30.00th=[ 25035], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 68682], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[143655], 99.50th=[221250], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 50, max= 445, per=25.22%, avg=206.06, stdev=79.65, samples=54 iops : min= 3, max= 27, avg=12.13, stdev= 4.98, samples=54 write: IOPS=14, BW=236KiB/s (241kB/s)(6544KiB/27764msec); 0 zone resets clat (usec): min=1429, max=191694, avg=29341.52, stdev=31931.71 lat (usec): min=1431, max=191696, avg=29343.71, stdev=31931.69 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1696], 10.00th=[ 1942], 20.00th=[ 4113], | 30.00th=[ 7046], 40.00th=[ 10945], 50.00th=[ 16319], 60.00th=[ 25560], | 70.00th=[ 37487], 80.00th=[ 51643], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[128451], 99.50th=[139461], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 508, per=27.27%, avg=234.56, stdev=106.78, samples=54 iops : min= 1, max= 31, avg=13.93, stdev= 6.78, samples=54 lat (usec) : 50=1.04%, 100=5.73%, 250=0.65%, 500=0.13% lat (msec) : 2=5.99%, 4=4.56%, 10=9.77%, 20=12.63%, 50=31.90% lat (msec) : 100=22.79%, 250=4.69%, 500=0.13% cpu : usr=0.08%, sys=5.36%, ctx=1419, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Thu Aug 27 09:49:22 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6256KiB/29301msec) clat (usec): min=27, max=268886, avg=41537.27, stdev=35373.61 lat (usec): min=27, max=268887, avg=41538.69, stdev=35373.67 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 262], | 30.00th=[ 25035], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[168821], 99.50th=[248513], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 475, per=26.15%, avg=213.65, stdev=91.16, samples=57 iops : min= 1, max= 29, avg=12.61, stdev= 5.79, samples=57 write: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29301msec); 0 zone resets clat (usec): min=1384, max=344381, avg=33896.87, stdev=42107.18 lat (usec): min=1386, max=344384, avg=33899.12, stdev=42107.34 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1745], 10.00th=[ 2114], 20.00th=[ 4948], | 30.00th=[ 7439], 40.00th=[ 11994], 50.00th=[ 19268], 60.00th=[ 30278], | 70.00th=[ 40109], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[109577], | 99.00th=[191890], 99.50th=[308282], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 63, max= 477, per=23.49%, avg=201.98, stdev=95.42, samples=57 iops : min= 3, max= 29, avg=11.88, stdev= 6.02, samples=57 lat (usec) : 50=0.78%, 100=8.85%, 250=0.52%, 500=0.39%, 750=0.13% lat (msec) : 2=4.82%, 4=3.91%, 10=9.77%, 20=8.59%, 50=32.68% lat (msec) : 100=24.87%, 250=4.30%, 500=0.39% cpu : usr=0.02%, sys=5.21%, ctx=1411, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Thu Aug 27 09:49:22 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6032KiB/27706msec) clat (usec): min=29, max=194699, avg=39818.96, stdev=31801.89 lat (usec): min=29, max=194700, avg=39820.34, stdev=31801.84 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 429], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[166724], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 61, max= 472, per=26.35%, avg=215.28, stdev=85.12, samples=54 iops : min= 3, max= 29, avg=12.70, stdev= 5.42, samples=54 write: IOPS=14, BW=226KiB/s (231kB/s)(6256KiB/27706msec); 0 zone resets clat (usec): min=1301, max=192202, avg=32298.19, stdev=36073.24 lat (usec): min=1302, max=192205, avg=32300.65, stdev=36073.18 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1680], 10.00th=[ 1860], 20.00th=[ 3916], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[ 19006], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[108528], | 99.00th=[170918], 99.50th=[185598], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 572, per=26.17%, avg=225.04, stdev=100.73, samples=54 iops : min= 1, max= 35, avg=13.30, stdev= 6.35, samples=54 lat (usec) : 50=1.43%, 100=7.55%, 250=0.65%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=5.99%, 4=4.43%, 10=10.55%, 20=6.90%, 50=34.38% lat (msec) : 100=22.14%, 250=5.34% cpu : usr=0.07%, sys=4.95%, ctx=1385, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=817KiB/s (837kB/s), 206KiB/s-218KiB/s (210kB/s-223kB/s), io=23.4MiB (24.5MB), run=27706-29301msec WRITE: bw=860KiB/s (881kB/s), 206KiB/s-236KiB/s (211kB/s-241kB/s), io=24.6MiB (25.8MB), run=27706-29301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Thu Aug 27 09:50:07 2026 read: IOPS=5, BW=82.1KiB/s (84.1kB/s)(5920KiB/72118msec) clat (msec): min=5, max=333, avg=42.07, stdev=48.81 lat (msec): min=5, max=333, avg=42.07, stdev=48.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 92], 95.00th=[ 146], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 379, per=27.62%, avg=91.41, stdev=59.31, samples=127 iops : min= 1, max= 23, avg= 4.90, stdev= 3.77, samples=127 write: IOPS=5, BW=88.3KiB/s (90.4kB/s)(6368KiB/72118msec); 0 zone resets clat (msec): min=49, max=423, avg=141.89, stdev=60.05 lat (msec): min=49, max=423, avg=141.89, stdev=60.05 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 257], | 99.00th=[ 347], 99.50th=[ 409], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 160, per=25.58%, avg=89.03, stdev=36.72, samples=140 iops : min= 1, max= 10, avg= 4.74, stdev= 2.36, samples=140 lat (msec) : 10=2.21%, 20=14.06%, 50=22.66%, 100=18.75%, 250=38.80% lat (msec) : 500=3.52% cpu : usr=0.03%, sys=1.08%, ctx=1261, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144808: Thu Aug 27 09:50:07 2026 read: IOPS=4, BW=79.5KiB/s (81.4kB/s)(5744KiB/72240msec) clat (msec): min=6, max=345, avg=39.86, stdev=44.90 lat (msec): min=6, max=345, avg=39.86, stdev=44.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 87], 95.00th=[ 134], | 99.00th=[ 236], 99.50th=[ 330], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 21, max= 287, per=27.96%, avg=92.55, stdev=58.98, samples=121 iops : min= 1, max= 17, avg= 5.02, stdev= 3.74, samples=121 write: IOPS=5, BW=90.6KiB/s (92.8kB/s)(6544KiB/72240msec); 0 zone resets clat (msec): min=29, max=428, avg=141.48, stdev=60.66 lat (msec): min=29, max=428, avg=141.48, stdev=60.66 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 71], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 215], 95.00th=[ 264], | 99.00th=[ 351], 99.50th=[ 363], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 21, max= 191, per=26.24%, avg=91.30, stdev=36.13, samples=140 iops : min= 1, max= 11, avg= 4.91, stdev= 2.31, samples=140 lat (msec) : 10=2.99%, 20=14.45%, 50=20.44%, 100=17.97%, 250=40.62% lat (msec) : 500=3.52% cpu : usr=0.04%, sys=1.06%, ctx=1216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144809: Thu Aug 27 09:50:07 2026 read: IOPS=5, BW=89.4KiB/s (91.5kB/s)(6256KiB/69989msec) clat (msec): min=7, max=289, avg=36.32, stdev=35.39 lat (msec): min=7, max=289, avg=36.32, stdev=35.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 104], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 320, per=30.10%, avg=99.62, stdev=66.44, samples=124 iops : min= 1, max= 20, avg= 5.40, stdev= 4.19, samples=124 write: IOPS=5, BW=86.2KiB/s (88.3kB/s)(6032KiB/69989msec); 0 zone resets clat (msec): min=38, max=528, avg=147.75, stdev=68.90 lat (msec): min=38, max=528, avg=147.76, stdev=68.89 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 96], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 296], | 99.00th=[ 380], 99.50th=[ 464], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 31, max= 190, per=25.24%, avg=87.83, stdev=33.65, samples=134 iops : min= 1, max= 11, avg= 4.66, stdev= 2.15, samples=134 lat (msec) : 10=2.21%, 20=14.84%, 50=25.91%, 100=16.80%, 250=36.46% lat (msec) : 500=3.65%, 750=0.13% cpu : usr=0.04%, sys=1.14%, ctx=1281, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144810: Thu Aug 27 09:50:07 2026 read: IOPS=5, BW=84.3KiB/s (86.3kB/s)(6032KiB/71548msec) clat (msec): min=7, max=276, avg=37.41, stdev=35.17 lat (msec): min=7, max=276, avg=37.41, stdev=35.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 205], 99.50th=[ 220], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 351, per=29.43%, avg=97.43, stdev=62.40, samples=121 iops : min= 1, max= 21, avg= 5.29, stdev= 3.95, samples=121 write: IOPS=5, BW=87.4KiB/s (89.5kB/s)(6256KiB/71548msec); 0 zone resets clat (msec): min=44, max=513, avg=146.75, stdev=67.68 lat (msec): min=44, max=513, avg=146.75, stdev=67.68 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 409], 99.50th=[ 489], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 30, max= 160, per=25.41%, avg=88.44, stdev=35.86, samples=139 iops : min= 1, max= 10, avg= 4.73, stdev= 2.29, samples=139 lat (msec) : 10=1.56%, 20=14.06%, 50=25.39%, 100=17.84%, 250=37.63% lat (msec) : 500=3.39%, 750=0.13% cpu : usr=0.05%, sys=1.07%, ctx=1280, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=332KiB/s (340kB/s), 79.5KiB/s-89.4KiB/s (81.4kB/s-91.5kB/s), io=23.4MiB (24.5MB), run=69989-72240msec WRITE: bw=349KiB/s (357kB/s), 86.2KiB/s-90.6KiB/s (88.3kB/s-92.8kB/s), io=24.6MiB (25.8MB), run=69989-72240msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144831: Thu Aug 27 09:50:22 2026 read: IOPS=1, BW=1402KiB/s (1436kB/s)(7168KiB/5113msec) clat (msec): min=122, max=2598, avg=577.67, stdev=894.97 lat (msec): min=122, max=2598, avg=577.67, stdev=894.97 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 169], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 271], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 368], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2015, max= 2832, per=62.08%, avg=2233.50, stdev=399.24, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=0, BW=1001KiB/s (1025kB/s)(5120KiB/5113msec); 0 zone resets clat (msec): min=106, max=316, avg=212.81, stdev=92.30 lat (msec): min=107, max=316, avg=213.61, stdev=91.86 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2015, max= 4096, per=53.92%, avg=2716.67, stdev=1194.60, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.64%, ctx=588, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144832: Thu Aug 27 09:50:22 2026 read: IOPS=0, BW=377KiB/s (386kB/s)(2048KiB/5431msec) clat (msec): min=51, max=220, avg=135.90, stdev=119.86 lat (msec): min=51, max=220, avg=135.91, stdev=119.86 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 52], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1426, max= 2015, per=47.82%, avg=1720.50, stdev=416.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1885KiB/s (1931kB/s)(10.0MiB/5431msec); 0 zone resets clat (msec): min=53, max=2412, avg=515.22, stdev=698.91 lat (msec): min=53, max=2413, avg=515.45, stdev=698.99 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 123], | 30.00th=[ 144], 40.00th=[ 171], 50.00th=[ 228], 60.00th=[ 372], | 70.00th=[ 376], 80.00th=[ 535], 90.00th=[ 735], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2015, max= 6144, per=72.89%, avg=3672.00, stdev=2245.25, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.96%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144833: Thu Aug 27 09:50:22 2026 read: IOPS=1, BW=1129KiB/s (1156kB/s)(6144KiB/5442msec) clat (usec): min=1262, max=324290, avg=170338.02, stdev=140128.43 lat (usec): min=1263, max=324291, avg=170340.03, stdev=140127.43 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1270], 10.00th=[ 1270], 20.00th=[ 8586], | 30.00th=[ 8586], 40.00th=[162530], 50.00th=[162530], 60.00th=[225444], | 70.00th=[299893], 80.00th=[299893], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2043, max= 4096, per=94.22%, avg=3390.00, stdev=1166.99, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1129KiB/s (1156kB/s)(6144KiB/5442msec); 0 zone resets clat (msec): min=169, max=3195, avg=736.21, stdev=1207.08 lat (msec): min=169, max=3195, avg=736.38, stdev=1207.17 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 296], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2015, max= 2786, per=43.39%, avg=2186.20, stdev=335.54, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 2=8.33%, 10=8.33%, 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.74%, ctx=297, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Thu Aug 27 09:50:22 2026 read: IOPS=0, BW=900KiB/s (921kB/s)(5120KiB/5691msec) clat (usec): min=385, max=205375, avg=81844.21, stdev=111334.55 lat (usec): min=385, max=205376, avg=81845.08, stdev=111334.34 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 635], 60.00th=[ 635], | 70.00th=[202376], 80.00th=[202376], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 2015, max= 6144, per=100.00%, avg=4079.50, stdev=2919.64, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1260KiB/s (1290kB/s)(7168KiB/5691msec); 0 zone resets clat (msec): min=140, max=2996, avg=754.17, stdev=1001.04 lat (msec): min=140, max=2996, avg=754.27, stdev=1001.03 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 266], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 435], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 609], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1436, max= 4079, per=47.50%, avg=2393.25, stdev=1158.13, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.05%, ctx=164, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3599KiB/s (3685kB/s), 377KiB/s-1402KiB/s (386kB/s-1436kB/s), io=20.0MiB (20.0MB), run=5113-5691msec WRITE: bw=5038KiB/s (5159kB/s), 1001KiB/s-1885KiB/s (1025kB/s-1931kB/s), io=28.0MiB (29.4MB), run=5113-5691msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Thu Aug 27 09:50:23 2026 read: IOPS=1, BW=1521KiB/s (1557kB/s)(7168KiB/4714msec) clat (msec): min=74, max=1774, avg=387.84, stdev=616.43 lat (msec): min=74, max=1774, avg=387.84, stdev=616.43 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 178], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 296], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 2043, max= 4668, per=100.00%, avg=3494.00, stdev=1334.24, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1086KiB/s (1112kB/s)(5120KiB/4714msec); 0 zone resets clat (msec): min=188, max=764, avg=368.23, stdev=227.83 lat (msec): min=190, max=765, avg=368.58, stdev=227.61 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1885, max= 4031, per=65.64%, avg=2653.00, stdev=1195.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.56%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144827: Thu Aug 27 09:50:23 2026 read: IOPS=0, BW=289KiB/s (296kB/s)(2048KiB/7092msec) clat (msec): min=203, max=270, avg=237.16, stdev=47.01 lat (msec): min=204, max=270, avg=237.36, stdev=46.74 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1456, max= 2043, per=60.60%, avg=1749.50, stdev=415.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1444KiB/s (1479kB/s)(10.0MiB/7092msec); 0 zone resets clat (msec): min=108, max=3510, avg=638.95, stdev=1030.25 lat (msec): min=109, max=3510, avg=639.06, stdev=1030.25 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 192], | 30.00th=[ 224], 40.00th=[ 234], 50.00th=[ 245], 60.00th=[ 255], | 70.00th=[ 305], 80.00th=[ 464], 90.00th=[ 852], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1456, max= 3938, per=62.91%, avg=2543.00, stdev=1041.39, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.57%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144828: Thu Aug 27 09:50:23 2026 read: IOPS=1, BW=1071KiB/s (1097kB/s)(6144KiB/5736msec) clat (msec): min=66, max=304, avg=173.02, stdev=97.03 lat (msec): min=66, max=304, avg=173.02, stdev=97.03 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 142], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1885, max= 4087, per=86.42%, avg=2495.00, stdev=1063.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1071KiB/s (1097kB/s)(6144KiB/5736msec); 0 zone resets clat (msec): min=289, max=2850, avg=772.87, stdev=1020.53 lat (msec): min=289, max=2851, avg=773.14, stdev=1020.71 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 430], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1885, max= 2946, per=54.72%, avg=2211.75, stdev=493.75, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.41%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144829: Thu Aug 27 09:50:23 2026 read: IOPS=0, BW=790KiB/s (809kB/s)(5120KiB/6484msec) clat (msec): min=61, max=2494, avg=606.28, stdev=1060.60 lat (msec): min=61, max=2494, avg=606.28, stdev=1060.60 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 99], 60.00th=[ 99], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1973, max= 4031, per=92.91%, avg=2682.33, stdev=1168.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1105KiB/s (1132kB/s)(7168KiB/6484msec); 0 zone resets clat (msec): min=214, max=901, avg=465.35, stdev=248.68 lat (msec): min=214, max=902, avg=465.46, stdev=248.68 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 279], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 363], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 676], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1558, max= 3771, per=56.15%, avg=2269.60, stdev=861.80, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=8.33%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.33%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2888KiB/s (2957kB/s), 289KiB/s-1521KiB/s (296kB/s-1557kB/s), io=20.0MiB (20.0MB), run=4714-7092msec WRITE: bw=4043KiB/s (4140kB/s), 1071KiB/s-1444KiB/s (1097kB/s-1479kB/s), io=28.0MiB (29.4MB), run=4714-7092msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Thu Aug 27 09:50:37 2026 read: IOPS=0, BW=3879KiB/s (3972kB/s)(12.0MiB/3168msec) clat (msec): min=714, max=1354, avg=1014.27, stdev=321.59 lat (msec): min=714, max=1354, avg=1014.28, stdev=321.59 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.22%, ctx=241, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144843: Thu Aug 27 09:50:37 2026 read: IOPS=0, BW=1006KiB/s (1031kB/s)(4096KiB/4070msec) clat (nsec): min=1354.0M, max=1354.0M, avg=1354983463.00, stdev= 0.00 lat (nsec): min=1354.0M, max=1354.0M, avg=1354984798.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2013KiB/s (2061kB/s)(8192KiB/4070msec); 0 zone resets clat (msec): min=751, max=1852, avg=1302.16, stdev=778.26 lat (msec): min=753, max=1852, avg=1303.37, stdev=777.24 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.59%, ctx=253, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144844: Thu Aug 27 09:50:37 2026 write: IOPS=0, BW=3576KiB/s (3662kB/s)(12.0MiB/3436msec); 0 zone resets clat (msec): min=806, max=1302, avg=1117.39, stdev=270.63 lat (msec): min=807, max=1302, avg=1117.78, stdev=270.65 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.57%, ctx=110, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144845: Thu Aug 27 09:50:37 2026 write: IOPS=1, BW=4730KiB/s (4843kB/s)(12.0MiB/2598msec); 0 zone resets clat (msec): min=469, max=1165, avg=829.41, stdev=348.30 lat (msec): min=470, max=1165, avg=830.54, stdev=348.09 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.05%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4026KiB/s (4122kB/s), 1006KiB/s-3879KiB/s (1031kB/s-3972kB/s), io=16.0MiB (16.8MB), run=3168-4070msec WRITE: bw=8051KiB/s (8244kB/s), 2013KiB/s-4730KiB/s (2061kB/s-4843kB/s), io=32.0MiB (33.6MB), run=2598-4070msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144847: Thu Aug 27 09:50:37 2026 read: IOPS=0, BW=3568KiB/s (3654kB/s)(12.0MiB/3444msec) clat (msec): min=284, max=1705, avg=1147.66, stdev=757.80 lat (msec): min=284, max=1705, avg=1147.66, stdev=757.80 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.96%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144848: Thu Aug 27 09:50:37 2026 read: IOPS=0, BW=1126KiB/s (1153kB/s)(4096KiB/3639msec) clat (nsec): min=1626.5M, max=1626.5M, avg=1626513676.00, stdev= 0.00 lat (nsec): min=1626.5M, max=1626.5M, avg=1626516406.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2251KiB/s (2305kB/s)(8192KiB/3639msec); 0 zone resets clat (msec): min=354, max=1650, avg=1002.69, stdev=916.54 lat (msec): min=354, max=1652, avg=1003.73, stdev=917.54 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8047, max= 8047, per=89.37%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.16%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144849: Thu Aug 27 09:50:37 2026 write: IOPS=0, BW=3735KiB/s (3825kB/s)(12.0MiB/3290msec); 0 zone resets clat (msec): min=614, max=1338, avg=1093.65, stdev=414.76 lat (msec): min=615, max=1339, avg=1094.11, stdev=414.71 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7937, max= 8175, per=89.47%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.01%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144850: Thu Aug 27 09:50:37 2026 write: IOPS=0, BW=3873KiB/s (3966kB/s)(12.0MiB/3173msec); 0 zone resets clat (msec): min=325, max=1617, avg=1056.92, stdev=662.85 lat (msec): min=325, max=1617, avg=1057.20, stdev=662.77 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8175, per=90.52%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4502KiB/s (4610kB/s), 1126KiB/s-3568KiB/s (1153kB/s-3654kB/s), io=16.0MiB (16.8MB), run=3444-3639msec WRITE: bw=9005KiB/s (9221kB/s), 2251KiB/s-3873KiB/s (2305kB/s-3966kB/s), io=32.0MiB (33.6MB), run=3173-3639msec