== sanity test 398b: DIO and buffer IO race ============== 17:12:07 (1788469927) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.40913 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178598: Thu Sep 3 17:14:47 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(5992KiB/141553msec) clat (usec): min=38, max=695909, avg=52931.23, stdev=42788.37 lat (usec): min=39, max=695910, avg=52935.74, stdev=42788.44 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 1893], 10.00th=[ 16450], 20.00th=[ 24249], | 30.00th=[ 30540], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 62129], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[170918], 99.50th=[200279], 99.90th=[692061], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 112, per=25.26%, avg=42.44, stdev=19.56, samples=274 iops : min= 1, max= 28, avg= 9.96, stdev= 4.95, samples=274 write: IOPS=11, BW=44.5KiB/s (45.5kB/s)(6296KiB/141553msec); 0 zone resets clat (usec): min=768, max=1145.7k, avg=39388.27, stdev=51451.45 lat (usec): min=770, max=1145.7k, avg=39389.83, stdev=51451.76 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1172], 10.00th=[ 1352], | 20.00th=[ 3294], 30.00th=[ 7111], 40.00th=[ 16188], | 50.00th=[ 25822], 60.00th=[ 35390], 70.00th=[ 47973], | 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[ 123208], | 99.00th=[ 198181], 99.50th=[ 250610], 99.90th=[ 350225], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 5, max= 136, per=25.34%, avg=44.60, stdev=23.49, samples=274 iops : min= 1, max= 34, avg=10.51, stdev= 5.95, samples=274 lat (usec) : 50=0.46%, 100=1.69%, 250=0.13%, 500=0.07%, 1000=0.46% lat (msec) : 2=7.00%, 4=3.87%, 10=6.58%, 20=8.69%, 50=35.19% lat (msec) : 100=26.46%, 250=9.02%, 500=0.29%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.05%, ctx=6194, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178599: Thu Sep 3 17:14:47 2026 read: IOPS=10, BW=42.2KiB/s (43.2kB/s)(5940KiB/140880msec) clat (usec): min=37, max=1029.8k, avg=53003.92, stdev=49137.17 lat (usec): min=38, max=1029.8k, avg=53005.56, stdev=49136.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12387], 10.00th=[ 16909], | 20.00th=[ 23462], 30.00th=[ 28967], 40.00th=[ 35390], | 50.00th=[ 42206], 60.00th=[ 50594], 70.00th=[ 60031], | 80.00th=[ 76022], 90.00th=[ 102237], 95.00th=[ 128451], | 99.00th=[ 189793], 99.50th=[ 225444], 99.90th=[ 734004], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 6, max= 103, per=25.28%, avg=42.47, stdev=20.32, samples=272 iops : min= 1, max= 25, avg= 9.97, stdev= 5.12, samples=272 write: IOPS=11, BW=45.1KiB/s (46.1kB/s)(6348KiB/140880msec); 0 zone resets clat (usec): min=816, max=829796, avg=39025.31, stdev=47339.01 lat (usec): min=816, max=829796, avg=39027.05, stdev=47339.34 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 2999], | 30.00th=[ 6521], 40.00th=[ 16712], 50.00th=[ 25297], 60.00th=[ 35914], | 70.00th=[ 48497], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[185598], 99.50th=[206570], 99.90th=[350225], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 5, max= 135, per=25.59%, avg=45.04, stdev=23.96, samples=274 iops : min= 1, max= 33, avg=10.62, stdev= 6.05, samples=274 lat (usec) : 50=0.26%, 100=1.24%, 250=0.07%, 500=0.03%, 1000=0.33% lat (msec) : 2=8.30%, 4=3.65%, 10=5.83%, 20=10.09%, 50=35.64% lat (msec) : 100=24.74%, 250=9.44%, 500=0.29%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.15%, ctx=6313, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178600: Thu Sep 3 17:14:47 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6028KiB/142523msec) clat (usec): min=33, max=1337.5k, avg=51346.67, stdev=50301.91 lat (usec): min=33, max=1337.5k, avg=51349.23, stdev=50300.57 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9634], 10.00th=[ 16909], | 20.00th=[ 23462], 30.00th=[ 28705], 40.00th=[ 34866], | 50.00th=[ 41157], 60.00th=[ 49021], 70.00th=[ 57934], | 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[ 121111], | 99.00th=[ 189793], 99.50th=[ 227541], 99.90th=[ 362808], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 119, per=25.44%, avg=42.73, stdev=19.80, samples=274 iops : min= 1, max= 29, avg=10.03, stdev= 5.00, samples=274 write: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6260KiB/142523msec); 0 zone resets clat (usec): min=719, max=917744, avg=41470.17, stdev=52819.71 lat (usec): min=720, max=917747, avg=41471.53, stdev=52819.73 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2802], | 30.00th=[ 6521], 40.00th=[ 16909], 50.00th=[ 27657], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[101188], 95.00th=[129500], | 99.00th=[214959], 99.50th=[252707], 99.90th=[633340], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 103, per=25.04%, avg=44.07, stdev=21.33, samples=275 iops : min= 1, max= 25, avg=10.37, stdev= 5.39, samples=275 lat (usec) : 50=0.26%, 100=1.50%, 250=0.10%, 750=0.10%, 1000=0.20% lat (msec) : 2=7.52%, 4=4.65%, 10=6.02%, 20=8.56%, 50=36.10% lat (msec) : 100=25.42%, 250=9.11%, 500=0.36%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.03%, ctx=6270, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178601: Thu Sep 3 17:14:47 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6052KiB/139887msec) clat (usec): min=41, max=1489.4k, avg=50651.75, stdev=55182.77 lat (usec): min=41, max=1489.4k, avg=50653.00, stdev=55182.85 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9110], 10.00th=[ 16057], | 20.00th=[ 23200], 30.00th=[ 28443], 40.00th=[ 33817], | 50.00th=[ 40633], 60.00th=[ 47973], 70.00th=[ 56886], | 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[ 119014], | 99.00th=[ 181404], 99.50th=[ 204473], 99.90th=[ 843056], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 7, max= 96, per=26.05%, avg=43.76, stdev=20.22, samples=269 iops : min= 1, max= 24, avg=10.29, stdev= 5.11, samples=269 write: IOPS=11, BW=44.6KiB/s (45.6kB/s)(6236KiB/139887msec); 0 zone resets clat (usec): min=628, max=824443, avg=40344.29, stdev=49810.36 lat (usec): min=629, max=824444, avg=40346.99, stdev=49811.07 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1156], 10.00th=[ 1369], 20.00th=[ 3097], | 30.00th=[ 6652], 40.00th=[ 16188], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[132645], | 99.00th=[214959], 99.50th=[248513], 99.90th=[396362], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 119, per=25.79%, avg=45.38, stdev=23.43, samples=267 iops : min= 1, max= 29, avg=10.70, stdev= 5.91, samples=267 lat (usec) : 50=0.33%, 100=1.76%, 250=0.10%, 750=0.10%, 1000=0.42% lat (msec) : 2=7.06%, 4=4.33%, 10=6.09%, 20=8.95%, 50=36.59% lat (msec) : 100=25.20%, 250=8.76%, 500=0.23%, 1000=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.03%, ctx=6059, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (173kB/s), 42.2KiB/s-43.3KiB/s (43.2kB/s-44.3kB/s), io=23.4MiB (24.6MB), run=139887-142523msec WRITE: bw=176KiB/s (181kB/s), 43.9KiB/s-45.1KiB/s (44.0kB/s-46.1kB/s), io=24.6MiB (25.7MB), run=139887-142523msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178594: Thu Sep 3 17:15:30 2026 read: IOPS=8, BW=32.4KiB/s (33.2kB/s)(5992KiB/184931msec) clat (msec): min=3, max=738, avg=48.81, stdev=51.99 lat (msec): min=3, max=738, avg=48.81, stdev=51.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 262], 99.50th=[ 288], 99.90th=[ 368], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 151, per=25.78%, avg=33.26, stdev=25.56, samples=347 iops : min= 1, max= 37, avg= 7.64, stdev= 6.43, samples=347 write: IOPS=8, BW=34.0KiB/s (34.9kB/s)(6296KiB/184931msec); 0 zone resets clat (msec): min=11, max=1105, avg=70.84, stdev=64.16 lat (msec): min=11, max=1105, avg=70.84, stdev=64.16 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 142], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 321], 99.90th=[ 667], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 118, per=25.25%, avg=34.09, stdev=24.07, samples=356 iops : min= 1, max= 29, avg= 7.85, stdev= 6.07, samples=356 lat (msec) : 4=0.03%, 10=2.73%, 20=14.10%, 50=42.45%, 100=23.83% lat (msec) : 250=15.49%, 500=1.24%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.47%, ctx=4754, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178595: Thu Sep 3 17:15:30 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(5940KiB/182831msec) clat (msec): min=6, max=1126, avg=48.73, stdev=60.33 lat (msec): min=6, max=1126, avg=48.73, stdev=60.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 112], 95.00th=[ 153], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 877], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 144, per=26.17%, avg=33.75, stdev=25.96, samples=341 iops : min= 1, max= 36, avg= 7.76, stdev= 6.53, samples=341 write: IOPS=8, BW=34.7KiB/s (35.6kB/s)(6348KiB/182831msec); 0 zone resets clat (msec): min=9, max=792, avg=69.43, stdev=59.36 lat (msec): min=9, max=792, avg=69.44, stdev=59.36 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 101], 90.00th=[ 142], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 330], 99.90th=[ 609], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 111, per=26.12%, avg=35.26, stdev=24.00, samples=348 iops : min= 1, max= 27, avg= 8.14, stdev= 6.05, samples=348 lat (msec) : 10=2.60%, 20=15.17%, 50=43.72%, 100=22.53%, 250=14.45% lat (msec) : 500=1.40%, 750=0.03%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.47%, ctx=4678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178596: Thu Sep 3 17:15:30 2026 read: IOPS=8, BW=32.8KiB/s (33.5kB/s)(6028KiB/184051msec) clat (msec): min=5, max=760, avg=49.67, stdev=52.74 lat (msec): min=5, max=760, avg=49.67, stdev=52.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 113], 95.00th=[ 155], | 99.00th=[ 257], 99.50th=[ 288], 99.90th=[ 372], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 143, per=26.05%, avg=33.60, stdev=24.40, samples=348 iops : min= 1, max= 35, avg= 7.72, stdev= 6.14, samples=348 write: IOPS=8, BW=34.0KiB/s (34.8kB/s)(6260KiB/184051msec); 0 zone resets clat (msec): min=11, max=896, avg=69.61, stdev=63.40 lat (msec): min=11, max=896, avg=69.62, stdev=63.40 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 49], 60.00th=[ 60], | 70.00th=[ 75], 80.00th=[ 104], 90.00th=[ 142], 95.00th=[ 184], | 99.00th=[ 284], 99.50th=[ 405], 99.90th=[ 726], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 119, per=25.62%, avg=34.59, stdev=24.84, samples=351 iops : min= 1, max= 29, avg= 7.97, stdev= 6.25, samples=351 lat (msec) : 10=2.02%, 20=14.39%, 50=43.49%, 100=23.57%, 250=15.07% lat (msec) : 500=1.37%, 750=0.03%, 1000=0.07% cpu : usr=0.05%, sys=1.45%, ctx=4705, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178597: Thu Sep 3 17:15:30 2026 read: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6052KiB/183695msec) clat (msec): min=5, max=692, avg=48.47, stdev=52.84 lat (msec): min=5, max=692, avg=48.48, stdev=52.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 70], 90.00th=[ 112], 95.00th=[ 153], | 99.00th=[ 264], 99.50th=[ 313], 99.90th=[ 435], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 127, per=27.30%, avg=35.22, stdev=25.36, samples=333 iops : min= 1, max= 31, avg= 8.12, stdev= 6.38, samples=333 write: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6236KiB/183695msec); 0 zone resets clat (msec): min=11, max=898, avg=70.63, stdev=62.80 lat (msec): min=11, max=898, avg=70.63, stdev=62.80 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 292], 99.50th=[ 338], 99.90th=[ 885], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 144, per=25.69%, avg=34.68, stdev=24.07, samples=348 iops : min= 1, max= 36, avg= 8.00, stdev= 6.07, samples=348 lat (msec) : 10=2.51%, 20=15.30%, 50=42.48%, 100=23.05%, 250=15.23% lat (msec) : 500=1.33%, 750=0.03%, 1000=0.07% cpu : usr=0.05%, sys=1.61%, ctx=4858, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 32.4KiB/s-32.9KiB/s (33.2kB/s-33.7kB/s), io=23.4MiB (24.6MB), run=182831-184931msec WRITE: bw=136KiB/s (139kB/s), 33.9KiB/s-34.7KiB/s (34.8kB/s-35.6kB/s), io=24.6MiB (25.7MB), run=182831-184931msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178651: Thu Sep 3 17:16:20 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5920KiB/38139msec) clat (usec): min=45, max=263712, avg=57193.41, stdev=41635.30 lat (usec): min=45, max=263713, avg=57194.60, stdev=41635.26 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 77], 10.00th=[ 17695], 20.00th=[ 26346], | 30.00th=[ 31851], 40.00th=[ 39584], 50.00th=[ 47973], 60.00th=[ 57410], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[117965], 95.00th=[145753], | 99.00th=[179307], 99.50th=[242222], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 30, max= 351, per=25.50%, avg=155.52, stdev=72.20, samples=75 iops : min= 1, max= 21, avg= 8.93, stdev= 4.57, samples=75 write: IOPS=10, BW=167KiB/s (171kB/s)(6368KiB/38139msec); 0 zone resets clat (usec): min=1372, max=349452, avg=41846.74, stdev=47563.11 lat (usec): min=1374, max=349455, avg=41849.05, stdev=47563.34 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2507], 20.00th=[ 5276], | 30.00th=[ 9634], 40.00th=[ 17171], 50.00th=[ 27657], 60.00th=[ 35390], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[101188], 95.00th=[124257], | 99.00th=[223347], 99.50th=[316670], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 478, per=26.36%, avg=169.23, stdev=93.71, samples=74 iops : min= 1, max= 29, avg= 9.80, stdev= 5.91, samples=74 lat (usec) : 50=0.26%, 100=2.73%, 250=0.26%, 1000=0.13% lat (msec) : 2=4.04%, 4=4.04%, 10=7.94%, 20=8.33%, 50=32.81% lat (msec) : 100=27.60%, 250=11.33%, 500=0.52% cpu : usr=0.08%, sys=4.39%, ctx=1608, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178652: Thu Sep 3 17:16:20 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5744KiB/38844msec) clat (usec): min=39, max=379225, avg=57977.17, stdev=45657.88 lat (usec): min=39, max=379226, avg=57978.49, stdev=45657.79 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 12125], 20.00th=[ 25560], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[109577], 95.00th=[137364], | 99.00th=[210764], 99.50th=[312476], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 30, max= 315, per=24.79%, avg=151.22, stdev=68.29, samples=74 iops : min= 1, max= 19, avg= 8.66, stdev= 4.33, samples=74 write: IOPS=10, BW=168KiB/s (173kB/s)(6544KiB/38844msec); 0 zone resets clat (usec): min=1146, max=321726, avg=43459.93, stdev=42627.49 lat (usec): min=1148, max=321728, avg=43461.93, stdev=42627.42 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 2900], 20.00th=[ 8029], | 30.00th=[ 14484], 40.00th=[ 22676], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 53740], 80.00th=[ 71828], 90.00th=[106431], 95.00th=[125305], | 99.00th=[181404], 99.50th=[204473], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 415, per=26.64%, avg=171.00, stdev=83.54, samples=75 iops : min= 1, max= 25, avg= 9.92, stdev= 5.25, samples=75 lat (usec) : 50=0.52%, 100=2.73%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.91%, 4=3.78%, 10=5.34%, 20=8.33%, 50=33.85% lat (msec) : 100=29.04%, 250=11.46%, 500=0.52% cpu : usr=0.07%, sys=4.24%, ctx=1634, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178653: Thu Sep 3 17:16:20 2026 read: IOPS=9, BW=160KiB/s (163kB/s)(6256KiB/39212msec) clat (usec): min=43, max=222979, avg=52747.31, stdev=39167.66 lat (usec): min=43, max=222980, avg=52748.49, stdev=39167.77 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 128], 20.00th=[ 22676], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[126354], | 99.00th=[175113], 99.50th=[196084], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 383, per=26.60%, avg=162.24, stdev=80.00, samples=76 iops : min= 1, max= 23, avg= 9.36, stdev= 5.04, samples=76 write: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39212msec); 0 zone resets clat (usec): min=1099, max=264398, avg=48078.34, stdev=49175.94 lat (usec): min=1101, max=264400, avg=48080.59, stdev=49175.84 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2769], 20.00th=[ 6194], | 30.00th=[ 12518], 40.00th=[ 23200], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 61604], 80.00th=[ 83362], 90.00th=[117965], 95.00th=[156238], | 99.00th=[214959], 99.50th=[252707], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 30, max= 415, per=24.10%, avg=154.74, stdev=79.67, samples=76 iops : min= 1, max= 25, avg= 8.88, stdev= 5.02, samples=76 lat (usec) : 50=0.26%, 100=4.56%, 250=0.65% lat (msec) : 2=3.52%, 4=3.39%, 10=7.16%, 20=7.81%, 50=32.03% lat (msec) : 100=28.39%, 250=11.98%, 500=0.26% cpu : usr=0.04%, sys=4.30%, ctx=1652, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178654: Thu Sep 3 17:16:20 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38083msec) clat (usec): min=37, max=241991, avg=56130.91, stdev=44020.36 lat (usec): min=37, max=241992, avg=56133.88, stdev=44020.28 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 73], 20.00th=[ 25297], | 30.00th=[ 31851], 40.00th=[ 37487], 50.00th=[ 46924], 60.00th=[ 55313], | 70.00th=[ 68682], 80.00th=[ 84411], 90.00th=[114820], 95.00th=[132645], | 99.00th=[221250], 99.50th=[240124], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 351, per=26.25%, avg=160.15, stdev=79.51, samples=74 iops : min= 1, max= 21, avg= 9.23, stdev= 4.97, samples=74 write: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38083msec); 0 zone resets clat (usec): min=923, max=347887, avg=42954.76, stdev=51940.52 lat (usec): min=924, max=347889, avg=42961.82, stdev=51961.48 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1745], 10.00th=[ 2073], 20.00th=[ 5145], | 30.00th=[ 9765], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 36439], | 70.00th=[ 46400], 80.00th=[ 68682], 90.00th=[108528], 95.00th=[160433], | 99.00th=[258999], 99.50th=[299893], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 380, per=25.93%, avg=166.50, stdev=76.16, samples=74 iops : min= 1, max= 23, avg= 9.64, stdev= 4.78, samples=74 lat (usec) : 50=0.39%, 100=5.21%, 250=0.13%, 1000=0.13% lat (msec) : 2=4.95%, 4=3.52%, 10=7.03%, 20=7.81%, 50=33.46% lat (msec) : 100=25.13%, 250=11.72%, 500=0.52% cpu : usr=0.07%, sys=4.58%, ctx=1623, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=611KiB/s (625kB/s), 148KiB/s-160KiB/s (151kB/s-163kB/s), io=23.4MiB (24.5MB), run=38083-39212msec WRITE: bw=643KiB/s (658kB/s), 154KiB/s-168KiB/s (158kB/s-173kB/s), io=24.6MiB (25.8MB), run=38083-39212msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178647: Thu Sep 3 17:16:32 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(5920KiB/51003msec) clat (msec): min=6, max=343, avg=54.78, stdev=54.77 lat (msec): min=6, max=343, avg=54.78, stdev=54.77 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 58], 80.00th=[ 83], 90.00th=[ 130], 95.00th=[ 171], | 99.00th=[ 268], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 480, per=26.29%, avg=123.32, stdev=87.89, samples=93 iops : min= 1, max= 30, avg= 6.94, stdev= 5.59, samples=93 write: IOPS=7, BW=125KiB/s (128kB/s)(6368KiB/51003msec); 0 zone resets clat (msec): min=13, max=448, avg=76.03, stdev=61.64 lat (msec): min=13, max=448, avg=76.03, stdev=61.64 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 89], 80.00th=[ 112], 90.00th=[ 159], 95.00th=[ 203], | 99.00th=[ 317], 99.50th=[ 372], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 508, per=26.56%, avg=131.21, stdev=95.03, samples=95 iops : min= 1, max= 31, avg= 7.41, stdev= 6.01, samples=95 lat (msec) : 10=1.30%, 20=13.02%, 50=41.54%, 100=24.61%, 250=17.84% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.38%, ctx=1131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178648: Thu Sep 3 17:16:32 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(5744KiB/50913msec) clat (msec): min=7, max=467, avg=53.08, stdev=54.27 lat (msec): min=7, max=467, avg=53.09, stdev=54.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 75], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 220], 99.50th=[ 284], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 22, max= 480, per=25.96%, avg=121.76, stdev=89.91, samples=92 iops : min= 1, max= 30, avg= 6.82, stdev= 5.70, samples=92 write: IOPS=8, BW=129KiB/s (132kB/s)(6544KiB/50913msec); 0 zone resets clat (msec): min=13, max=434, avg=76.77, stdev=63.68 lat (msec): min=13, max=434, avg=76.77, stdev=63.68 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 112], 90.00th=[ 146], 95.00th=[ 207], | 99.00th=[ 313], 99.50th=[ 368], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 22, max= 572, per=27.13%, avg=134.01, stdev=97.13, samples=96 iops : min= 1, max= 35, avg= 7.59, stdev= 6.12, samples=96 lat (msec) : 10=0.91%, 20=14.71%, 50=39.19%, 100=25.91%, 250=17.58% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.35%, ctx=1179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178649: Thu Sep 3 17:16:32 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6256KiB/50820msec) clat (msec): min=7, max=342, avg=53.66, stdev=52.23 lat (msec): min=7, max=342, avg=53.66, stdev=52.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 117], 95.00th=[ 163], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 413, per=27.51%, avg=129.02, stdev=98.02, samples=94 iops : min= 1, max= 25, avg= 7.28, stdev= 6.18, samples=94 write: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50820msec); 0 zone resets clat (msec): min=13, max=434, avg=78.27, stdev=62.32 lat (msec): min=13, max=434, avg=78.28, stdev=62.32 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 88], 80.00th=[ 120], 90.00th=[ 161], 95.00th=[ 194], | 99.00th=[ 334], 99.50th=[ 426], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 384, per=23.50%, avg=116.11, stdev=79.15, samples=99 iops : min= 1, max= 24, avg= 6.46, stdev= 4.98, samples=99 lat (msec) : 10=1.30%, 20=12.37%, 50=39.97%, 100=26.69%, 250=18.10% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.42%, ctx=1175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178650: Thu Sep 3 17:16:32 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50527msec) clat (msec): min=5, max=384, avg=54.17, stdev=54.03 lat (msec): min=5, max=384, avg=54.18, stdev=54.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 509, per=26.05%, avg=122.20, stdev=92.59, samples=96 iops : min= 1, max= 31, avg= 6.85, stdev= 5.83, samples=96 write: IOPS=7, BW=124KiB/s (127kB/s)(6256KiB/50527msec); 0 zone resets clat (msec): min=8, max=429, avg=76.84, stdev=59.30 lat (msec): min=8, max=429, avg=76.85, stdev=59.30 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 84], 80.00th=[ 112], 90.00th=[ 148], 95.00th=[ 197], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 448, per=25.83%, avg=127.60, stdev=88.14, samples=96 iops : min= 1, max= 28, avg= 7.18, stdev= 5.57, samples=96 lat (msec) : 10=2.08%, 20=10.94%, 50=39.45%, 100=29.56%, 250=16.02% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.42%, ctx=1191, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=470KiB/s (481kB/s), 113KiB/s-123KiB/s (116kB/s-126kB/s), io=23.4MiB (24.5MB), run=50527-51003msec WRITE: bw=494KiB/s (506kB/s), 119KiB/s-129KiB/s (122kB/s-132kB/s), io=24.6MiB (25.8MB), run=50527-51003msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178667: Thu Sep 3 17:16:49 2026 read: IOPS=1, BW=1211KiB/s (1240kB/s)(7168KiB/5919msec) clat (usec): min=532, max=711624, avg=216558.13, stdev=246076.57 lat (usec): min=533, max=711625, avg=216559.36, stdev=246076.51 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 594], | 30.00th=[141558], 40.00th=[141558], 50.00th=[158335], 60.00th=[170918], | 70.00th=[170918], 80.00th=[333448], 90.00th=[708838], 95.00th=[708838], | 99.00th=[708838], 99.50th=[708838], 99.90th=[708838], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 3961, max= 4484, per=100.00%, avg=4222.50, stdev=369.82, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=0, BW=865KiB/s (886kB/s)(5120KiB/5919msec); 0 zone resets clat (msec): min=74, max=3005, avg=850.53, stdev=1253.12 lat (msec): min=74, max=3005, avg=850.61, stdev=1253.14 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1796, max= 2023, per=49.42%, avg=1925.33, stdev=116.77, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.98%, ctx=216, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178668: Thu Sep 3 17:16:49 2026 read: IOPS=0, BW=278KiB/s (285kB/s)(2048KiB/7359msec) clat (usec): min=614, max=3299.6k, avg=1650107.07, stdev=2332735.00 lat (usec): min=615, max=3299.6k, avg=1650108.81, stdev=2332735.92 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 611], 30.00th=[ 611], 40.00th=[ 611], | 50.00th=[ 611], 60.00th=[3305112], 70.00th=[3305112], | 80.00th=[3305112], 90.00th=[3305112], 95.00th=[3305112], | 99.00th=[3305112], 99.50th=[3305112], 99.90th=[3305112], | 99.95th=[3305112], 99.99th=[3305112] bw ( KiB/s): min= 1738, max= 2027, per=67.67%, avg=1882.50, stdev=204.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1391KiB/s (1425kB/s)(10.0MiB/7359msec); 0 zone resets clat (msec): min=53, max=1026, avg=397.62, stdev=302.20 lat (msec): min=53, max=1026, avg=397.72, stdev=302.22 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 114], | 30.00th=[ 131], 40.00th=[ 205], 50.00th=[ 257], 60.00th=[ 468], | 70.00th=[ 550], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2007, max= 4047, per=75.14%, avg=2927.50, stdev=1014.73, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=25.00%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=9.46%, ctx=612, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178669: Thu Sep 3 17:16:49 2026 read: IOPS=0, BW=853KiB/s (873kB/s)(6144KiB/7203msec) clat (usec): min=384, max=402498, avg=116112.50, stdev=159710.48 lat (usec): min=385, max=402499, avg=116113.59, stdev=159710.48 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1582], 50.00th=[ 1582], 60.00th=[102237], | 70.00th=[189793], 80.00th=[189793], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2043, max= 3915, per=100.00%, avg=3183.33, stdev=1000.68, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=853KiB/s (873kB/s)(6144KiB/7203msec); 0 zone resets clat (msec): min=95, max=3487, avg=1023.73, stdev=1255.37 lat (msec): min=95, max=3487, avg=1023.89, stdev=1255.35 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 802], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1796, max= 3915, per=60.23%, avg=2346.60, stdev=881.74, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=8.33%, 750=8.33% lat (msec) : 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.58%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178670: Thu Sep 3 17:16:49 2026 read: IOPS=0, BW=839KiB/s (859kB/s)(5120KiB/6105msec) clat (usec): min=345, max=165298, avg=33885.22, stdev=73469.49 lat (usec): min=346, max=165299, avg=33886.15, stdev=73469.45 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 461], 40.00th=[ 461], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[164627], 95.00th=[164627], | 99.00th=[164627], 99.50th=[164627], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 1796, max= 5873, per=100.00%, avg=3834.50, stdev=2882.87, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1174KiB/s (1202kB/s)(7168KiB/6105msec); 0 zone resets clat (msec): min=81, max=3527, avg=816.09, stdev=1213.00 lat (msec): min=81, max=3527, avg=816.15, stdev=1213.01 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 87], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 443], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 600], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1980, max= 3915, per=73.93%, avg=2880.50, stdev=1016.89, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 4=8.33%, 100=16.67%, 250=8.33%, 500=16.67%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.39%, ctx=114, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2783KiB/s (2850kB/s), 278KiB/s-1211KiB/s (285kB/s-1240kB/s), io=20.0MiB (20.0MB), run=5919-7359msec WRITE: bw=3896KiB/s (3990kB/s), 853KiB/s-1391KiB/s (873kB/s-1425kB/s), io=28.0MiB (29.4MB), run=5919-7359msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178671: Thu Sep 3 17:16:50 2026 read: IOPS=0, BW=890KiB/s (911kB/s)(7168KiB/8053msec) clat (msec): min=109, max=459, avg=242.57, stdev=124.68 lat (msec): min=109, max=459, avg=242.58, stdev=124.68 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 136], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 207], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 347], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1992, max= 4087, per=100.00%, avg=2898.50, stdev=1060.92, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=636KiB/s (651kB/s)(5120KiB/8053msec); 0 zone resets clat (msec): min=293, max=3507, avg=1231.83, stdev=1290.14 lat (msec): min=293, max=3507, avg=1232.28, stdev=1289.98 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1973, max= 2043, per=59.80%, avg=2011.75, stdev=34.69, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 1000=25.00%, >=2000=8.33% cpu : usr=0.07%, sys=3.29%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178672: Thu Sep 3 17:16:50 2026 read: IOPS=0, BW=244KiB/s (249kB/s)(2048KiB/8409msec) clat (msec): min=189, max=3180, avg=1685.00, stdev=2114.65 lat (msec): min=189, max=3180, avg=1685.00, stdev=2114.65 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1992, max= 2003, per=83.16%, avg=1997.50, stdev= 7.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1218KiB/s (1247kB/s)(10.0MiB/8409msec); 0 zone resets clat (msec): min=178, max=1222, avg=477.66, stdev=349.27 lat (msec): min=178, max=1222, avg=478.39, stdev=349.34 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 182], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 414], | 70.00th=[ 575], 80.00th=[ 751], 90.00th=[ 776], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1965, max= 5988, per=89.01%, avg=2994.17, stdev=1659.21, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=3.10%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178673: Thu Sep 3 17:16:50 2026 read: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8246msec) clat (msec): min=95, max=681, avg=324.01, stdev=213.59 lat (msec): min=95, max=681, avg=324.01, stdev=213.59 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1973, max= 2015, per=83.09%, avg=1995.80, stdev=16.15, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8246msec); 0 zone resets clat (msec): min=115, max=3452, avg=1029.30, stdev=1217.50 lat (msec): min=116, max=3452, avg=1029.95, stdev=1217.23 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 760], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1750, max= 3984, per=70.41%, avg=2368.60, stdev=911.53, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=2.49%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178674: Thu Sep 3 17:16:50 2026 read: IOPS=0, BW=601KiB/s (615kB/s)(5120KiB/8523msec) clat (msec): min=77, max=677, avg=392.00, stdev=270.08 lat (msec): min=77, max=677, avg=392.00, stdev=270.08 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1992, max= 2039, per=83.54%, avg=2006.75, stdev=21.75, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=841KiB/s (861kB/s)(7168KiB/8523msec); 0 zone resets clat (msec): min=119, max=3812, avg=891.42, stdev=1318.07 lat (msec): min=120, max=3812, avg=891.80, stdev=1317.88 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 138], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 388], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 852], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1799, max= 3992, per=70.31%, avg=2365.20, stdev=914.37, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.50%, ctx=74, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2403KiB/s (2461kB/s), 244KiB/s-890KiB/s (249kB/s-911kB/s), io=20.0MiB (20.0MB), run=8053-8523msec WRITE: bw=3364KiB/s (3445kB/s), 636KiB/s-1218KiB/s (651kB/s-1247kB/s), io=28.0MiB (29.4MB), run=8053-8523msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178683: Thu Sep 3 17:17:08 2026 read: IOPS=0, BW=2684KiB/s (2748kB/s)(12.0MiB/4579msec) clat (msec): min=300, max=2105, avg=1456.89, stdev=1003.86 lat (msec): min=300, max=2105, avg=1456.89, stdev=1003.86 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1972], 50.00th=[ 1972], 60.00th=[ 1972], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7742, max= 8094, per=100.00%, avg=7918.00, stdev=248.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.66%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178684: Thu Sep 3 17:17:08 2026 read: IOPS=0, BW=807KiB/s (826kB/s)(4096KiB/5076msec) clat (nsec): min=1380.8M, max=1380.8M, avg=1380790716.00, stdev= 0.00 lat (nsec): min=1380.8M, max=1380.8M, avg=1380793116.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1614KiB/s (1653kB/s)(8192KiB/5076msec); 0 zone resets clat (msec): min=467, max=3132, avg=1800.35, stdev=1884.61 lat (msec): min=468, max=3133, avg=1800.75, stdev=1884.74 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 3138], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.15%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178685: Thu Sep 3 17:17:08 2026 write: IOPS=1, BW=4808KiB/s (4923kB/s)(12.0MiB/2556msec); 0 zone resets clat (msec): min=248, max=1785, avg=800.95, stdev=854.55 lat (msec): min=248, max=1785, avg=801.36, stdev=854.51 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7433, max= 8192, per=100.00%, avg=7812.50, stdev=536.69, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.48%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178686: Thu Sep 3 17:17:08 2026 write: IOPS=0, BW=3188KiB/s (3264kB/s)(12.0MiB/3855msec); 0 zone resets clat (msec): min=504, max=2396, avg=1232.78, stdev=1018.46 lat (msec): min=504, max=2396, avg=1233.15, stdev=1018.33 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 5728, max= 8094, per=100.00%, avg=6911.00, stdev=1673.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.66%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3228KiB/s (3305kB/s), 807KiB/s-2684KiB/s (826kB/s-2748kB/s), io=16.0MiB (16.8MB), run=4579-5076msec WRITE: bw=6455KiB/s (6610kB/s), 1614KiB/s-4808KiB/s (1653kB/s-4923kB/s), io=32.0MiB (33.6MB), run=2556-5076msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178687: Thu Sep 3 17:17:08 2026 read: IOPS=0, BW=2860KiB/s (2929kB/s)(12.0MiB/4296msec) clat (msec): min=1054, max=1666, avg=1392.21, stdev=310.86 lat (msec): min=1054, max=1666, avg=1392.21, stdev=310.85 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7684, max= 8143, per=100.00%, avg=7913.50, stdev=324.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.02%, sys=8.27%, ctx=338, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178688: Thu Sep 3 17:17:08 2026 read: IOPS=0, BW=879KiB/s (900kB/s)(4096KiB/4660msec) clat (nsec): min=761123k, max=761123k, avg=761123282.00, stdev= 0.00 lat (nsec): min=761126k, max=761126k, avg=761126185.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1758KiB/s (1800kB/s)(8192KiB/4660msec); 0 zone resets clat (msec): min=1331, max=2226, avg=1779.03, stdev=633.48 lat (msec): min=1331, max=2227, avg=1779.45, stdev=633.60 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.75%, ctx=167, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178689: Thu Sep 3 17:17:08 2026 write: IOPS=0, BW=2509KiB/s (2570kB/s)(12.0MiB/4897msec); 0 zone resets clat (msec): min=442, max=2689, avg=1500.99, stdev=1128.99 lat (msec): min=443, max=2689, avg=1501.51, stdev=1128.94 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 7684, max= 8126, per=100.00%, avg=7905.00, stdev=312.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.00%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178690: Thu Sep 3 17:17:08 2026 write: IOPS=0, BW=2867KiB/s (2936kB/s)(12.0MiB/4286msec); 0 zone resets clat (msec): min=844, max=1581, avg=1276.13, stdev=384.21 lat (msec): min=847, max=1581, avg=1277.30, stdev=383.10 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7684, max= 7801, per=100.00%, avg=7742.50, stdev=82.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.55%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3516KiB/s (3600kB/s), 879KiB/s-2860KiB/s (900kB/s-2929kB/s), io=16.0MiB (16.8MB), run=4296-4660msec WRITE: bw=6691KiB/s (6852kB/s), 1758KiB/s-2867KiB/s (1800kB/s-2936kB/s), io=32.0MiB (33.6MB), run=4286-4897msec