== sanity test 398b: DIO and buffer IO race ============== 11:37:17 (1780328237) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.08234 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181618: Mon Jun 1 11:39:59 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140736msec) clat (usec): min=35, max=549346, avg=51961.37, stdev=44004.68 lat (usec): min=35, max=549347, avg=51964.17, stdev=44004.95 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 78], 10.00th=[ 16057], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[221250], 99.50th=[254804], 99.90th=[471860], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 110, per=25.41%, avg=42.68, stdev=18.15, samples=272 iops : min= 1, max= 27, avg=10.01, stdev= 4.56, samples=272 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6296KiB/140736msec); 0 zone resets clat (usec): min=1000, max=1135.3k, avg=39458.67, stdev=53785.66 lat (usec): min=1001, max=1135.3k, avg=39462.89, stdev=53787.09 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1713], | 20.00th=[ 3949], 30.00th=[ 8094], 40.00th=[ 16712], | 50.00th=[ 25822], 60.00th=[ 35390], 70.00th=[ 47973], | 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[ 119014], | 99.00th=[ 177210], 99.50th=[ 229639], 99.90th=[ 683672], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 126, per=25.70%, avg=45.23, stdev=22.52, samples=270 iops : min= 1, max= 31, avg=10.66, stdev= 5.67, samples=270 lat (usec) : 50=0.72%, 100=1.89%, 250=0.07%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.09%, 4=4.30%, 10=6.64%, 20=10.19%, 50=35.94% lat (msec) : 100=25.00%, 250=8.66%, 500=0.29%, 750=0.10%, 2000=0.03% cpu : usr=0.06%, sys=4.70%, ctx=6226, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181622: Mon Jun 1 11:39:59 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5940KiB/142803msec) clat (usec): min=36, max=1145.4k, avg=54044.03, stdev=56908.97 lat (usec): min=36, max=1145.4k, avg=54053.91, stdev=56918.52 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9503], 10.00th=[ 17695], | 20.00th=[ 24511], 30.00th=[ 30278], 40.00th=[ 35914], | 50.00th=[ 43779], 60.00th=[ 52691], 70.00th=[ 61604], | 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[ 121111], | 99.00th=[ 198181], 99.50th=[ 274727], 99.90th=[ 851444], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 6, max= 118, per=25.10%, avg=42.18, stdev=19.50, samples=274 iops : min= 1, max= 29, avg= 9.88, stdev= 4.91, samples=274 write: IOPS=11, BW=44.5KiB/s (45.5kB/s)(6348KiB/142803msec); 0 zone resets clat (usec): min=750, max=396986, avg=38623.17, stdev=44329.24 lat (usec): min=751, max=396987, avg=38641.62, stdev=44327.85 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1680], 20.00th=[ 3982], | 30.00th=[ 7504], 40.00th=[ 15270], 50.00th=[ 26084], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[223347], 99.50th=[261096], 99.90th=[350225], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 6, max= 135, per=25.73%, avg=45.29, stdev=22.74, samples=272 iops : min= 1, max= 33, avg=10.67, stdev= 5.72, samples=272 lat (usec) : 50=0.33%, 100=1.82%, 250=0.10%, 750=0.07%, 1000=0.16% lat (msec) : 2=5.86%, 4=4.33%, 10=7.52%, 20=9.05%, 50=35.12% lat (msec) : 100=27.25%, 250=7.78%, 500=0.46%, 750=0.10%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.85%, ctx=6408, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181624: Mon Jun 1 11:39:59 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6028KiB/139865msec) clat (usec): min=32, max=737998, avg=50350.68, stdev=44871.02 lat (usec): min=33, max=737999, avg=50352.14, stdev=44871.06 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 74], 10.00th=[ 15533], 20.00th=[ 23462], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[177210], 99.50th=[283116], 99.90th=[624952], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 102, per=26.11%, avg=43.87, stdev=20.52, samples=268 iops : min= 1, max= 25, avg=10.32, stdev= 5.15, samples=268 write: IOPS=11, BW=44.8KiB/s (45.8kB/s)(6260KiB/139865msec); 0 zone resets clat (usec): min=822, max=1143.4k, avg=39980.49, stdev=56479.84 lat (usec): min=844, max=1143.4k, avg=39985.34, stdev=56479.42 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1483], | 20.00th=[ 3589], 30.00th=[ 7111], 40.00th=[ 16057], | 50.00th=[ 27132], 60.00th=[ 36439], 70.00th=[ 49546], | 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[ 120062], | 99.00th=[ 204473], 99.50th=[ 240124], 99.90th=[ 801113], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 124, per=25.95%, avg=45.67, stdev=21.86, samples=267 iops : min= 1, max= 31, avg=10.78, stdev= 5.52, samples=267 lat (usec) : 50=0.65%, 100=2.08%, 250=0.07%, 500=0.10%, 1000=0.20% lat (msec) : 2=6.45%, 4=4.49%, 10=6.58%, 20=8.98%, 50=36.62% lat (msec) : 100=25.72%, 250=7.55%, 500=0.36%, 750=0.10%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.08%, sys=4.80%, ctx=6332, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181625: Mon Jun 1 11:39:59 2026 read: IOPS=10, BW=42.8KiB/s (43.9kB/s)(6052KiB/141261msec) clat (usec): min=35, max=517692, avg=49655.00, stdev=37442.32 lat (usec): min=35, max=517694, avg=49658.97, stdev=37443.45 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 221], 10.00th=[ 16319], 20.00th=[ 23462], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[177210], 99.50th=[227541], 99.90th=[396362], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 103, per=25.81%, avg=43.37, stdev=20.77, samples=270 iops : min= 1, max= 25, avg=10.19, stdev= 5.20, samples=270 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6236KiB/141261msec); 0 zone resets clat (usec): min=844, max=1200.5k, avg=41527.57, stdev=59583.63 lat (usec): min=845, max=1200.5k, avg=41532.99, stdev=59582.07 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1467], | 20.00th=[ 3687], 30.00th=[ 7701], 40.00th=[ 16581], | 50.00th=[ 27919], 60.00th=[ 38011], 70.00th=[ 51119], | 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[ 124257], | 99.00th=[ 204473], 99.50th=[ 246416], 99.90th=[ 734004], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 4, max= 119, per=25.41%, avg=44.73, stdev=21.22, samples=270 iops : min= 1, max= 29, avg=10.53, stdev= 5.32, samples=270 lat (usec) : 50=0.59%, 100=1.69%, 250=0.20%, 750=0.03%, 1000=0.16% lat (msec) : 2=6.64%, 4=4.04%, 10=6.48%, 20=8.85%, 50=36.33% lat (msec) : 100=27.41%, 250=7.19%, 500=0.23%, 750=0.13%, 2000=0.03% cpu : usr=0.06%, sys=4.58%, ctx=6235, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 41.6KiB/s-43.1KiB/s (42.6kB/s-44.1kB/s), io=23.4MiB (24.6MB), run=139865-142803msec WRITE: bw=176KiB/s (180kB/s), 44.1KiB/s-44.8KiB/s (45.2kB/s-45.8kB/s), io=24.6MiB (25.7MB), run=139865-142803msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181619: Mon Jun 1 11:40:44 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5992KiB/187739msec) clat (msec): min=5, max=1134, avg=50.14, stdev=59.23 lat (msec): min=5, max=1134, avg=50.15, stdev=59.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 112], 95.00th=[ 157], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 575], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 159, per=25.98%, avg=32.99, stdev=25.54, samples=352 iops : min= 1, max= 39, avg= 7.60, stdev= 6.43, samples=352 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6296KiB/187739msec); 0 zone resets clat (msec): min=13, max=832, avg=70.69, stdev=60.68 lat (msec): min=13, max=832, avg=70.69, stdev=60.68 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 178], | 99.00th=[ 288], 99.50th=[ 397], 99.90th=[ 642], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 144, per=25.61%, avg=34.06, stdev=24.64, samples=358 iops : min= 1, max= 36, avg= 7.86, stdev= 6.21, samples=358 lat (msec) : 10=1.99%, 20=15.10%, 50=40.89%, 100=25.00%, 250=15.59% lat (msec) : 500=1.27%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=5057, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181620: Mon Jun 1 11:40:44 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5940KiB/186228msec) clat (msec): min=5, max=1702, avg=48.82, stdev=66.14 lat (msec): min=5, max=1702, avg=48.82, stdev=66.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 69], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 247], 99.50th=[ 275], 99.90th=[ 827], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 4, max= 151, per=26.68%, avg=33.88, stdev=25.88, samples=340 iops : min= 1, max= 37, avg= 7.81, stdev= 6.53, samples=340 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6348KiB/186228msec); 0 zone resets clat (msec): min=10, max=634, avg=71.17, stdev=60.54 lat (msec): min=10, max=634, avg=71.17, stdev=60.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 63], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 146], 95.00th=[ 184], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 567], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 4, max= 128, per=26.19%, avg=34.83, stdev=24.66, samples=353 iops : min= 1, max= 32, avg= 8.05, stdev= 6.23, samples=353 lat (msec) : 10=1.86%, 20=15.36%, 50=42.97%, 100=23.01%, 250=15.53% lat (msec) : 500=1.07%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.94%, ctx=4973, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181621: Mon Jun 1 11:40:44 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6028KiB/186747msec) clat (msec): min=4, max=845, avg=48.56, stdev=51.30 lat (msec): min=4, max=845, avg=48.57, stdev=51.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 251], 99.50th=[ 309], 99.90th=[ 363], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 4, max= 142, per=26.26%, avg=33.35, stdev=24.60, samples=350 iops : min= 1, max= 35, avg= 7.69, stdev= 6.20, samples=350 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6260KiB/186747msec); 0 zone resets clat (msec): min=11, max=1249, avg=71.76, stdev=67.17 lat (msec): min=11, max=1249, avg=71.77, stdev=67.17 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 81], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 180], | 99.00th=[ 279], 99.50th=[ 384], 99.90th=[ 743], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 4, max= 141, per=25.60%, avg=34.05, stdev=24.57, samples=356 iops : min= 1, max= 35, avg= 7.86, stdev= 6.20, samples=356 lat (msec) : 10=2.44%, 20=13.38%, 50=42.55%, 100=25.26%, 250=15.04% lat (msec) : 500=1.14%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=5013, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181623: Mon Jun 1 11:40:44 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6052KiB/186059msec) clat (msec): min=5, max=745, avg=46.34, stdev=49.35 lat (msec): min=5, max=745, avg=46.35, stdev=49.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 38], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 101], 95.00th=[ 130], | 99.00th=[ 218], 99.50th=[ 275], 99.90th=[ 659], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 159, per=26.66%, avg=33.86, stdev=26.10, samples=347 iops : min= 1, max= 39, avg= 7.81, stdev= 6.58, samples=347 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6236KiB/186059msec); 0 zone resets clat (msec): min=10, max=1248, avg=73.57, stdev=66.66 lat (msec): min=10, max=1248, avg=73.57, stdev=66.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 66], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 284], 99.50th=[ 363], 99.90th=[ 567], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 4, max= 104, per=25.55%, avg=33.99, stdev=23.51, samples=356 iops : min= 1, max= 26, avg= 7.85, stdev= 5.93, samples=356 lat (msec) : 10=2.25%, 20=14.68%, 50=41.99%, 100=24.41%, 250=15.36% lat (msec) : 500=1.14%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.92%, ctx=5113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.9KiB/s-32.5KiB/s (32.7kB/s-33.3kB/s), io=23.4MiB (24.6MB), run=186059-187739msec WRITE: bw=134KiB/s (137kB/s), 33.5KiB/s-34.1KiB/s (34.3kB/s-34.9kB/s), io=24.6MiB (25.7MB), run=186059-187739msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181678: Mon Jun 1 11:41:30 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35371msec) clat (usec): min=34, max=277188, avg=49445.67, stdev=33700.62 lat (usec): min=34, max=277190, avg=49447.26, stdev=33700.51 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 1745], 20.00th=[ 25822], | 30.00th=[ 32113], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[166724], 99.50th=[187696], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 28, max= 320, per=24.95%, avg=166.17, stdev=66.86, samples=69 iops : min= 1, max= 20, avg= 9.61, stdev= 4.24, samples=69 write: IOPS=11, BW=180KiB/s (184kB/s)(6368KiB/35371msec); 0 zone resets clat (usec): min=1292, max=209553, avg=41497.85, stdev=36855.96 lat (usec): min=1294, max=209554, avg=41500.51, stdev=36855.78 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1876], 10.00th=[ 2868], 20.00th=[ 8094], | 30.00th=[ 13042], 40.00th=[ 23987], 50.00th=[ 31065], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[152044], 99.50th=[177210], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 61, max= 320, per=25.96%, avg=182.00, stdev=61.45, samples=68 iops : min= 3, max= 20, avg=10.62, stdev= 3.90, samples=68 lat (usec) : 50=0.65%, 100=3.65%, 250=0.39% lat (msec) : 2=3.78%, 4=3.12%, 10=6.25%, 20=8.20%, 50=34.24% lat (msec) : 100=32.68%, 250=6.90%, 500=0.13% cpu : usr=0.07%, sys=5.43%, ctx=1664, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181679: Mon Jun 1 11:41:30 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(5744KiB/35921msec) clat (usec): min=40, max=231900, avg=55076.68, stdev=36188.73 lat (usec): min=41, max=231900, avg=55098.88, stdev=36193.62 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 19792], 20.00th=[ 28443], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[114820], | 99.00th=[191890], 99.50th=[229639], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 254, per=23.73%, avg=158.06, stdev=60.20, samples=70 iops : min= 1, max= 15, avg= 9.11, stdev= 3.85, samples=70 write: IOPS=11, BW=182KiB/s (187kB/s)(6544KiB/35921msec); 0 zone resets clat (usec): min=1556, max=224983, avg=38813.10, stdev=38900.35 lat (usec): min=1558, max=224986, avg=38820.17, stdev=38896.82 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1926], 10.00th=[ 3261], 20.00th=[ 5669], | 30.00th=[ 9634], 40.00th=[ 16909], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 52167], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[158335], 99.50th=[175113], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 475, per=26.15%, avg=183.32, stdev=87.22, samples=69 iops : min= 3, max= 29, avg=10.70, stdev= 5.46, samples=69 lat (usec) : 50=0.26%, 100=2.99% lat (msec) : 2=3.12%, 4=3.91%, 10=9.51%, 20=8.33%, 50=32.68% lat (msec) : 100=30.34%, 250=8.85% cpu : usr=0.09%, sys=5.19%, ctx=1617, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181681: Mon Jun 1 11:41:30 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35804msec) clat (usec): min=39, max=177610, avg=51645.15, stdev=30702.38 lat (usec): min=39, max=177610, avg=51646.71, stdev=30702.44 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 19268], 20.00th=[ 28705], | 30.00th=[ 35390], 40.00th=[ 41681], 50.00th=[ 49546], 60.00th=[ 54789], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[156238], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 341, per=26.65%, avg=177.51, stdev=60.39, samples=69 iops : min= 3, max= 21, avg=10.33, stdev= 3.86, samples=69 write: IOPS=10, BW=168KiB/s (173kB/s)(6032KiB/35804msec); 0 zone resets clat (usec): min=1395, max=275166, avg=40049.22, stdev=39341.35 lat (usec): min=1398, max=275170, avg=40057.83, stdev=39338.54 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 3326], 20.00th=[ 6063], | 30.00th=[ 10552], 40.00th=[ 20317], 50.00th=[ 27657], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[158335], 99.50th=[173016], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 28, max= 533, per=23.74%, avg=166.40, stdev=83.21, samples=70 iops : min= 1, max= 33, avg= 9.63, stdev= 5.29, samples=70 lat (usec) : 50=0.13%, 100=2.99%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=4.95%, 10=7.68%, 20=6.38%, 50=35.16% lat (msec) : 100=32.16%, 250=7.81%, 500=0.13% cpu : usr=0.06%, sys=5.19%, ctx=1681, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181684: Mon Jun 1 11:41:30 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35322msec) clat (usec): min=31, max=291001, avg=50326.60, stdev=34020.03 lat (usec): min=32, max=291002, avg=50332.46, stdev=34023.77 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 2311], 20.00th=[ 27132], | 30.00th=[ 34866], 40.00th=[ 40109], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[170918], 99.50th=[187696], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 380, per=26.18%, avg=174.33, stdev=68.63, samples=67 iops : min= 1, max= 23, avg=10.13, stdev= 4.38, samples=67 write: IOPS=11, BW=177KiB/s (181kB/s)(6256KiB/35322msec); 0 zone resets clat (usec): min=1402, max=326790, avg=40482.54, stdev=41647.16 lat (usec): min=1404, max=326792, avg=40536.54, stdev=41751.86 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1926], 10.00th=[ 2868], 20.00th=[ 6194], | 30.00th=[ 11076], 40.00th=[ 17433], 50.00th=[ 30016], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 98042], 95.00th=[128451], | 99.00th=[166724], 99.50th=[217056], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 63, max= 376, per=25.69%, avg=180.09, stdev=67.88, samples=68 iops : min= 3, max= 23, avg=10.50, stdev= 4.32, samples=68 lat (usec) : 50=0.39%, 100=4.30%, 250=0.13% lat (msec) : 2=2.86%, 4=3.91%, 10=7.55%, 20=8.59%, 50=36.20% lat (msec) : 100=27.60%, 250=8.20%, 500=0.26% cpu : usr=0.06%, sys=4.96%, ctx=1626, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=667KiB/s (683kB/s), 160KiB/s-175KiB/s (164kB/s-179kB/s), io=23.4MiB (24.5MB), run=35322-35921msec WRITE: bw=702KiB/s (718kB/s), 168KiB/s-182KiB/s (173kB/s-187kB/s), io=24.6MiB (25.8MB), run=35322-35921msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181677: Mon Jun 1 11:41:44 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5920KiB/49667msec) clat (msec): min=8, max=352, avg=50.72, stdev=40.99 lat (msec): min=8, max=352, avg=50.72, stdev=40.99 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 105], 95.00th=[ 133], | 99.00th=[ 194], 99.50th=[ 241], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 416, per=25.56%, avg=121.42, stdev=75.07, samples=96 iops : min= 1, max= 26, avg= 6.80, stdev= 4.79, samples=96 write: IOPS=8, BW=128KiB/s (131kB/s)(6368KiB/49667msec); 0 zone resets clat (msec): min=15, max=268, avg=76.91, stdev=49.44 lat (msec): min=15, max=268, avg=76.92, stdev=49.43 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 199], | 99.00th=[ 245], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 384, per=25.81%, avg=129.06, stdev=68.74, samples=97 iops : min= 1, max= 24, avg= 7.27, stdev= 4.37, samples=97 lat (msec) : 10=0.26%, 20=6.64%, 50=45.18%, 100=30.08%, 250=17.45% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.90%, ctx=1304, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181680: Mon Jun 1 11:41:44 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5744KiB/50336msec) clat (msec): min=9, max=230, avg=51.43, stdev=40.33 lat (msec): min=9, max=230, avg=51.43, stdev=40.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 109], 95.00th=[ 144], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 384, per=24.48%, avg=116.29, stdev=77.30, samples=96 iops : min= 1, max= 24, avg= 6.46, stdev= 4.95, samples=96 write: IOPS=8, BW=130KiB/s (133kB/s)(6544KiB/50336msec); 0 zone resets clat (msec): min=14, max=294, avg=76.88, stdev=49.75 lat (msec): min=14, max=294, avg=76.88, stdev=49.75 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 93], 80.00th=[ 116], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 257], 99.50th=[ 262], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 409, per=25.72%, avg=128.60, stdev=74.89, samples=99 iops : min= 1, max= 25, avg= 7.25, stdev= 4.75, samples=99 lat (msec) : 10=0.26%, 20=7.42%, 50=44.14%, 100=28.26%, 250=19.27% lat (msec) : 500=0.65% cpu : usr=0.07%, sys=1.85%, ctx=1293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181682: Mon Jun 1 11:41:44 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50147msec) clat (msec): min=7, max=271, avg=53.30, stdev=41.89 lat (msec): min=7, max=271, avg=53.30, stdev=41.89 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 117], 95.00th=[ 134], | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 447, per=26.63%, avg=126.51, stdev=83.19, samples=96 iops : min= 1, max= 27, avg= 7.11, stdev= 5.26, samples=96 write: IOPS=7, BW=120KiB/s (123kB/s)(6032KiB/50147msec); 0 zone resets clat (msec): min=14, max=302, avg=76.62, stdev=46.63 lat (msec): min=14, max=302, avg=76.62, stdev=46.63 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 64], 60.00th=[ 75], | 70.00th=[ 87], 80.00th=[ 115], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 228], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 320, per=23.54%, avg=117.71, stdev=65.52, samples=98 iops : min= 1, max= 20, avg= 6.56, stdev= 4.17, samples=98 lat (msec) : 10=0.39%, 20=9.11%, 50=41.02%, 100=30.21%, 250=18.88% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.84%, ctx=1249, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181683: Mon Jun 1 11:41:44 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49692msec) clat (msec): min=8, max=316, avg=52.40, stdev=43.52 lat (msec): min=8, max=316, avg=52.40, stdev=43.52 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 75], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 416, per=27.34%, avg=129.88, stdev=73.10, samples=91 iops : min= 1, max= 26, avg= 7.34, stdev= 4.65, samples=91 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49692msec); 0 zone resets clat (msec): min=16, max=313, avg=76.42, stdev=47.43 lat (msec): min=16, max=313, avg=76.43, stdev=47.43 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 146], 95.00th=[ 171], | 99.00th=[ 243], 99.50th=[ 300], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 384, per=25.14%, avg=125.71, stdev=69.38, samples=98 iops : min= 1, max= 24, avg= 7.07, stdev= 4.40, samples=98 lat (msec) : 10=0.26%, 20=8.07%, 50=41.93%, 100=31.90%, 250=17.32% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.94%, ctx=1258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=476KiB/s (487kB/s), 114KiB/s-125KiB/s (117kB/s-128kB/s), io=23.4MiB (24.5MB), run=49667-50336msec WRITE: bw=501KiB/s (513kB/s), 120KiB/s-130KiB/s (123kB/s-133kB/s), io=24.6MiB (25.8MB), run=49667-50336msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181698: Mon Jun 1 11:42:06 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(7168KiB/7449msec) clat (usec): min=1968, max=3971.7k, avg=745693.66, stdev=1426565.96 lat (usec): min=1969, max=3971.7k, avg=745695.42, stdev=1426566.50 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 1975], 10.00th=[ 1975], | 20.00th=[ 189793], 30.00th=[ 196084], 40.00th=[ 196084], | 50.00th=[ 233833], 60.00th=[ 278922], 70.00th=[ 278922], | 80.00th=[ 350225], 90.00th=[3976201], 95.00th=[3976201], | 99.00th=[3976201], 99.50th=[3976201], 99.90th=[3976201], | 99.95th=[3976201], 99.99th=[3976201] bw ( KiB/s): min= 2003, max= 4087, per=100.00%, avg=2439.80, stdev=920.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=687KiB/s (704kB/s)(5120KiB/7449msec); 0 zone resets clat (msec): min=235, max=721, avg=434.54, stdev=203.99 lat (msec): min=235, max=721, avg=434.63, stdev=203.97 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2003, max= 4071, per=93.75%, avg=2705.67, stdev=1182.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.04%, sys=9.05%, ctx=634, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181699: Mon Jun 1 11:42:06 2026 read: IOPS=0, BW=210KiB/s (215kB/s)(2048KiB/9751msec) clat (msec): min=409, max=3695, avg=2052.46, stdev=2323.01 lat (msec): min=409, max=3695, avg=2052.46, stdev=2323.01 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 3708], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 2043, max= 2043, per=99.13%, avg=2043.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1050KiB/s (1075kB/s)(10.0MiB/9751msec); 0 zone resets clat (msec): min=227, max=882, avg=550.78, stdev=267.81 lat (msec): min=229, max=882, avg=552.11, stdev=266.64 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 292], | 30.00th=[ 309], 40.00th=[ 313], 50.00th=[ 409], 60.00th=[ 609], | 70.00th=[ 785], 80.00th=[ 827], 90.00th=[ 852], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2000, max= 4071, per=80.28%, avg=2316.86, stdev=773.70, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=8.33%, 500=41.67%, 750=8.33%, 1000=33.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.12%, ctx=637, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181700: Mon Jun 1 11:42:06 2026 read: IOPS=0, BW=618KiB/s (633kB/s)(6144KiB/9934msec) clat (msec): min=166, max=951, avg=421.37, stdev=274.89 lat (msec): min=166, max=951, avg=421.37, stdev=274.89 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 368], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2035, max= 4087, per=100.00%, avg=2551.00, stdev=1024.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=618KiB/s (633kB/s)(6144KiB/9934msec); 0 zone resets clat (msec): min=209, max=3954, avg=1177.64, stdev=1404.85 lat (msec): min=209, max=3954, avg=1177.78, stdev=1404.84 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 978], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 2000, max= 2043, per=69.92%, avg=2018.00, stdev=19.82, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=5.63%, ctx=293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181701: Mon Jun 1 11:42:06 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(5120KiB/8705msec) clat (msec): min=4, max=957, avg=358.85, stdev=359.71 lat (msec): min=4, max=957, avg=358.86, stdev=359.71 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2000, max= 4087, per=100.00%, avg=2710.00, stdev=1192.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=823KiB/s (843kB/s)(7168KiB/8705msec); 0 zone resets clat (msec): min=102, max=4462, avg=982.08, stdev=1557.42 lat (msec): min=102, max=4462, avg=982.19, stdev=1557.43 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 174], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 393], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 919], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1365, max= 4079, per=99.57%, avg=2873.50, stdev=1378.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=6.54%, ctx=159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2062KiB/s (2111kB/s), 210KiB/s-962KiB/s (215kB/s-985kB/s), io=20.0MiB (20.0MB), run=7449-9934msec WRITE: bw=2886KiB/s (2956kB/s), 618KiB/s-1050KiB/s (633kB/s-1075kB/s), io=28.0MiB (29.4MB), run=7449-9934msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181702: Mon Jun 1 11:42:07 2026 read: IOPS=0, BW=727KiB/s (744kB/s)(7168KiB/9860msec) clat (msec): min=132, max=3682, avg=950.27, stdev=1275.06 lat (msec): min=132, max=3682, avg=950.28, stdev=1275.06 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 150], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 558], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 1318], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 2003, max= 3984, per=100.00%, avg=2406.40, stdev=881.94, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=519KiB/s (532kB/s)(5120KiB/9860msec); 0 zone resets clat (msec): min=141, max=1072, avg=568.20, stdev=392.58 lat (msec): min=142, max=1072, avg=568.73, stdev=392.09 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 2011, max= 2035, per=71.23%, avg=2023.00, stdev=10.33, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 750=25.00%, 1000=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.59%, ctx=64, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181703: Mon Jun 1 11:42:07 2026 read: IOPS=0, BW=203KiB/s (208kB/s)(2048KiB/10095msec) clat (msec): min=124, max=3539, avg=1831.53, stdev=2414.76 lat (msec): min=124, max=3539, avg=1831.53, stdev=2414.76 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 3540], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2007, max= 2023, per=99.36%, avg=2015.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1014KiB/s (1039kB/s)(10.0MiB/10095msec); 0 zone resets clat (msec): min=226, max=1464, avg=604.14, stdev=449.60 lat (msec): min=226, max=1464, avg=604.26, stdev=449.59 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 288], | 30.00th=[ 305], 40.00th=[ 355], 50.00th=[ 489], 60.00th=[ 493], | 70.00th=[ 502], 80.00th=[ 523], 90.00th=[ 1401], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1992, max= 4031, per=81.02%, avg=2300.86, stdev=763.06, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.21%, ctx=144, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181704: Mon Jun 1 11:42:07 2026 read: IOPS=0, BW=641KiB/s (657kB/s)(6144KiB/9578msec) clat (msec): min=110, max=850, avg=419.36, stdev=297.62 lat (msec): min=110, max=850, avg=419.36, stdev=297.62 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 409], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2011, max= 4039, per=100.00%, avg=2692.33, stdev=1166.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=641KiB/s (657kB/s)(6144KiB/9578msec); 0 zone resets clat (msec): min=196, max=3873, avg=1154.60, stdev=1366.86 lat (msec): min=196, max=3873, avg=1154.72, stdev=1366.85 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 877], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1992, max= 2035, per=70.80%, avg=2010.60, stdev=17.78, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=1.67%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181705: Mon Jun 1 11:42:07 2026 read: IOPS=0, BW=536KiB/s (549kB/s)(5120KiB/9545msec) clat (msec): min=134, max=662, avg=378.02, stdev=242.96 lat (msec): min=134, max=662, avg=378.02, stdev=242.96 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 4007, max= 4015, per=100.00%, avg=4011.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=751KiB/s (769kB/s)(7168KiB/9545msec); 0 zone resets clat (msec): min=359, max=3548, avg=1034.77, stdev=1154.02 lat (msec): min=359, max=3548, avg=1034.87, stdev=1154.03 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 418], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 514], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 1318], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1992, max= 2035, per=71.02%, avg=2016.86, stdev=13.91, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (msec) : 250=16.67%, 500=33.33%, 750=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.17%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2029KiB/s (2077kB/s), 203KiB/s-727KiB/s (208kB/s-744kB/s), io=20.0MiB (20.0MB), run=9545-10095msec WRITE: bw=2840KiB/s (2908kB/s), 519KiB/s-1014KiB/s (532kB/s-1039kB/s), io=28.0MiB (29.4MB), run=9545-10095msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181712: Mon Jun 1 11:42:20 2026 read: IOPS=1, BW=4106KiB/s (4204kB/s)(12.0MiB/2993msec) clat (msec): min=847, max=1140, avg=949.91, stdev=164.88 lat (msec): min=847, max=1140, avg=949.91, stdev=164.88 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.27%, sys=8.92%, ctx=235, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181713: Mon Jun 1 11:42:20 2026 read: IOPS=0, BW=1374KiB/s (1407kB/s)(4096KiB/2980msec) clat (nsec): min=1138.4M, max=1138.4M, avg=1138418087.00, stdev= 0.00 lat (nsec): min=1138.4M, max=1138.4M, avg=1138420299.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2749KiB/s (2815kB/s)(8192KiB/2980msec); 0 zone resets clat (msec): min=537, max=1197, avg=867.27, stdev=466.69 lat (msec): min=539, max=1197, avg=868.84, stdev=465.08 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8143, max= 8143, per=84.65%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.13%, sys=4.83%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181714: Mon Jun 1 11:42:20 2026 write: IOPS=0, BW=3608KiB/s (3694kB/s)(12.0MiB/3406msec); 0 zone resets clat (msec): min=667, max=1366, avg=1098.60, stdev=376.80 lat (msec): min=668, max=1367, avg=1099.09, stdev=376.87 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8175, max= 8192, per=85.07%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.15%, sys=3.20%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181715: Mon Jun 1 11:42:20 2026 write: IOPS=1, BW=4701KiB/s (4814kB/s)(12.0MiB/2614msec); 0 zone resets clat (msec): min=361, max=1698, avg=862.13, stdev=728.75 lat (msec): min=362, max=1699, avg=862.82, stdev=729.57 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 6243, max= 8047, per=74.27%, avg=7145.00, stdev=1275.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=3.94%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5474KiB/s (5605kB/s), 1374KiB/s-4106KiB/s (1407kB/s-4204kB/s), io=16.0MiB (16.8MB), run=2980-2993msec WRITE: bw=9621KiB/s (9852kB/s), 2749KiB/s-4701KiB/s (2815kB/s-4814kB/s), io=32.0MiB (33.6MB), run=2614-3406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181717: Mon Jun 1 11:42:20 2026 read: IOPS=1, BW=4438KiB/s (4544kB/s)(12.0MiB/2769msec) clat (msec): min=330, max=1862, avg=910.91, stdev=830.43 lat (msec): min=330, max=1862, avg=910.91, stdev=830.43 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.25%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181718: Mon Jun 1 11:42:20 2026 read: IOPS=0, BW=1484KiB/s (1519kB/s)(4096KiB/2761msec) clat (nsec): min=1390.7M, max=1390.7M, avg=1390688924.00, stdev= 0.00 lat (nsec): min=1390.7M, max=1390.7M, avg=1390691826.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2967KiB/s (3038kB/s)(8192KiB/2761msec); 0 zone resets clat (msec): min=477, max=878, avg=678.16, stdev=283.70 lat (msec): min=480, max=879, avg=679.85, stdev=282.26 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8175, max= 8175, per=70.43%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.19%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181719: Mon Jun 1 11:42:20 2026 write: IOPS=1, BW=4353KiB/s (4457kB/s)(12.0MiB/2823msec); 0 zone resets clat (msec): min=447, max=1387, avg=938.48, stdev=471.38 lat (msec): min=449, max=1387, avg=939.98, stdev=470.39 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8126, max= 8175, per=70.22%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.14%, sys=3.58%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181720: Mon Jun 1 11:42:20 2026 write: IOPS=1, BW=5357KiB/s (5485kB/s)(12.0MiB/2294msec); 0 zone resets clat (msec): min=492, max=920, avg=762.45, stdev=234.82 lat (msec): min=497, max=921, avg=764.28, stdev=232.21 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 6747, max= 8192, per=64.35%, avg=7469.50, stdev=1021.77, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.15%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5917KiB/s (6059kB/s), 1484KiB/s-4438KiB/s (1519kB/s-4544kB/s), io=16.0MiB (16.8MB), run=2761-2769msec WRITE: bw=11.3MiB/s (11.9MB/s), 2967KiB/s-5357KiB/s (3038kB/s-5485kB/s), io=32.0MiB (33.6MB), run=2294-2823msec