== sanity test 398b: DIO and buffer IO race ============== 22:25:47 (1780453547) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.39508 s, 6.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146017: Tue Jun 2 22:28:14 2026 read: IOPS=12, BW=49.6KiB/s (50.7kB/s)(5992KiB/120926msec) clat (usec): min=34, max=883625, avg=40683.17, stdev=36978.44 lat (usec): min=34, max=883626, avg=40686.27, stdev=36976.35 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 11207], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[212861], 99.90th=[287310], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 125, per=25.82%, avg=49.31, stdev=19.63, samples=237 iops : min= 1, max= 31, avg=11.68, stdev= 4.93, samples=237 write: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6296KiB/120926msec); 0 zone resets clat (usec): min=1054, max=508306, avg=37878.94, stdev=41171.19 lat (usec): min=1055, max=508308, avg=37880.57, stdev=41171.33 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 2040], 20.00th=[ 4424], | 30.00th=[ 8356], 40.00th=[ 16581], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[158335], 99.50th=[227541], 99.90th=[392168], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 110, per=25.89%, avg=51.78, stdev=21.23, samples=237 iops : min= 1, max= 27, avg=12.30, stdev= 5.35, samples=237 lat (usec) : 50=0.46%, 100=3.48%, 250=0.23%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.11%, 4=4.56%, 10=7.78%, 20=9.99%, 50=39.75% lat (msec) : 100=23.21%, 250=4.92%, 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.40%, ctx=6633, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146018: Tue Jun 2 22:28:14 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5940KiB/123814msec) clat (usec): min=27, max=274379, avg=40905.72, stdev=29803.16 lat (usec): min=27, max=274379, avg=40908.29, stdev=29802.52 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 9372], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[156238], 99.90th=[246416], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 5, max= 95, per=24.97%, avg=47.69, stdev=18.58, samples=243 iops : min= 1, max= 23, avg=11.28, stdev= 4.67, samples=243 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6348KiB/123814msec); 0 zone resets clat (usec): min=979, max=858207, avg=39479.79, stdev=45081.22 lat (usec): min=980, max=858208, avg=39485.37, stdev=45078.17 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 4555], | 30.00th=[ 9372], 40.00th=[ 19006], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 50594], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[168821], 99.50th=[212861], 99.90th=[476054], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 116, per=25.59%, avg=51.18, stdev=20.84, samples=242 iops : min= 1, max= 29, avg=12.16, stdev= 5.26, samples=242 lat (usec) : 50=0.68%, 100=3.55%, 250=0.29%, 750=0.07%, 1000=0.07% lat (msec) : 2=5.50%, 4=3.94%, 10=6.74%, 20=10.03%, 50=38.74% lat (msec) : 100=24.74%, 250=5.53%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.39%, ctx=6599, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146019: Tue Jun 2 22:28:14 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6028KiB/122164msec) clat (usec): min=29, max=883901, avg=40357.26, stdev=37517.88 lat (usec): min=29, max=883902, avg=40365.80, stdev=37517.36 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 963], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[127402], 99.50th=[143655], 99.90th=[591397], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 5, max= 134, per=25.65%, avg=48.98, stdev=21.26, samples=239 iops : min= 1, max= 33, avg=11.61, stdev= 5.36, samples=239 write: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6260KiB/122164msec); 0 zone resets clat (usec): min=1099, max=485329, avg=38962.97, stdev=41104.20 lat (usec): min=1100, max=485330, avg=38970.04, stdev=41102.33 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 2024], 20.00th=[ 4490], | 30.00th=[ 9110], 40.00th=[ 18482], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[177210], 99.50th=[206570], 99.90th=[417334], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 126, per=25.29%, avg=50.57, stdev=19.87, samples=240 iops : min= 1, max= 31, avg=12.01, stdev= 5.00, samples=240 lat (usec) : 50=0.42%, 100=3.81%, 250=0.59%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.05%, 4=4.39%, 10=6.71%, 20=10.71%, 50=37.83% lat (msec) : 100=25.68%, 250=4.49%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.24%, ctx=6633, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146020: Tue Jun 2 22:28:14 2026 read: IOPS=12, BW=48.3KiB/s (49.4kB/s)(6052KiB/125379msec) clat (usec): min=34, max=448601, avg=39786.94, stdev=29143.75 lat (usec): min=34, max=448602, avg=39788.56, stdev=29143.17 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 8979], 20.00th=[ 19268], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[125305], 99.50th=[145753], 99.90th=[193987], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 118, per=25.53%, avg=48.77, stdev=19.22, samples=242 iops : min= 1, max= 29, avg=11.55, stdev= 4.85, samples=242 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125379msec); 0 zone resets clat (usec): min=1071, max=1165.6k, avg=41556.64, stdev=51575.99 lat (usec): min=1072, max=1165.6k, avg=41561.67, stdev=51574.32 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1549], | 20.00th=[ 4686], 30.00th=[ 9634], 40.00th=[ 20317], | 50.00th=[ 30540], 60.00th=[ 40633], 70.00th=[ 53216], | 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[ 117965], | 99.00th=[ 183501], 99.50th=[ 246416], 99.90th=[ 480248], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 127, per=24.90%, avg=49.80, stdev=19.21, samples=244 iops : min= 1, max= 31, avg=11.81, stdev= 4.83, samples=244 lat (usec) : 50=0.59%, 100=3.26%, 250=0.59%, 500=0.23%, 1000=0.03% lat (msec) : 2=6.25%, 4=3.09%, 10=6.58%, 20=10.25%, 50=37.99% lat (msec) : 100=25.16%, 250=5.76%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=5.05%, ctx=6649, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (196kB/s), 47.0KiB/s-49.6KiB/s (49.1kB/s-50.7kB/s), io=23.4MiB (24.6MB), run=120926-125379msec WRITE: bw=201KiB/s (205kB/s), 49.7KiB/s-52.1KiB/s (50.9kB/s-53.3kB/s), io=24.6MiB (25.7MB), run=120926-125379msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146021: Tue Jun 2 22:30:38 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(5992KiB/269093msec) clat (msec): min=6, max=927, avg=39.10, stdev=40.09 lat (msec): min=6, max=927, avg=39.11, stdev=40.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 165], 99.50th=[ 205], 99.90th=[ 393], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 95, per=27.96%, avg=24.89, stdev=15.68, samples=465 iops : min= 1, max= 23, avg= 5.57, stdev= 3.96, samples=465 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6296KiB/269093msec); 0 zone resets clat (msec): min=33, max=523, avg=133.54, stdev=61.04 lat (msec): min=33, max=523, avg=133.55, stdev=61.04 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 209], 95.00th=[ 251], | 99.00th=[ 342], 99.50th=[ 372], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 55, per=24.61%, avg=22.89, stdev= 9.66, samples=529 iops : min= 1, max= 13, avg= 5.06, stdev= 2.47, samples=529 lat (msec) : 10=2.31%, 20=11.04%, 50=25.26%, 100=24.41%, 250=34.21% lat (msec) : 500=2.64%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.43%, ctx=5738, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146022: Tue Jun 2 22:30:38 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5940KiB/269148msec) clat (msec): min=6, max=848, avg=40.24, stdev=40.42 lat (msec): min=6, max=848, avg=40.24, stdev=40.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 71], 95.00th=[ 102], | 99.00th=[ 178], 99.50th=[ 236], 99.90th=[ 384], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 87, per=27.59%, avg=24.56, stdev=15.76, samples=466 iops : min= 1, max= 21, avg= 5.49, stdev= 3.97, samples=466 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6348KiB/269148msec); 0 zone resets clat (msec): min=34, max=615, avg=131.68, stdev=56.39 lat (msec): min=34, max=615, avg=131.68, stdev=56.39 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 236], | 99.00th=[ 313], 99.50th=[ 342], 99.90th=[ 506], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 55, per=24.85%, avg=23.11, stdev= 9.18, samples=528 iops : min= 1, max= 13, avg= 5.12, stdev= 2.35, samples=528 lat (msec) : 10=1.79%, 20=11.23%, 50=24.87%, 100=25.23%, 250=34.73% lat (msec) : 500=2.05%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.42%, ctx=5609, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146023: Tue Jun 2 22:30:38 2026 read: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6028KiB/268652msec) clat (msec): min=6, max=401, avg=41.20, stdev=37.82 lat (msec): min=6, max=401, avg=41.21, stdev=37.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 79], 95.00th=[ 102], | 99.00th=[ 201], 99.50th=[ 275], 99.90th=[ 384], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 95, per=26.60%, avg=23.68, stdev=15.47, samples=490 iops : min= 1, max= 23, avg= 5.27, stdev= 3.91, samples=490 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6260KiB/268652msec); 0 zone resets clat (msec): min=32, max=1013, avg=131.74, stdev=61.22 lat (msec): min=32, max=1013, avg=131.74, stdev=61.22 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 205], 95.00th=[ 241], | 99.00th=[ 321], 99.50th=[ 368], 99.90th=[ 609], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 48, per=24.74%, avg=23.01, stdev= 9.62, samples=523 iops : min= 1, max= 12, avg= 5.10, stdev= 2.45, samples=523 lat (msec) : 10=1.46%, 20=11.04%, 50=25.49%, 100=25.33%, 250=34.24% lat (msec) : 500=2.38%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5572, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146024: Tue Jun 2 22:30:38 2026 read: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6052KiB/269251msec) clat (msec): min=6, max=471, avg=40.11, stdev=36.01 lat (msec): min=6, max=471, avg=40.11, stdev=36.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 188], 99.50th=[ 220], 99.90th=[ 326], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 111, per=27.94%, avg=24.86, stdev=16.44, samples=469 iops : min= 1, max= 27, avg= 5.56, stdev= 4.13, samples=469 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6236KiB/269251msec); 0 zone resets clat (msec): min=36, max=1169, avg=133.58, stdev=64.85 lat (msec): min=36, max=1169, avg=133.59, stdev=64.86 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 209], 95.00th=[ 247], | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 609], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 47, per=24.37%, avg=22.66, stdev= 9.45, samples=528 iops : min= 1, max= 11, avg= 5.01, stdev= 2.42, samples=528 lat (msec) : 10=2.12%, 20=11.30%, 50=25.13%, 100=24.06%, 250=34.96% lat (msec) : 500=2.31%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.42%, ctx=5703, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.2KiB/s (91.3kB/s), 22.1KiB/s-22.5KiB/s (22.6kB/s-23.0kB/s), io=23.4MiB (24.6MB), run=268652-269251msec WRITE: bw=93.4KiB/s (95.6kB/s), 23.2KiB/s-23.6KiB/s (23.7kB/s-24.2kB/s), io=24.6MiB (25.7MB), run=268652-269251msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Tue Jun 2 22:31:22 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5920KiB/31240msec) clat (usec): min=40, max=343958, avg=46268.86, stdev=39557.58 lat (usec): min=40, max=343959, avg=46269.99, stdev=39557.60 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 19530], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[173016], 99.50th=[252707], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 382, per=26.12%, avg=187.57, stdev=82.18, samples=61 iops : min= 1, max= 23, avg=10.97, stdev= 5.19, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31240msec); 0 zone resets clat (usec): min=1552, max=424805, avg=35350.75, stdev=44355.11 lat (usec): min=1553, max=424807, avg=35353.14, stdev=44354.99 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 2245], 20.00th=[ 5014], | 30.00th=[ 8586], 40.00th=[ 12911], 50.00th=[ 21365], 60.00th=[ 29754], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[242222], 99.50th=[325059], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 31, max= 347, per=26.78%, avg=202.49, stdev=81.13, samples=61 iops : min= 1, max= 21, avg=11.93, stdev= 5.12, samples=61 lat (usec) : 50=0.91%, 100=6.25%, 250=0.39%, 750=0.26%, 1000=0.13% lat (msec) : 2=4.30%, 4=4.17%, 10=9.38%, 20=8.98%, 50=34.38% lat (msec) : 100=23.18%, 250=7.03%, 500=0.65% cpu : usr=0.09%, sys=5.54%, ctx=1450, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146085: Tue Jun 2 22:31:22 2026 read: IOPS=10, BW=172KiB/s (177kB/s)(5744KiB/33324msec) clat (usec): min=35, max=267349, avg=49813.33, stdev=38444.27 lat (usec): min=35, max=267350, avg=49814.44, stdev=38444.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 21627], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[120062], | 99.00th=[173016], 99.50th=[217056], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 411, per=24.51%, avg=176.02, stdev=79.97, samples=63 iops : min= 1, max= 25, avg=10.24, stdev= 5.06, samples=63 write: IOPS=12, BW=196KiB/s (201kB/s)(6544KiB/33324msec); 0 zone resets clat (usec): min=1233, max=294738, avg=37643.03, stdev=44375.48 lat (usec): min=1234, max=294740, avg=37644.92, stdev=44375.53 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1729], 10.00th=[ 2442], 20.00th=[ 5276], | 30.00th=[ 9372], 40.00th=[ 14222], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 44827], 80.00th=[ 61604], 90.00th=[ 89654], 95.00th=[124257], | 99.00th=[202376], 99.50th=[270533], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 381, per=25.74%, avg=194.58, stdev=80.64, samples=65 iops : min= 1, max= 23, avg=11.42, stdev= 5.10, samples=65 lat (usec) : 50=0.52%, 100=5.73%, 250=0.91%, 500=0.13% lat (msec) : 2=4.95%, 4=3.52%, 10=8.33%, 20=10.03%, 50=30.73% lat (msec) : 100=25.78%, 250=8.85%, 500=0.52% cpu : usr=0.06%, sys=4.98%, ctx=1423, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146086: Tue Jun 2 22:31:22 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32217msec) clat (usec): min=40, max=229045, avg=44905.72, stdev=37321.39 lat (usec): min=41, max=229046, avg=44906.82, stdev=37321.38 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 14484], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[189793], 99.50th=[217056], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 508, per=27.13%, avg=194.78, stdev=81.22, samples=63 iops : min= 3, max= 31, avg=11.44, stdev= 5.09, samples=63 write: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32217msec); 0 zone resets clat (usec): min=1382, max=262470, avg=38711.82, stdev=44022.10 lat (usec): min=1383, max=262472, avg=38713.84, stdev=44022.01 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 5276], | 30.00th=[ 9110], 40.00th=[ 13698], 50.00th=[ 23725], 60.00th=[ 34866], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 91751], 95.00th=[133694], | 99.00th=[193987], 99.50th=[261096], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 30, max= 380, per=24.79%, avg=187.43, stdev=80.55, samples=63 iops : min= 1, max= 23, avg=10.95, stdev= 5.09, samples=63 lat (usec) : 50=0.52%, 100=7.68%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=3.12%, 10=8.33%, 20=8.33%, 50=33.59% lat (msec) : 100=24.48%, 250=7.81%, 500=0.26% cpu : usr=0.09%, sys=5.03%, ctx=1444, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146087: Tue Jun 2 22:31:22 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(6032KiB/32516msec) clat (usec): min=33, max=320990, avg=45217.31, stdev=39754.78 lat (usec): min=34, max=320991, avg=45218.34, stdev=39754.77 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 3163], | 30.00th=[ 24773], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[189793], 99.50th=[240124], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 568, per=26.63%, avg=191.20, stdev=90.99, samples=61 iops : min= 1, max= 35, avg=11.20, stdev= 5.74, samples=61 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32516msec); 0 zone resets clat (usec): min=1449, max=372673, avg=39463.68, stdev=51566.22 lat (usec): min=1451, max=372676, avg=39465.72, stdev=51566.24 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1844], 10.00th=[ 2409], 20.00th=[ 5932], | 30.00th=[ 8455], 40.00th=[ 13435], 50.00th=[ 20841], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[132645], | 99.00th=[312476], 99.50th=[341836], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 30, max= 440, per=25.52%, avg=192.97, stdev=87.92, samples=63 iops : min= 1, max= 27, avg=11.30, stdev= 5.53, samples=63 lat (usec) : 50=0.65%, 100=8.07%, 250=0.26%, 500=0.39%, 750=0.13% lat (msec) : 2=4.04%, 4=4.69%, 10=9.51%, 20=9.51%, 50=29.56% lat (msec) : 100=25.13%, 250=7.29%, 500=0.78% cpu : usr=0.06%, sys=5.05%, ctx=1398, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=719KiB/s (736kB/s), 172KiB/s-194KiB/s (177kB/s-199kB/s), io=23.4MiB (24.5MB), run=31240-33324msec WRITE: bw=756KiB/s (774kB/s), 187KiB/s-204KiB/s (192kB/s-209kB/s), io=24.6MiB (25.8MB), run=31240-33324msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Tue Jun 2 22:31:56 2026 read: IOPS=5, BW=87.8KiB/s (89.0kB/s)(5920KiB/67393msec) clat (msec): min=6, max=424, avg=41.37, stdev=52.29 lat (msec): min=6, max=424, avg=41.38, stdev=52.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 96], 95.00th=[ 136], | 99.00th=[ 300], 99.50th=[ 355], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 318, per=28.36%, avg=99.55, stdev=61.03, samples=117 iops : min= 1, max= 19, avg= 5.41, stdev= 3.91, samples=117 write: IOPS=5, BW=94.5KiB/s (96.8kB/s)(6368KiB/67393msec); 0 zone resets clat (msec): min=46, max=494, avg=130.66, stdev=74.60 lat (msec): min=46, max=494, avg=130.66, stdev=74.61 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 87], 40.00th=[ 94], 50.00th=[ 103], 60.00th=[ 117], | 70.00th=[ 138], 80.00th=[ 174], 90.00th=[ 243], 95.00th=[ 300], | 99.00th=[ 435], 99.50th=[ 464], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 192, per=25.63%, avg=94.82, stdev=50.48, samples=132 iops : min= 1, max= 12, avg= 5.10, stdev= 3.25, samples=132 lat (msec) : 10=2.73%, 20=18.75%, 50=17.19%, 100=29.56%, 250=26.82% lat (msec) : 500=4.95% cpu : usr=0.03%, sys=1.33%, ctx=1326, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Tue Jun 2 22:31:56 2026 read: IOPS=5, BW=84.4KiB/s (86.4kB/s)(5744KiB/68061msec) clat (msec): min=7, max=573, avg=40.86, stdev=50.60 lat (msec): min=7, max=573, avg=40.86, stdev=50.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 59], 90.00th=[ 94], 95.00th=[ 142], | 99.00th=[ 224], 99.50th=[ 305], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 23, max= 320, per=28.24%, avg=99.12, stdev=65.94, samples=113 iops : min= 1, max= 20, avg= 5.36, stdev= 4.18, samples=113 write: IOPS=6, BW=96.1KiB/s (98.5kB/s)(6544KiB/68061msec); 0 zone resets clat (msec): min=43, max=379, avg=130.11, stdev=67.14 lat (msec): min=43, max=379, avg=130.11, stdev=67.14 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 255, per=26.89%, avg=99.49, stdev=46.79, samples=129 iops : min= 1, max= 15, avg= 5.40, stdev= 3.00, samples=129 lat (msec) : 10=1.69%, 20=18.10%, 50=17.84%, 100=27.86%, 250=30.34% lat (msec) : 500=4.04%, 750=0.13% cpu : usr=0.04%, sys=1.36%, ctx=1366, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Tue Jun 2 22:31:56 2026 read: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6256KiB/65772msec) clat (msec): min=6, max=318, avg=35.69, stdev=38.29 lat (msec): min=6, max=318, avg=35.70, stdev=38.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 81], 95.00th=[ 121], | 99.00th=[ 194], 99.50th=[ 211], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 416, per=30.25%, avg=106.17, stdev=75.72, samples=116 iops : min= 1, max= 26, avg= 5.80, stdev= 4.84, samples=116 write: IOPS=5, BW=91.7KiB/s (93.9kB/s)(6032KiB/65772msec); 0 zone resets clat (msec): min=40, max=532, avg=136.99, stdev=81.76 lat (msec): min=40, max=532, avg=137.00, stdev=81.76 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 184], 90.00th=[ 247], 95.00th=[ 326], | 99.00th=[ 456], 99.50th=[ 472], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 191, per=25.13%, avg=92.98, stdev=46.45, samples=126 iops : min= 1, max= 11, avg= 4.98, stdev= 2.97, samples=126 lat (msec) : 10=3.26%, 20=19.66%, 50=19.01%, 100=26.56%, 250=26.69% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.03%, sys=1.35%, ctx=1381, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146082: Tue Jun 2 22:31:56 2026 read: IOPS=5, BW=89.7KiB/s (91.9kB/s)(6032KiB/67228msec) clat (msec): min=6, max=446, avg=37.88, stdev=43.54 lat (msec): min=6, max=446, avg=37.88, stdev=43.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 120], | 99.00th=[ 211], 99.50th=[ 266], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 256, per=28.85%, avg=101.27, stdev=62.57, samples=116 iops : min= 1, max= 16, avg= 5.52, stdev= 3.95, samples=116 write: IOPS=5, BW=93.1KiB/s (95.3kB/s)(6256KiB/67228msec); 0 zone resets clat (msec): min=52, max=510, avg=135.02, stdev=75.29 lat (msec): min=52, max=510, avg=135.02, stdev=75.30 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 70], 20.00th=[ 81], | 30.00th=[ 89], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 176], 90.00th=[ 241], 95.00th=[ 296], | 99.00th=[ 405], 99.50th=[ 464], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 30, max= 191, per=25.87%, avg=95.73, stdev=46.13, samples=128 iops : min= 1, max= 11, avg= 5.16, stdev= 2.98, samples=128 lat (msec) : 10=2.21%, 20=19.27%, 50=17.71%, 100=27.60%, 250=28.52% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.03%, sys=1.37%, ctx=1290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=352KiB/s (360kB/s), 84.4KiB/s-95.1KiB/s (86.4kB/s-97.4kB/s), io=23.4MiB (24.5MB), run=65772-68061msec WRITE: bw=370KiB/s (379kB/s), 91.7KiB/s-96.1KiB/s (93.9kB/s-98.5kB/s), io=24.6MiB (25.8MB), run=65772-68061msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146103: Tue Jun 2 22:32:12 2026 read: IOPS=2, BW=2176KiB/s (2228kB/s)(7168KiB/3294msec) clat (msec): min=92, max=296, avg=150.23, stdev=66.51 lat (msec): min=92, max=296, avg=150.23, stdev=66.51 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 126], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 130], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 142], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1961, max= 4445, per=66.03%, avg=2614.00, stdev=1221.05, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1554KiB/s (1592kB/s)(5120KiB/3294msec); 0 zone resets clat (msec): min=231, max=573, avg=430.01, stdev=144.48 lat (msec): min=235, max=573, avg=431.03, stdev=143.08 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1961, max= 3842, per=47.11%, avg=2611.33, stdev=1066.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=3.98%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146104: Tue Jun 2 22:32:12 2026 read: IOPS=0, BW=396KiB/s (405kB/s)(2048KiB/5172msec) clat (msec): min=87, max=188, avg=138.46, stdev=71.42 lat (msec): min=87, max=188, avg=138.47, stdev=71.42 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1440, max= 1851, per=41.56%, avg=1645.50, stdev=290.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1980KiB/s (2027kB/s)(10.0MiB/5172msec); 0 zone resets clat (msec): min=225, max=1015, avg=485.72, stdev=242.25 lat (msec): min=225, max=1015, avg=485.85, stdev=242.37 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 243], | 30.00th=[ 305], 40.00th=[ 372], 50.00th=[ 418], 60.00th=[ 464], | 70.00th=[ 472], 80.00th=[ 667], 90.00th=[ 676], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1440, max= 4087, per=45.09%, avg=2499.43, stdev=1050.69, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.56%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146105: Tue Jun 2 22:32:12 2026 read: IOPS=1, BW=1313KiB/s (1345kB/s)(6144KiB/4679msec) clat (msec): min=82, max=351, avg=217.39, stdev=99.67 lat (msec): min=82, max=351, avg=217.39, stdev=99.67 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 222], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1921, max= 4047, per=62.53%, avg=2475.50, stdev=1047.90, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1313KiB/s (1345kB/s)(6144KiB/4679msec); 0 zone resets clat (msec): min=248, max=999, avg=547.53, stdev=314.43 lat (msec): min=248, max=999, avg=547.62, stdev=314.43 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 709], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1479, max= 2031, per=33.57%, avg=1861.00, stdev=226.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.83%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146106: Tue Jun 2 22:32:12 2026 read: IOPS=1, BW=1134KiB/s (1161kB/s)(5120KiB/4515msec) clat (msec): min=107, max=971, avg=330.15, stdev=362.18 lat (msec): min=107, max=971, avg=330.15, stdev=362.18 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 3923, max= 3946, per=99.38%, avg=3934.50, stdev=16.26, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1588KiB/s (1626kB/s)(7168KiB/4515msec); 0 zone resets clat (msec): min=234, max=872, avg=403.31, stdev=235.75 lat (msec): min=234, max=872, avg=403.38, stdev=235.76 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 245], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 300], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 567], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1921, max= 4047, per=50.30%, avg=2788.00, stdev=1011.64, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=2.50%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3960KiB/s (4055kB/s), 396KiB/s-2176KiB/s (405kB/s-2228kB/s), io=20.0MiB (20.0MB), run=3294-5172msec WRITE: bw=5544KiB/s (5677kB/s), 1313KiB/s-1980KiB/s (1345kB/s-2027kB/s), io=28.0MiB (29.4MB), run=3294-5172msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146108: Tue Jun 2 22:32:13 2026 read: IOPS=2, BW=2164KiB/s (2216kB/s)(7168KiB/3313msec) clat (msec): min=2, max=397, avg=218.55, stdev=128.28 lat (msec): min=2, max=397, avg=218.55, stdev=128.28 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 115], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 234], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 309], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1875, max= 3255, per=54.67%, avg=2218.00, stdev=581.78, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1545KiB/s (1583kB/s)(5120KiB/3313msec); 0 zone resets clat (msec): min=179, max=578, avg=355.78, stdev=171.89 lat (msec): min=179, max=578, avg=355.85, stdev=171.89 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1984, max= 3716, per=45.19%, avg=2566.67, stdev=995.38, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.25%, ctx=177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146109: Tue Jun 2 22:32:13 2026 read: IOPS=0, BW=406KiB/s (416kB/s)(2048KiB/5047msec) clat (usec): min=515, max=346372, avg=173444.33, stdev=244557.87 lat (usec): min=516, max=346375, avg=173446.16, stdev=244559.13 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[346031], | 70.00th=[346031], 80.00th=[346031], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1605, max= 1858, per=42.68%, avg=1731.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2029KiB/s (2078kB/s)(10.0MiB/5047msec); 0 zone resets clat (msec): min=169, max=1001, avg=469.50, stdev=272.33 lat (msec): min=169, max=1001, avg=469.57, stdev=272.31 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 176], | 30.00th=[ 255], 40.00th=[ 309], 50.00th=[ 368], 60.00th=[ 456], | 70.00th=[ 558], 80.00th=[ 659], 90.00th=[ 751], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1858, max= 3968, per=44.38%, avg=2520.86, stdev=980.40, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.58%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146110: Tue Jun 2 22:32:13 2026 read: IOPS=1, BW=1769KiB/s (1812kB/s)(6144KiB/3473msec) clat (usec): min=465, max=261617, avg=134562.62, stdev=131170.03 lat (usec): min=466, max=261618, avg=134563.73, stdev=131170.01 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 46924], 50.00th=[ 46924], 60.00th=[242222], | 70.00th=[256902], 80.00th=[256902], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 2000, max= 3750, per=77.78%, avg=3155.33, stdev=1000.69, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1769KiB/s (1812kB/s)(6144KiB/3473msec); 0 zone resets clat (msec): min=199, max=797, avg=442.93, stdev=218.52 lat (msec): min=199, max=798, avg=443.89, stdev=218.74 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 422], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1641, max= 3716, per=39.49%, avg=2243.20, stdev=835.72, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 50=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.43%, ctx=202, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146111: Tue Jun 2 22:32:13 2026 read: IOPS=1, BW=1526KiB/s (1562kB/s)(5120KiB/3356msec) clat (usec): min=1708, max=274855, avg=110593.42, stdev=126773.65 lat (usec): min=1709, max=274856, avg=110594.84, stdev=126773.60 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1713], 10.00th=[ 1713], 20.00th=[ 1713], | 30.00th=[ 3130], 40.00th=[ 3130], 50.00th=[ 57410], 60.00th=[ 57410], | 70.00th=[214959], 80.00th=[214959], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7433, max= 7433, per=100.00%, avg=7433.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2136KiB/s (2187kB/s)(7168KiB/3356msec); 0 zone resets clat (msec): min=109, max=807, avg=398.96, stdev=247.42 lat (msec): min=109, max=807, avg=399.05, stdev=247.43 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 262], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 676], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1602, max= 4000, per=40.27%, avg=2287.40, stdev=969.78, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=16.67%, 500=41.67% lat (msec) : 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=10.43%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4058KiB/s (4155kB/s), 406KiB/s-2164KiB/s (416kB/s-2216kB/s), io=20.0MiB (20.0MB), run=3313-5047msec WRITE: bw=5681KiB/s (5817kB/s), 1545KiB/s-2136KiB/s (1583kB/s-2187kB/s), io=28.0MiB (29.4MB), run=3313-5047msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146119: Tue Jun 2 22:32:27 2026 read: IOPS=0, BW=3954KiB/s (4049kB/s)(12.0MiB/3108msec) clat (msec): min=797, max=1065, avg=941.52, stdev=135.30 lat (msec): min=797, max=1065, avg=941.53, stdev=135.30 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.65%, ctx=300, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146120: Tue Jun 2 22:32:27 2026 read: IOPS=0, BW=1148KiB/s (1176kB/s)(4096KiB/3567msec) clat (nsec): min=961907k, max=961907k, avg=961907016.00, stdev= 0.00 lat (nsec): min=961910k, max=961910k, avg=961909621.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2297KiB/s (2352kB/s)(8192KiB/3567msec); 0 zone resets clat (msec): min=832, max=1609, avg=1221.19, stdev=549.04 lat (msec): min=833, max=1609, avg=1221.60, stdev=549.13 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8143, max= 8143, per=88.65%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.60%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146122: Tue Jun 2 22:32:27 2026 write: IOPS=2, BW=8840KiB/s (9052kB/s)(12.0MiB/1390msec); 0 zone resets clat (msec): min=378, max=434, avg=411.69, stdev=29.34 lat (msec): min=378, max=434, avg=412.03, stdev=29.39 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 6803, max= 8078, per=81.00%, avg=7440.50, stdev=901.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=11.02%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146124: Tue Jun 2 22:32:27 2026 write: IOPS=0, BW=3522KiB/s (3606kB/s)(12.0MiB/3489msec); 0 zone resets clat (msec): min=466, max=2098, avg=1140.15, stdev=852.31 lat (msec): min=466, max=2098, avg=1140.57, stdev=852.46 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8078, max= 8175, per=88.47%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.87%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4593KiB/s (4703kB/s), 1148KiB/s-3954KiB/s (1176kB/s-4049kB/s), io=16.0MiB (16.8MB), run=3108-3567msec WRITE: bw=9186KiB/s (9407kB/s), 2297KiB/s-8840KiB/s (2352kB/s-9052kB/s), io=32.0MiB (33.6MB), run=1390-3567msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146121: Tue Jun 2 22:32:28 2026 read: IOPS=0, BW=3676KiB/s (3764kB/s)(12.0MiB/3343msec) clat (msec): min=928, max=1191, avg=1029.28, stdev=141.46 lat (msec): min=928, max=1191, avg=1029.28, stdev=141.46 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.35%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146123: Tue Jun 2 22:32:28 2026 read: IOPS=0, BW=1074KiB/s (1100kB/s)(4096KiB/3814msec) clat (nsec): min=1106.9M, max=1106.9M, avg=1106897106.00, stdev= 0.00 lat (nsec): min=1106.9M, max=1106.9M, avg=1106899590.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2148KiB/s (2199kB/s)(8192KiB/3814msec); 0 zone resets clat (msec): min=974, max=1335, avg=1154.82, stdev=255.43 lat (msec): min=975, max=1335, avg=1155.40, stdev=255.06 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.96%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146125: Tue Jun 2 22:32:28 2026 write: IOPS=0, BW=2658KiB/s (2722kB/s)(12.0MiB/4623msec); 0 zone resets clat (msec): min=507, max=2300, avg=1469.20, stdev=903.63 lat (msec): min=507, max=2300, avg=1469.45, stdev=903.57 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7937, max= 8126, per=100.00%, avg=8031.50, stdev=133.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.92%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146126: Tue Jun 2 22:32:28 2026 write: IOPS=1, BW=4099KiB/s (4197kB/s)(12.0MiB/2998msec); 0 zone resets clat (msec): min=379, max=1743, avg=969.32, stdev=700.61 lat (msec): min=379, max=1744, avg=969.61, stdev=700.61 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7728, max= 8126, per=100.00%, avg=7927.00, stdev=281.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.47%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4296KiB/s (4399kB/s), 1074KiB/s-3676KiB/s (1100kB/s-3764kB/s), io=16.0MiB (16.8MB), run=3343-3814msec WRITE: bw=7088KiB/s (7258kB/s), 2148KiB/s-4099KiB/s (2199kB/s-4197kB/s), io=32.0MiB (33.6MB), run=2998-4623msec