== sanity test 398b: DIO and buffer IO race ============== 06:36:51 (1773225411) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.39972 s, 14.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182208: Wed Mar 11 06:38:07 2026 read: IOPS=22, BW=91.9KiB/s (94.1kB/s)(5992KiB/65190msec) clat (usec): min=26, max=678547, avg=23763.39, stdev=21980.66 lat (usec): min=26, max=678549, avg=23765.52, stdev=21981.48 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 7504], 10.00th=[ 10159], 20.00th=[ 13173], | 30.00th=[ 15533], 40.00th=[ 17957], 50.00th=[ 20841], 60.00th=[ 23987], | 70.00th=[ 27657], 80.00th=[ 31851], 90.00th=[ 39584], 95.00th=[ 46400], | 99.00th=[ 74974], 99.50th=[ 89654], 99.90th=[135267], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 39, max= 151, per=25.04%, avg=92.16, stdev=24.43, samples=128 iops : min= 9, max= 37, avg=22.52, stdev= 6.14, samples=128 write: IOPS=24, BW=96.6KiB/s (98.9kB/s)(6296KiB/65190msec); 0 zone resets clat (usec): min=716, max=121816, avg=18620.82, stdev=16592.93 lat (usec): min=716, max=121817, avg=18623.65, stdev=16597.25 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1745], 10.00th=[ 2409], 20.00th=[ 3752], | 30.00th=[ 6325], 40.00th=[ 10945], 50.00th=[ 14746], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 31327], 90.00th=[ 41157], 95.00th=[ 51119], | 99.00th=[ 78119], 99.50th=[ 83362], 99.90th=[ 91751], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 32, max= 175, per=25.17%, avg=96.91, stdev=27.74, samples=128 iops : min= 8, max= 43, avg=23.70, stdev= 6.89, samples=128 lat (usec) : 50=0.13%, 100=1.07%, 250=0.65%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=3.61%, 4=7.19%, 10=10.94%, 20=31.90%, 50=39.68% lat (msec) : 100=4.30%, 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=14.43%, ctx=8122, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182209: Wed Mar 11 06:38:07 2026 read: IOPS=23, BW=92.1KiB/s (94.3kB/s)(5940KiB/64524msec) clat (usec): min=39, max=158497, avg=23513.54, stdev=14526.05 lat (usec): min=40, max=158499, avg=23514.65, stdev=14526.05 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 8848], 10.00th=[ 10421], 20.00th=[ 12911], | 30.00th=[ 15139], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23462], | 70.00th=[ 27132], 80.00th=[ 31589], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 79168], 99.50th=[ 87557], 99.90th=[102237], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 6, max= 151, per=24.90%, avg=91.64, stdev=27.13, samples=128 iops : min= 1, max= 37, avg=22.38, stdev= 6.76, samples=128 write: IOPS=24, BW=98.4KiB/s (101kB/s)(6348KiB/64524msec); 0 zone resets clat (usec): min=757, max=661493, avg=18480.24, stdev=22750.79 lat (usec): min=757, max=661495, avg=18481.79, stdev=22750.89 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1729], 10.00th=[ 2409], 20.00th=[ 3621], | 30.00th=[ 6128], 40.00th=[ 10814], 50.00th=[ 14353], 60.00th=[ 17957], | 70.00th=[ 22676], 80.00th=[ 30540], 90.00th=[ 39584], 95.00th=[ 49021], | 99.00th=[ 67634], 99.50th=[ 92799], 99.90th=[110625], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 39, max= 176, per=25.58%, avg=98.49, stdev=29.18, samples=127 iops : min= 9, max= 44, avg=24.09, stdev= 7.30, samples=127 lat (usec) : 50=0.16%, 100=0.85%, 250=0.20%, 500=0.07%, 1000=0.13% lat (msec) : 2=3.65%, 4=7.75%, 10=11.00%, 20=33.72%, 50=37.70% lat (msec) : 100=4.59%, 250=0.16%, 750=0.03% cpu : usr=0.12%, sys=14.63%, ctx=8128, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182210: Wed Mar 11 06:38:07 2026 read: IOPS=23, BW=94.1KiB/s (96.4kB/s)(6028KiB/64043msec) clat (usec): min=38, max=671262, avg=23745.02, stdev=21759.59 lat (usec): min=38, max=671264, avg=23746.11, stdev=21759.63 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 8094], 10.00th=[ 10290], 20.00th=[ 13173], | 30.00th=[ 15270], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 23725], | 70.00th=[ 27657], 80.00th=[ 32113], 90.00th=[ 40633], 95.00th=[ 46924], | 99.00th=[ 68682], 99.50th=[ 83362], 99.90th=[168821], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 6, max= 167, per=25.48%, avg=93.76, stdev=23.63, samples=127 iops : min= 1, max= 41, avg=22.91, stdev= 5.95, samples=127 write: IOPS=24, BW=97.7KiB/s (100kB/s)(6260KiB/64043msec); 0 zone resets clat (usec): min=838, max=107958, avg=17893.30, stdev=15960.11 lat (usec): min=840, max=107959, avg=17894.70, stdev=15960.09 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1827], 10.00th=[ 2573], 20.00th=[ 3654], | 30.00th=[ 5669], 40.00th=[ 10290], 50.00th=[ 14091], 60.00th=[ 17695], | 70.00th=[ 22414], 80.00th=[ 29492], 90.00th=[ 40633], 95.00th=[ 50070], | 99.00th=[ 68682], 99.50th=[ 77071], 99.90th=[106431], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 20, max= 175, per=25.30%, avg=97.40, stdev=29.83, samples=127 iops : min= 5, max= 43, avg=23.83, stdev= 7.43, samples=127 lat (usec) : 50=0.13%, 100=1.07%, 250=0.59%, 500=0.07%, 1000=0.10% lat (msec) : 2=3.12%, 4=8.46%, 10=10.84%, 20=32.39%, 50=38.87% lat (msec) : 100=4.10%, 250=0.23%, 750=0.03% cpu : usr=0.12%, sys=14.86%, ctx=7978, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182211: Wed Mar 11 06:38:07 2026 read: IOPS=23, BW=93.2KiB/s (95.5kB/s)(6052KiB/64921msec) clat (usec): min=41, max=707841, avg=23321.68, stdev=22231.19 lat (usec): min=41, max=707842, avg=23323.23, stdev=22231.32 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 7308], 10.00th=[ 9896], 20.00th=[ 12780], | 30.00th=[ 14746], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23725], | 70.00th=[ 27395], 80.00th=[ 31851], 90.00th=[ 39584], 95.00th=[ 47449], | 99.00th=[ 67634], 99.50th=[ 77071], 99.90th=[117965], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 6, max= 152, per=25.26%, avg=92.96, stdev=26.10, samples=129 iops : min= 1, max= 38, avg=22.72, stdev= 6.55, samples=129 write: IOPS=24, BW=96.1KiB/s (98.4kB/s)(6236KiB/64921msec); 0 zone resets clat (usec): min=855, max=124144, avg=18822.60, stdev=16507.42 lat (usec): min=856, max=124145, avg=18824.82, stdev=16506.94 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1647], 10.00th=[ 2311], 20.00th=[ 3589], | 30.00th=[ 6128], 40.00th=[ 11076], 50.00th=[ 15139], 60.00th=[ 19792], | 70.00th=[ 25035], 80.00th=[ 31851], 90.00th=[ 41681], 95.00th=[ 50070], | 99.00th=[ 68682], 99.50th=[ 82314], 99.90th=[119014], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 24, max= 166, per=24.88%, avg=95.78, stdev=25.99, samples=129 iops : min= 6, max= 41, avg=23.43, stdev= 6.50, samples=129 lat (usec) : 50=0.20%, 100=1.17%, 250=0.62%, 500=0.03%, 1000=0.23% lat (msec) : 2=3.29%, 4=7.71%, 10=10.97%, 20=30.70%, 50=40.46% lat (msec) : 100=4.39%, 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=14.45%, ctx=8103, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=368KiB/s (377kB/s), 91.9KiB/s-94.1KiB/s (94.1kB/s-96.4kB/s), io=23.4MiB (24.6MB), run=64043-65190msec WRITE: bw=386KiB/s (395kB/s), 96.1KiB/s-98.4KiB/s (98.4kB/s-101kB/s), io=24.6MiB (25.7MB), run=64043-65190msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182213: Wed Mar 11 06:38:25 2026 read: IOPS=17, BW=71.8KiB/s (73.5kB/s)(5992KiB/83447msec) clat (msec): min=3, max=677, avg=22.36, stdev=25.46 lat (msec): min=3, max=677, avg=22.36, stdev=25.46 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 49], 95.00th=[ 61], | 99.00th=[ 100], 99.50th=[ 111], 99.90th=[ 153], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 207, per=24.94%, avg=71.58, stdev=41.70, samples=164 iops : min= 1, max= 51, avg=17.38, stdev=10.47, samples=164 write: IOPS=18, BW=75.4KiB/s (77.3kB/s)(6296KiB/83447msec); 0 zone resets clat (msec): min=7, max=182, avg=31.63, stdev=20.55 lat (msec): min=7, max=182, avg=31.63, stdev=20.55 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 60], 95.00th=[ 71], | 99.00th=[ 104], 99.50th=[ 118], 99.90th=[ 165], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 15, max= 192, per=25.07%, avg=75.20, stdev=40.84, samples=164 iops : min= 3, max= 48, avg=18.29, stdev=10.26, samples=164 lat (msec) : 4=0.03%, 10=12.47%, 20=38.28%, 50=36.30%, 100=11.88% lat (msec) : 250=1.01%, 750=0.03% cpu : usr=0.11%, sys=6.41%, ctx=5468, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182214: Wed Mar 11 06:38:25 2026 read: IOPS=17, BW=71.0KiB/s (72.7kB/s)(5940KiB/83628msec) clat (msec): min=4, max=718, avg=22.45, stdev=26.30 lat (msec): min=4, max=718, avg=22.45, stdev=26.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 49], 95.00th=[ 63], | 99.00th=[ 97], 99.50th=[ 106], 99.90th=[ 153], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 224, per=24.76%, avg=71.05, stdev=43.99, samples=165 iops : min= 1, max= 56, avg=17.25, stdev=11.01, samples=165 write: IOPS=18, BW=75.9KiB/s (77.7kB/s)(6348KiB/83628msec); 0 zone resets clat (msec): min=6, max=166, avg=31.56, stdev=20.33 lat (msec): min=6, max=166, avg=31.56, stdev=20.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 60], 95.00th=[ 72], | 99.00th=[ 100], 99.50th=[ 112], 99.90th=[ 157], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 7, max= 199, per=25.26%, avg=75.79, stdev=39.67, samples=165 iops : min= 1, max= 49, avg=18.44, stdev= 9.97, samples=165 lat (msec) : 10=12.60%, 20=37.73%, 50=36.59%, 100=12.24%, 250=0.81% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=6.27%, ctx=5437, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182215: Wed Mar 11 06:38:25 2026 read: IOPS=18, BW=72.2KiB/s (73.9kB/s)(6028KiB/83483msec) clat (msec): min=4, max=135, avg=21.74, stdev=17.51 lat (msec): min=4, max=135, avg=21.75, stdev=17.51 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 105], 99.90th=[ 124], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 15, max= 200, per=25.21%, avg=72.36, stdev=42.00, samples=165 iops : min= 3, max= 50, avg=17.58, stdev=10.53, samples=165 write: IOPS=18, BW=74.0KiB/s (76.8kB/s)(6260KiB/83483msec); 0 zone resets clat (msec): min=7, max=726, avg=32.29, stdev=27.02 lat (msec): min=7, max=726, avg=32.29, stdev=27.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 101], 99.50th=[ 120], 99.90th=[ 155], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 208, per=25.04%, avg=75.13, stdev=41.51, samples=165 iops : min= 5, max= 52, avg=18.27, stdev=10.43, samples=165 lat (msec) : 10=13.15%, 20=36.72%, 50=37.24%, 100=12.11%, 250=0.75% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=6.32%, ctx=5438, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182216: Wed Mar 11 06:38:25 2026 read: IOPS=18, BW=72.7KiB/s (74.5kB/s)(6052KiB/83233msec) clat (msec): min=4, max=126, avg=21.61, stdev=17.89 lat (msec): min=4, max=126, avg=21.61, stdev=17.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 47], 95.00th=[ 59], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 125], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 7, max= 216, per=25.70%, avg=73.76, stdev=42.23, samples=162 iops : min= 1, max= 54, avg=17.93, stdev=10.59, samples=162 write: IOPS=18, BW=74.9KiB/s (76.7kB/s)(6236KiB/83233msec); 0 zone resets clat (msec): min=6, max=720, avg=32.31, stdev=26.99 lat (msec): min=6, max=720, avg=32.31, stdev=26.99 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 73], | 99.00th=[ 102], 99.50th=[ 121], 99.90th=[ 180], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 15, max= 215, per=24.95%, avg=74.86, stdev=39.85, samples=164 iops : min= 3, max= 53, avg=18.20, stdev=10.01, samples=164 lat (msec) : 10=12.99%, 20=36.52%, 50=38.15%, 100=11.49%, 250=0.81% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=6.47%, ctx=5436, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=287KiB/s (294kB/s), 71.0KiB/s-72.7KiB/s (72.7kB/s-74.5kB/s), io=23.4MiB (24.6MB), run=83233-83628msec WRITE: bw=301KiB/s (308kB/s), 74.9KiB/s-75.9KiB/s (76.7kB/s-77.7kB/s), io=24.6MiB (25.7MB), run=83233-83628msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182248: Wed Mar 11 06:38:48 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(5920KiB/18810msec) clat (usec): min=44, max=111326, avg=25655.84, stdev=15250.66 lat (usec): min=45, max=111328, avg=25657.08, stdev=15250.66 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 157], 10.00th=[ 10552], 20.00th=[ 15008], | 30.00th=[ 17695], 40.00th=[ 20055], 50.00th=[ 23200], 60.00th=[ 26608], | 70.00th=[ 30278], 80.00th=[ 34866], 90.00th=[ 43779], 95.00th=[ 52691], | 99.00th=[ 80217], 99.50th=[ 86508], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 95, max= 510, per=24.65%, avg=313.27, stdev=95.73, samples=37 iops : min= 5, max= 31, avg=19.05, stdev= 5.99, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18810msec); 0 zone resets clat (usec): min=1379, max=101624, avg=22936.35, stdev=18501.05 lat (usec): min=1380, max=101626, avg=22938.79, stdev=18501.13 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2671], 10.00th=[ 3851], 20.00th=[ 5538], | 30.00th=[ 9765], 40.00th=[ 13829], 50.00th=[ 18220], 60.00th=[ 23462], | 70.00th=[ 30016], 80.00th=[ 37487], 90.00th=[ 47973], 95.00th=[ 56886], | 99.00th=[ 83362], 99.50th=[ 87557], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 127, max= 544, per=25.32%, avg=338.84, stdev=90.34, samples=37 iops : min= 7, max= 34, avg=20.65, stdev= 5.78, samples=37 lat (usec) : 50=0.65%, 100=1.43%, 250=1.04%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.17%, 4=4.56%, 10=10.68%, 20=27.47%, 50=45.05% lat (msec) : 100=7.42%, 250=0.26% cpu : usr=0.12%, sys=15.27%, ctx=2303, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182250: Wed Mar 11 06:38:48 2026 read: IOPS=19, BW=305KiB/s (312kB/s)(5744KiB/18832msec) clat (usec): min=42, max=92025, avg=27549.09, stdev=15256.06 lat (usec): min=43, max=92026, avg=27550.34, stdev=15256.08 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 8848], 10.00th=[12256], 20.00th=[15795], | 30.00th=[19530], 40.00th=[22676], 50.00th=[25297], 60.00th=[28443], | 70.00th=[32637], 80.00th=[36963], 90.00th=[46400], 95.00th=[55313], | 99.00th=[84411], 99.50th=[88605], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 54, max= 478, per=24.05%, avg=305.65, stdev=92.69, samples=37 iops : min= 3, max= 29, avg=18.57, stdev= 5.83, samples=37 write: IOPS=21, BW=347KiB/s (356kB/s)(6544KiB/18832msec); 0 zone resets clat (usec): min=1774, max=90472, avg=21470.92, stdev=17731.69 lat (usec): min=1775, max=90474, avg=21472.96, stdev=17731.72 clat percentiles (usec): | 1.00th=[ 2212], 5.00th=[ 3032], 10.00th=[ 4015], 20.00th=[ 6063], | 30.00th=[ 9765], 40.00th=[13173], 50.00th=[17171], 60.00th=[21890], | 70.00th=[26870], 80.00th=[33162], 90.00th=[42730], 95.00th=[57934], | 99.00th=[79168], 99.50th=[85459], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 96, max= 640, per=25.93%, avg=346.92, stdev=115.22, samples=37 iops : min= 6, max= 40, avg=21.16, stdev= 7.22, samples=37 lat (usec) : 50=0.26%, 100=1.04%, 250=0.65%, 500=0.13% lat (msec) : 2=0.26%, 4=4.56%, 10=12.37%, 20=26.04%, 50=47.53% lat (msec) : 100=7.16% cpu : usr=0.08%, sys=15.39%, ctx=2368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182251: Wed Mar 11 06:38:48 2026 read: IOPS=21, BW=343KiB/s (351kB/s)(6256KiB/18248msec) clat (usec): min=41, max=122850, avg=25705.95, stdev=16041.68 lat (usec): min=42, max=122852, avg=25707.27, stdev=16041.67 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 125], 10.00th=[ 10945], 20.00th=[ 14484], | 30.00th=[ 17433], 40.00th=[ 20055], 50.00th=[ 22676], 60.00th=[ 26346], | 70.00th=[ 29492], 80.00th=[ 35390], 90.00th=[ 44303], 95.00th=[ 54264], | 99.00th=[ 83362], 99.50th=[101188], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 96, max= 576, per=26.98%, avg=342.86, stdev=92.98, samples=36 iops : min= 6, max= 36, avg=20.89, stdev= 5.88, samples=36 write: IOPS=20, BW=331KiB/s (338kB/s)(6032KiB/18248msec); 0 zone resets clat (usec): min=1277, max=112958, avg=21605.27, stdev=17357.17 lat (usec): min=1277, max=112960, avg=21607.59, stdev=17356.97 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2442], 10.00th=[ 3523], 20.00th=[ 5669], | 30.00th=[ 9634], 40.00th=[ 13304], 50.00th=[ 17171], 60.00th=[ 22152], | 70.00th=[ 27919], 80.00th=[ 36439], 90.00th=[ 45351], 95.00th=[ 53740], | 99.00th=[ 76022], 99.50th=[ 92799], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 127, max= 544, per=24.34%, avg=325.61, stdev=99.28, samples=36 iops : min= 7, max= 34, avg=19.81, stdev= 6.40, samples=36 lat (usec) : 50=0.13%, 100=1.17%, 250=1.56%, 750=0.13% lat (msec) : 2=1.69%, 4=4.69%, 10=10.42%, 20=28.52%, 50=44.92% lat (msec) : 100=6.38%, 250=0.39% cpu : usr=0.12%, sys=15.35%, ctx=2262, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182252: Wed Mar 11 06:38:48 2026 read: IOPS=20, BW=322KiB/s (330kB/s)(6032KiB/18707msec) clat (usec): min=41, max=146102, avg=25396.26, stdev=15510.57 lat (usec): min=42, max=146103, avg=25397.45, stdev=15510.59 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 91], 10.00th=[ 9634], 20.00th=[ 15270], | 30.00th=[ 18482], 40.00th=[ 20841], 50.00th=[ 23725], 60.00th=[ 27132], | 70.00th=[ 30540], 80.00th=[ 34866], 90.00th=[ 42206], 95.00th=[ 50070], | 99.00th=[ 72877], 99.50th=[107480], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 96, max= 509, per=25.28%, avg=321.35, stdev=105.17, samples=37 iops : min= 6, max= 31, avg=19.54, stdev= 6.57, samples=37 write: IOPS=20, BW=334KiB/s (342kB/s)(6256KiB/18707msec); 0 zone resets clat (usec): min=1687, max=140528, avg=22820.64, stdev=19616.23 lat (usec): min=1688, max=140531, avg=22822.80, stdev=19616.33 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3294], 10.00th=[ 4293], 20.00th=[ 6325], | 30.00th=[ 10290], 40.00th=[ 13698], 50.00th=[ 17433], 60.00th=[ 21890], | 70.00th=[ 28967], 80.00th=[ 35914], 90.00th=[ 46924], 95.00th=[ 59507], | 99.00th=[101188], 99.50th=[123208], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 190, max= 538, per=25.08%, avg=335.54, stdev=76.79, samples=37 iops : min= 11, max= 33, avg=20.43, stdev= 4.92, samples=37 lat (usec) : 50=0.26%, 100=2.86%, 250=1.04%, 500=0.13% lat (msec) : 2=0.65%, 4=3.91%, 10=11.20%, 20=26.43%, 50=47.27% lat (msec) : 100=5.47%, 250=0.78% cpu : usr=0.11%, sys=15.10%, ctx=2308, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1272KiB/s (1302kB/s), 305KiB/s-343KiB/s (312kB/s-351kB/s), io=23.4MiB (24.5MB), run=18248-18832msec WRITE: bw=1338KiB/s (1370kB/s), 331KiB/s-347KiB/s (338kB/s-356kB/s), io=24.6MiB (25.8MB), run=18248-18832msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182253: Wed Mar 11 06:38:53 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(5920KiB/23325msec) clat (msec): min=5, max=118, avg=24.05, stdev=18.82 lat (msec): min=5, max=118, avg=24.05, stdev=18.82 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 68], | 99.00th=[ 92], 99.50th=[ 116], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 64, max= 608, per=24.94%, avg=251.85, stdev=145.36, samples=46 iops : min= 4, max= 38, avg=15.17, stdev= 9.12, samples=46 write: IOPS=17, BW=273KiB/s (280kB/s)(6368KiB/23325msec); 0 zone resets clat (msec): min=8, max=163, avg=35.99, stdev=23.53 lat (msec): min=8, max=163, avg=35.99, stdev=23.53 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 81], | 99.00th=[ 122], 99.50th=[ 155], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 95, max= 640, per=25.61%, avg=272.26, stdev=137.34, samples=46 iops : min= 5, max= 40, avg=16.46, stdev= 8.58, samples=46 lat (msec) : 10=8.20%, 20=33.85%, 50=41.67%, 100=14.97%, 250=1.30% cpu : usr=0.10%, sys=6.25%, ctx=1465, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182254: Wed Mar 11 06:38:53 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(5744KiB/23698msec) clat (msec): min=5, max=119, avg=25.48, stdev=20.39 lat (msec): min=5, max=119, avg=25.48, stdev=20.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 104], 99.50th=[ 118], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 32, max= 670, per=23.62%, avg=238.59, stdev=140.89, samples=46 iops : min= 2, max= 41, avg=14.35, stdev= 8.81, samples=46 write: IOPS=17, BW=276KiB/s (283kB/s)(6544KiB/23698msec); 0 zone resets clat (msec): min=8, max=181, avg=35.44, stdev=23.46 lat (msec): min=8, max=181, avg=35.45, stdev=23.46 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 110], 99.50th=[ 132], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 95, max= 798, per=25.16%, avg=267.41, stdev=144.37, samples=46 iops : min= 5, max= 49, avg=16.15, stdev= 8.97, samples=46 lat (msec) : 10=7.81%, 20=33.33%, 50=41.67%, 100=15.76%, 250=1.43% cpu : usr=0.07%, sys=6.19%, ctx=1433, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182255: Wed Mar 11 06:38:53 2026 read: IOPS=16, BW=268KiB/s (275kB/s)(6256KiB/23326msec) clat (msec): min=5, max=126, avg=24.87, stdev=20.33 lat (msec): min=5, max=126, avg=24.88, stdev=20.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 54], 95.00th=[ 75], | 99.00th=[ 99], 99.50th=[ 101], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 94, max= 702, per=26.69%, avg=269.52, stdev=151.03, samples=46 iops : min= 5, max= 43, avg=16.28, stdev= 9.47, samples=46 write: IOPS=16, BW=259KiB/s (265kB/s)(6032KiB/23326msec); 0 zone resets clat (msec): min=10, max=177, avg=35.77, stdev=22.98 lat (msec): min=10, max=177, avg=35.78, stdev=22.97 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 81], | 99.00th=[ 113], 99.50th=[ 159], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 32, max= 638, per=24.02%, avg=255.37, stdev=136.19, samples=46 iops : min= 2, max= 39, avg=15.39, stdev= 8.52, samples=46 lat (msec) : 10=8.20%, 20=35.03%, 50=40.62%, 100=15.23%, 250=0.91% cpu : usr=0.10%, sys=6.56%, ctx=1497, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182256: Wed Mar 11 06:38:53 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23489msec) clat (msec): min=4, max=131, avg=25.24, stdev=21.37 lat (msec): min=4, max=131, avg=25.24, stdev=21.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 39], 90.00th=[ 59], 95.00th=[ 71], | 99.00th=[ 95], 99.50th=[ 108], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 31, max= 798, per=25.12%, avg=253.70, stdev=155.29, samples=46 iops : min= 1, max= 49, avg=15.28, stdev= 9.71, samples=46 write: IOPS=16, BW=266KiB/s (273kB/s)(6256KiB/23489msec); 0 zone resets clat (msec): min=10, max=166, avg=35.28, stdev=21.99 lat (msec): min=10, max=166, avg=35.28, stdev=21.99 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 79], | 99.00th=[ 118], 99.50th=[ 126], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 63, max= 640, per=24.82%, avg=263.83, stdev=142.95, samples=46 iops : min= 3, max= 40, avg=15.93, stdev= 8.96, samples=46 lat (msec) : 10=8.33%, 20=35.03%, 50=39.84%, 100=15.49%, 250=1.30% cpu : usr=0.07%, sys=6.19%, ctx=1386, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1011KiB/s (1035kB/s), 242KiB/s-268KiB/s (248kB/s-275kB/s), io=23.4MiB (24.5MB), run=23325-23698msec WRITE: bw=1063KiB/s (1089kB/s), 259KiB/s-276KiB/s (265kB/s-283kB/s), io=24.6MiB (25.8MB), run=23325-23698msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182265: Wed Mar 11 06:39:02 2026 read: IOPS=1, BW=1964KiB/s (2011kB/s)(7168KiB/3650msec) clat (usec): min=528, max=2598.1k, avg=423996.64, stdev=960672.51 lat (usec): min=530, max=2598.1k, avg=423998.02, stdev=960672.44 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 562], 30.00th=[ 562], 40.00th=[ 562], | 50.00th=[ 109577], 60.00th=[ 124257], 70.00th=[ 124257], | 80.00th=[ 133694], 90.00th=[2600469], 95.00th=[2600469], | 99.00th=[2600469], 99.50th=[2600469], 99.90th=[2600469], | 99.95th=[2600469], 99.99th=[2600469] bw ( KiB/s): min= 2048, max= 6144, per=76.48%, avg=3992.33, stdev=2055.86, samples=3 iops : min= 2, max= 6, avg= 3.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1403KiB/s (1436kB/s)(5120KiB/3650msec); 0 zone resets clat (msec): min=97, max=139, avg=111.39, stdev=17.15 lat (msec): min=98, max=140, avg=111.45, stdev=17.14 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 108], 60.00th=[ 108], | 70.00th=[ 113], 80.00th=[ 113], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 lat (usec) : 750=25.00% lat (msec) : 100=16.67%, 250=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=23.68%, ctx=627, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182266: Wed Mar 11 06:39:02 2026 read: IOPS=0, BW=522KiB/s (535kB/s)(2048KiB/3923msec) clat (msec): min=132, max=161, avg=147.03, stdev=20.94 lat (msec): min=132, max=161, avg=147.03, stdev=20.94 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1835, max= 2019, per=36.92%, avg=1927.00, stdev=130.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2610KiB/s (2673kB/s)(10.0MiB/3923msec); 0 zone resets clat (msec): min=117, max=1612, avg=349.82, stdev=461.08 lat (msec): min=117, max=1612, avg=349.90, stdev=461.09 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 126], | 30.00th=[ 128], 40.00th=[ 136], 50.00th=[ 144], 60.00th=[ 146], | 70.00th=[ 224], 80.00th=[ 384], 90.00th=[ 481], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 2039, max= 6059, per=55.15%, avg=4030.25, stdev=1641.38, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 250=75.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=27.36%, ctx=594, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182268: Wed Mar 11 06:39:02 2026 read: IOPS=1, BW=1721KiB/s (1762kB/s)(6144KiB/3570msec) clat (usec): min=504, max=204826, avg=121378.29, stdev=86391.82 lat (usec): min=506, max=204827, avg=121379.53, stdev=86391.80 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 29754], | 30.00th=[ 29754], 40.00th=[129500], 50.00th=[129500], 60.00th=[177210], | 70.00th=[185598], 80.00th=[185598], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 3992, max= 4031, per=76.85%, avg=4011.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1721KiB/s (1762kB/s)(6144KiB/3570msec); 0 zone resets clat (msec): min=79, max=1622, avg=470.69, stdev=580.42 lat (msec): min=79, max=1622, avg=470.80, stdev=580.45 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 268], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 1996, max= 3567, per=34.56%, avg=2526.00, stdev=901.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=25.11%, ctx=562, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182270: Wed Mar 11 06:39:02 2026 read: IOPS=1, BW=1452KiB/s (1487kB/s)(5120KiB/3526msec) clat (usec): min=458, max=131845, avg=27902.65, stdev=58153.22 lat (usec): min=460, max=131845, avg=27903.78, stdev=58152.80 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 461], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 5997], 80.00th=[ 5997], 90.00th=[131597], 95.00th=[131597], | 99.00th=[131597], 99.50th=[131597], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2033KiB/s (2082kB/s)(7168KiB/3526msec); 0 zone resets clat (msec): min=132, max=1303, avg=477.16, stdev=400.00 lat (msec): min=132, max=1303, avg=477.23, stdev=399.98 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 161], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 472], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 535], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1996, max= 4031, per=36.70%, avg=2682.00, stdev=1168.32, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 10=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=23.43%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5220KiB/s (5346kB/s), 522KiB/s-1964KiB/s (535kB/s-2011kB/s), io=20.0MiB (20.0MB), run=3526-3923msec WRITE: bw=7309KiB/s (7484kB/s), 1403KiB/s-2610KiB/s (1436kB/s-2673kB/s), io=28.0MiB (29.4MB), run=3526-3923msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182267: Wed Mar 11 06:39:03 2026 read: IOPS=3, BW=3821KiB/s (3913kB/s)(7168KiB/1876msec) clat (msec): min=59, max=275, avg=124.76, stdev=85.11 lat (msec): min=59, max=275, avg=124.76, stdev=85.11 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 68], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 91], 60.00th=[ 96], | 70.00th=[ 96], 80.00th=[ 215], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2023, max= 7074, per=93.51%, avg=4548.50, stdev=3571.60, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2729KiB/s (2795kB/s)(5120KiB/1876msec); 0 zone resets clat (msec): min=91, max=439, avg=195.02, stdev=145.32 lat (msec): min=91, max=439, avg=195.09, stdev=145.33 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1768, max= 4087, per=38.56%, avg=2626.00, stdev=1271.67, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=58.33%, 250=25.00%, 500=16.67% cpu : usr=0.05%, sys=14.08%, ctx=212, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182269: Wed Mar 11 06:39:03 2026 read: IOPS=0, BW=501KiB/s (513kB/s)(2048KiB/4086msec) clat (msec): min=59, max=298, avg=179.23, stdev=168.82 lat (msec): min=59, max=298, avg=179.23, stdev=168.82 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1841, max= 2048, per=39.98%, avg=1944.50, stdev=146.37, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2506KiB/s (2566kB/s)(10.0MiB/4086msec); 0 zone resets clat (msec): min=63, max=1480, avg=359.56, stdev=415.58 lat (msec): min=63, max=1480, avg=359.65, stdev=415.60 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 97], | 30.00th=[ 144], 40.00th=[ 176], 50.00th=[ 211], 60.00th=[ 243], | 70.00th=[ 292], 80.00th=[ 388], 90.00th=[ 502], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2023, max= 6144, per=53.92%, avg=3672.00, stdev=2239.78, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.90%, ctx=156, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182271: Wed Mar 11 06:39:03 2026 read: IOPS=1, BW=1474KiB/s (1510kB/s)(6144KiB/4167msec) clat (msec): min=93, max=233, avg=167.12, stdev=54.53 lat (msec): min=93, max=233, avg=167.12, stdev=54.53 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 199], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 2043, max= 4071, per=52.45%, avg=2551.25, stdev=1013.17, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1474KiB/s (1510kB/s)(6144KiB/4167msec); 0 zone resets clat (msec): min=74, max=1644, avg=504.12, stdev=583.17 lat (msec): min=74, max=1644, avg=504.19, stdev=583.18 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 338], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1858, max= 4087, per=35.38%, avg=2409.20, stdev=941.03, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.75%, ctx=167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182272: Wed Mar 11 06:39:03 2026 read: IOPS=1, BW=1216KiB/s (1245kB/s)(5120KiB/4210msec) clat (msec): min=45, max=307, avg=144.02, stdev=115.43 lat (msec): min=45, max=307, avg=144.02, stdev=115.43 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 4071, max= 4096, per=83.95%, avg=4083.50, stdev=17.68, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1703KiB/s (1743kB/s)(7168KiB/4210msec); 0 zone resets clat (msec): min=36, max=1733, avg=492.38, stdev=577.84 lat (msec): min=36, max=1733, avg=492.48, stdev=577.85 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 122], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 426], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 498], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1809, max= 2043, per=29.23%, avg=1990.60, stdev=101.85, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=25.00%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=7.01%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4865KiB/s (4981kB/s), 501KiB/s-3821KiB/s (513kB/s-3913kB/s), io=20.0MiB (20.0MB), run=1876-4210msec WRITE: bw=6810KiB/s (6974kB/s), 1474KiB/s-2729KiB/s (1510kB/s-2795kB/s), io=28.0MiB (29.4MB), run=1876-4210msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182277: Wed Mar 11 06:39:11 2026 read: IOPS=1, BW=6003KiB/s (6147kB/s)(12.0MiB/2047msec) clat (msec): min=383, max=1079, avg=652.62, stdev=374.15 lat (msec): min=383, max=1079, avg=652.62, stdev=374.15 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.41%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182278: Wed Mar 11 06:39:11 2026 read: IOPS=0, BW=1892KiB/s (1937kB/s)(4096KiB/2165msec) clat (nsec): min=668516k, max=668516k, avg=668516063.00, stdev= 0.00 lat (nsec): min=668519k, max=668519k, avg=668518581.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3784KiB/s (3875kB/s)(8192KiB/2165msec); 0 zone resets clat (msec): min=507, max=915, avg=711.45, stdev=287.95 lat (msec): min=508, max=915, avg=711.69, stdev=287.87 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8192, max= 8192, per=54.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.94%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182280: Wed Mar 11 06:39:11 2026 write: IOPS=1, BW=6599KiB/s (6758kB/s)(12.0MiB/1862msec); 0 zone resets clat (msec): min=318, max=880, avg=600.30, stdev=281.11 lat (msec): min=318, max=880, avg=600.91, stdev=281.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 5902, max= 8192, per=46.56%, avg=7047.00, stdev=1619.27, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=12.84%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182281: Wed Mar 11 06:39:11 2026 write: IOPS=1, BW=7323KiB/s (7499kB/s)(12.0MiB/1678msec); 0 zone resets clat (msec): min=164, max=1124, avg=547.27, stdev=509.03 lat (msec): min=164, max=1125, avg=547.74, stdev=508.99 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=11736, max=11736, per=77.54%, avg=11736.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=13.42%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7568KiB/s (7749kB/s), 1892KiB/s-6003KiB/s (1937kB/s-6147kB/s), io=16.0MiB (16.8MB), run=2047-2165msec WRITE: bw=14.8MiB/s (15.5MB/s), 3784KiB/s-7323KiB/s (3875kB/s-7499kB/s), io=32.0MiB (33.6MB), run=1678-2165msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182282: Wed Mar 11 06:39:11 2026 read: IOPS=2, BW=8617KiB/s (8824kB/s)(12.0MiB/1426msec) clat (msec): min=428, max=532, avg=464.42, stdev=58.81 lat (msec): min=428, max=532, avg=464.42, stdev=58.81 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 5902, max= 8143, per=72.92%, avg=7022.50, stdev=1584.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=41.05%, ctx=1805, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182283: Wed Mar 11 06:39:11 2026 read: IOPS=0, BW=2408KiB/s (2466kB/s)(4096KiB/1701msec) clat (nsec): min=446935k, max=446935k, avg=446934781.00, stdev= 0.00 lat (nsec): min=446938k, max=446938k, avg=446937531.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 6370, max= 6370, per=66.14%, avg=6370.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4816KiB/s (4932kB/s)(8192KiB/1701msec); 0 zone resets clat (msec): min=539, max=641, avg=590.55, stdev=71.79 lat (msec): min=554, max=641, avg=597.95, stdev=61.74 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8143, max= 8143, per=49.93%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=17.76%, ctx=254, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182284: Wed Mar 11 06:39:11 2026 write: IOPS=1, BW=6116KiB/s (6263kB/s)(12.0MiB/2009msec); 0 zone resets clat (msec): min=124, max=1269, avg=643.77, stdev=579.82 lat (msec): min=124, max=1269, avg=644.09, stdev=580.06 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8175, per=50.12%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=10.21%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182285: Wed Mar 11 06:39:11 2026 write: IOPS=1, BW=6946KiB/s (7113kB/s)(12.0MiB/1769msec); 0 zone resets clat (msec): min=435, max=679, avg=550.00, stdev=122.57 lat (msec): min=435, max=679, avg=550.41, stdev=122.55 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 6014, max= 8175, per=43.50%, avg=7094.50, stdev=1528.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=13.69%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9632KiB/s (9863kB/s), 2408KiB/s-8617KiB/s (2466kB/s-8824kB/s), io=16.0MiB (16.8MB), run=1426-1701msec WRITE: bw=15.9MiB/s (16.7MB/s), 4816KiB/s-6946KiB/s (4932kB/s-7113kB/s), io=32.0MiB (33.6MB), run=1701-2009msec