== sanity test 398b: DIO and buffer IO race ============== 02:02:07 (1786946527) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.31216 s, 15.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183646: Mon Aug 17 02:03:26 2026 read: IOPS=22, BW=88.9KiB/s (91.1kB/s)(5992KiB/67384msec) clat (usec): min=33, max=271789, avg=24767.76, stdev=15902.13 lat (usec): min=34, max=271792, avg=24769.72, stdev=15903.02 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 7570], 10.00th=[ 10290], 20.00th=[ 13435], | 30.00th=[ 16319], 40.00th=[ 18744], 50.00th=[ 22152], 60.00th=[ 25560], | 70.00th=[ 28967], 80.00th=[ 33817], 90.00th=[ 41157], 95.00th=[ 51643], | 99.00th=[ 74974], 99.50th=[ 85459], 99.90th=[127402], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 144, per=24.74%, avg=88.08, stdev=24.61, samples=133 iops : min= 7, max= 36, avg=21.49, stdev= 6.20, samples=133 write: IOPS=23, BW=93.4KiB/s (95.7kB/s)(6296KiB/67384msec); 0 zone resets clat (usec): min=934, max=181911, avg=19171.20, stdev=18364.89 lat (usec): min=935, max=181913, avg=19173.16, stdev=18365.63 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1401], 10.00th=[ 1975], 20.00th=[ 3195], | 30.00th=[ 5538], 40.00th=[ 10683], 50.00th=[ 14877], 60.00th=[ 18744], | 70.00th=[ 23987], 80.00th=[ 31851], 90.00th=[ 43779], 95.00th=[ 55313], | 99.00th=[ 80217], 99.50th=[ 91751], 99.90th=[119014], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 23, max= 176, per=24.76%, avg=92.34, stdev=30.13, samples=133 iops : min= 5, max= 44, avg=22.55, stdev= 7.58, samples=133 lat (usec) : 50=0.29%, 100=1.01%, 250=0.42%, 500=0.03%, 1000=0.20% lat (msec) : 2=5.01%, 4=7.42%, 10=9.99%, 20=29.52%, 50=39.71% lat (msec) : 100=6.15%, 250=0.20%, 500=0.03% cpu : usr=0.11%, sys=11.91%, ctx=7521, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183647: Mon Aug 17 02:03:26 2026 read: IOPS=22, BW=88.9KiB/s (91.1kB/s)(5940KiB/66784msec) clat (usec): min=35, max=295949, avg=24555.51, stdev=16622.13 lat (usec): min=35, max=295950, avg=24556.40, stdev=16622.17 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 7898], 10.00th=[ 10421], 20.00th=[ 13173], | 30.00th=[ 15664], 40.00th=[ 17957], 50.00th=[ 20841], 60.00th=[ 24773], | 70.00th=[ 29230], 80.00th=[ 33817], 90.00th=[ 42730], 95.00th=[ 51643], | 99.00th=[ 80217], 99.50th=[ 93848], 99.90th=[125305], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 12, max= 152, per=24.85%, avg=88.47, stdev=25.74, samples=132 iops : min= 3, max= 38, avg=21.59, stdev= 6.47, samples=132 write: IOPS=23, BW=95.1KiB/s (97.3kB/s)(6348KiB/66784msec); 0 zone resets clat (usec): min=835, max=127320, avg=19049.43, stdev=18242.31 lat (usec): min=837, max=127321, avg=19050.64, stdev=18242.32 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1434], 10.00th=[ 2008], 20.00th=[ 3228], | 30.00th=[ 5342], 40.00th=[ 9765], 50.00th=[ 14353], 60.00th=[ 19268], | 70.00th=[ 24511], 80.00th=[ 31851], 90.00th=[ 43779], 95.00th=[ 55837], | 99.00th=[ 80217], 99.50th=[ 94897], 99.90th=[112722], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 39, max= 199, per=25.26%, avg=94.23, stdev=32.93, samples=132 iops : min= 9, max= 49, avg=23.02, stdev= 8.28, samples=132 lat (usec) : 50=0.36%, 100=0.91%, 250=0.52%, 500=0.03%, 1000=0.23% lat (msec) : 2=4.88%, 4=7.78%, 10=10.68%, 20=29.30%, 50=39.16% lat (msec) : 100=5.86%, 250=0.26%, 500=0.03% cpu : usr=0.12%, sys=11.64%, ctx=7462, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183648: Mon Aug 17 02:03:26 2026 read: IOPS=22, BW=89.8KiB/s (92.0kB/s)(6028KiB/67094msec) clat (usec): min=31, max=207673, avg=24281.90, stdev=15100.87 lat (usec): min=32, max=207673, avg=24283.10, stdev=15101.09 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6521], 10.00th=[ 10421], 20.00th=[ 13304], | 30.00th=[ 15795], 40.00th=[ 18220], 50.00th=[ 21627], 60.00th=[ 24773], | 70.00th=[ 28967], 80.00th=[ 34341], 90.00th=[ 41681], 95.00th=[ 50070], | 99.00th=[ 74974], 99.50th=[ 86508], 99.90th=[130548], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 24, max= 151, per=25.11%, avg=89.40, stdev=27.91, samples=133 iops : min= 6, max= 37, avg=21.82, stdev= 7.00, samples=133 write: IOPS=23, BW=93.3KiB/s (95.5kB/s)(6260KiB/67094msec); 0 zone resets clat (usec): min=859, max=317944, avg=19426.80, stdev=19286.55 lat (usec): min=860, max=317945, avg=19428.45, stdev=19286.57 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1532], 10.00th=[ 1991], 20.00th=[ 3097], | 30.00th=[ 5604], 40.00th=[ 10552], 50.00th=[ 14746], 60.00th=[ 18744], | 70.00th=[ 24773], 80.00th=[ 32637], 90.00th=[ 45351], 95.00th=[ 54789], | 99.00th=[ 77071], 99.50th=[ 83362], 99.90th=[116917], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 168, per=24.90%, avg=92.89, stdev=30.30, samples=133 iops : min= 7, max= 42, avg=22.68, stdev= 7.61, samples=133 lat (usec) : 50=0.29%, 100=1.43%, 250=0.49%, 500=0.10%, 1000=0.13% lat (msec) : 2=5.01%, 4=7.29%, 10=9.54%, 20=29.46%, 50=40.27% lat (msec) : 100=5.76%, 250=0.20%, 500=0.03% cpu : usr=0.12%, sys=11.86%, ctx=7416, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183649: Mon Aug 17 02:03:26 2026 read: IOPS=22, BW=90.0KiB/s (92.2kB/s)(6052KiB/67229msec) clat (usec): min=34, max=212769, avg=24055.36, stdev=15767.94 lat (usec): min=34, max=212770, avg=24057.82, stdev=15766.93 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6063], 10.00th=[ 9765], 20.00th=[ 12780], | 30.00th=[ 15139], 40.00th=[ 17957], 50.00th=[ 21103], 60.00th=[ 24773], | 70.00th=[ 28705], 80.00th=[ 34341], 90.00th=[ 42206], 95.00th=[ 50070], | 99.00th=[ 72877], 99.50th=[ 90702], 99.90th=[130548], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 23, max= 168, per=25.14%, avg=89.51, stdev=28.47, samples=133 iops : min= 5, max= 42, avg=21.84, stdev= 7.18, samples=133 write: IOPS=23, BW=92.8KiB/s (94.0kB/s)(6236KiB/67229msec); 0 zone resets clat (usec): min=882, max=317329, avg=19714.11, stdev=19565.46 lat (usec): min=882, max=317330, avg=19716.54, stdev=19565.03 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1500], 10.00th=[ 2089], 20.00th=[ 3425], | 30.00th=[ 5735], 40.00th=[ 10552], 50.00th=[ 15139], 60.00th=[ 19530], | 70.00th=[ 24773], 80.00th=[ 33162], 90.00th=[ 44303], 95.00th=[ 55313], | 99.00th=[ 79168], 99.50th=[ 94897], 99.90th=[120062], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 24, max= 192, per=24.72%, avg=92.20, stdev=28.66, samples=133 iops : min= 6, max= 48, avg=22.51, stdev= 7.25, samples=133 lat (usec) : 50=0.39%, 100=1.20%, 250=0.59%, 500=0.10%, 1000=0.16% lat (msec) : 2=4.56%, 4=7.10%, 10=10.94%, 20=29.17%, 50=39.81% lat (msec) : 100=5.57%, 250=0.39%, 500=0.03% cpu : usr=0.12%, sys=11.90%, ctx=7465, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=356KiB/s (365kB/s), 88.9KiB/s-90.0KiB/s (91.1kB/s-92.2kB/s), io=23.4MiB (24.6MB), run=66784-67384msec WRITE: bw=373KiB/s (382kB/s), 92.8KiB/s-95.1KiB/s (94.0kB/s-97.3kB/s), io=24.6MiB (25.7MB), run=66784-67384msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183641: Mon Aug 17 02:03:44 2026 read: IOPS=17, BW=70.2KiB/s (71.9kB/s)(5992KiB/85366msec) clat (msec): min=3, max=362, avg=22.50, stdev=21.42 lat (msec): min=3, max=362, avg=22.51, stdev=21.42 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 65], | 99.00th=[ 91], 99.50th=[ 103], 99.90th=[ 142], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 216, per=24.96%, avg=69.88, stdev=46.33, samples=168 iops : min= 1, max= 54, avg=16.99, stdev=11.72, samples=168 write: IOPS=18, BW=73.8KiB/s (75.5kB/s)(6296KiB/85366msec); 0 zone resets clat (msec): min=7, max=244, avg=32.63, stdev=23.18 lat (msec): min=7, max=244, avg=32.63, stdev=23.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 65], 95.00th=[ 78], | 99.00th=[ 116], 99.50th=[ 132], 99.90th=[ 171], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 15, max= 192, per=25.02%, avg=73.32, stdev=44.43, samples=168 iops : min= 3, max= 48, avg=17.85, stdev=11.23, samples=168 lat (msec) : 4=0.07%, 10=16.08%, 20=35.35%, 50=33.37%, 100=14.16% lat (msec) : 250=0.94%, 500=0.03% cpu : usr=0.09%, sys=5.27%, ctx=5232, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183642: Mon Aug 17 02:03:44 2026 read: IOPS=17, BW=69.6KiB/s (71.3kB/s)(5940KiB/85289msec) clat (msec): min=3, max=376, avg=21.86, stdev=21.64 lat (msec): min=3, max=376, avg=21.86, stdev=21.64 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 157], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 15, max= 216, per=24.84%, avg=69.55, stdev=47.03, samples=168 iops : min= 3, max= 54, avg=16.90, stdev=11.89, samples=168 write: IOPS=18, BW=74.4KiB/s (76.2kB/s)(6348KiB/85289msec); 0 zone resets clat (msec): min=6, max=153, avg=33.10, stdev=23.56 lat (msec): min=6, max=153, avg=33.11, stdev=23.56 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 81], | 99.00th=[ 123], 99.50th=[ 134], 99.90th=[ 146], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 15, max= 200, per=25.28%, avg=74.08, stdev=45.27, samples=168 iops : min= 3, max= 50, avg=18.04, stdev=11.45, samples=168 lat (msec) : 4=0.03%, 10=15.56%, 20=36.46%, 50=32.98%, 100=13.51% lat (msec) : 250=1.43%, 500=0.03% cpu : usr=0.10%, sys=5.28%, ctx=5240, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183643: Mon Aug 17 02:03:44 2026 read: IOPS=17, BW=71.4KiB/s (73.1kB/s)(6028KiB/84424msec) clat (msec): min=3, max=141, avg=21.58, stdev=19.18 lat (msec): min=3, max=141, avg=21.58, stdev=19.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 62], | 99.00th=[ 93], 99.50th=[ 107], 99.90th=[ 129], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 224, per=25.47%, avg=71.31, stdev=44.95, samples=166 iops : min= 1, max= 56, avg=17.34, stdev=11.35, samples=166 write: IOPS=18, BW=74.1KiB/s (75.9kB/s)(6260KiB/84424msec); 0 zone resets clat (msec): min=5, max=387, avg=32.98, stdev=24.23 lat (msec): min=5, max=387, avg=32.98, stdev=24.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 65], 95.00th=[ 80], | 99.00th=[ 114], 99.50th=[ 127], 99.90th=[ 150], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 15, max= 199, per=25.24%, avg=73.95, stdev=45.19, samples=166 iops : min= 3, max= 49, avg=18.01, stdev=11.44, samples=166 lat (msec) : 4=0.16%, 10=15.49%, 20=36.36%, 50=34.02%, 100=12.73% lat (msec) : 250=1.20%, 500=0.03% cpu : usr=0.09%, sys=5.44%, ctx=5244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183644: Mon Aug 17 02:03:44 2026 read: IOPS=17, BW=70.6KiB/s (72.3kB/s)(6052KiB/85752msec) clat (msec): min=3, max=148, avg=22.71, stdev=20.40 lat (msec): min=3, max=148, avg=22.71, stdev=20.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 53], 95.00th=[ 66], | 99.00th=[ 95], 99.50th=[ 111], 99.90th=[ 136], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 7, max= 232, per=25.08%, avg=70.22, stdev=47.02, samples=169 iops : min= 1, max= 58, avg=17.08, stdev=11.88, samples=169 write: IOPS=18, BW=72.7KiB/s (74.5kB/s)(6236KiB/85752msec); 0 zone resets clat (msec): min=6, max=389, avg=32.78, stdev=25.38 lat (msec): min=6, max=389, avg=32.78, stdev=25.38 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 65], 95.00th=[ 80], | 99.00th=[ 118], 99.50th=[ 127], 99.90th=[ 249], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 16, max= 216, per=24.75%, avg=72.50, stdev=45.98, samples=169 iops : min= 4, max= 54, avg=17.64, stdev=11.65, samples=169 lat (msec) : 4=0.10%, 10=16.63%, 20=34.15%, 50=34.31%, 100=13.35% lat (msec) : 250=1.43%, 500=0.03% cpu : usr=0.07%, sys=5.26%, ctx=5186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (287kB/s), 69.6KiB/s-71.4KiB/s (71.3kB/s-73.1kB/s), io=23.4MiB (24.6MB), run=84424-85752msec WRITE: bw=293KiB/s (300kB/s), 72.7KiB/s-74.4KiB/s (74.5kB/s-76.2kB/s), io=24.6MiB (25.7MB), run=84424-85752msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183674: Mon Aug 17 02:04:07 2026 read: IOPS=20, BW=334KiB/s (342kB/s)(5920KiB/17726msec) clat (usec): min=41, max=92053, avg=24843.81, stdev=14661.79 lat (usec): min=42, max=92053, avg=24845.13, stdev=14662.03 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 81], 10.00th=[ 9110], 20.00th=[14615], | 30.00th=[17695], 40.00th=[20317], 50.00th=[22676], 60.00th=[26084], | 70.00th=[30016], 80.00th=[35390], 90.00th=[43254], 95.00th=[49021], | 99.00th=[69731], 99.50th=[87557], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 95, max= 479, per=24.54%, avg=331.49, stdev=88.05, samples=35 iops : min= 5, max= 29, avg=19.97, stdev= 5.52, samples=35 write: IOPS=22, BW=359KiB/s (368kB/s)(6368KiB/17726msec); 0 zone resets clat (usec): min=1404, max=111947, avg=21222.60, stdev=18567.87 lat (usec): min=1405, max=111949, avg=21229.86, stdev=18573.35 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2343], 10.00th=[ 3195], 20.00th=[ 5211], | 30.00th=[ 7963], 40.00th=[ 13173], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 26084], 80.00th=[ 34341], 90.00th=[ 45876], 95.00th=[ 60031], | 99.00th=[ 81265], 99.50th=[110625], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 192, max= 569, per=25.18%, avg=357.74, stdev=84.90, samples=35 iops : min= 12, max= 35, avg=21.63, stdev= 5.24, samples=35 lat (usec) : 50=0.52%, 100=3.12%, 250=0.39%, 1000=0.13% lat (msec) : 2=1.69%, 4=4.95%, 10=12.24%, 20=26.56%, 50=43.75% lat (msec) : 100=6.25%, 250=0.39% cpu : usr=0.06%, sys=13.97%, ctx=2203, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183675: Mon Aug 17 02:04:07 2026 read: IOPS=20, BW=325KiB/s (332kB/s)(5744KiB/17692msec) clat (usec): min=37, max=199786, avg=26281.78, stdev=19573.34 lat (usec): min=38, max=199788, avg=26282.91, stdev=19573.29 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 99], 10.00th=[ 10683], 20.00th=[ 14877], | 30.00th=[ 17433], 40.00th=[ 20579], 50.00th=[ 24511], 60.00th=[ 26346], | 70.00th=[ 29230], 80.00th=[ 33817], 90.00th=[ 45351], 95.00th=[ 53740], | 99.00th=[101188], 99.50th=[170918], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 127, max= 510, per=23.95%, avg=323.63, stdev=94.07, samples=35 iops : min= 7, max= 31, avg=19.46, stdev= 5.86, samples=35 write: IOPS=23, BW=370KiB/s (379kB/s)(6544KiB/17692msec); 0 zone resets clat (usec): min=1406, max=99802, avg=19968.88, stdev=16741.07 lat (usec): min=1408, max=99804, avg=19973.00, stdev=16739.17 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2769], 10.00th=[ 3752], 20.00th=[ 5800], | 30.00th=[ 8586], 40.00th=[ 11994], 50.00th=[ 15533], 60.00th=[ 19530], | 70.00th=[ 24773], 80.00th=[ 32637], 90.00th=[ 43254], 95.00th=[ 53740], | 99.00th=[ 73925], 99.50th=[ 87557], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 159, max= 540, per=25.94%, avg=368.54, stdev=91.96, samples=35 iops : min= 9, max= 33, avg=22.29, stdev= 5.75, samples=35 lat (usec) : 50=0.26%, 100=2.08%, 250=1.17% lat (msec) : 2=1.17%, 4=4.82%, 10=13.54%, 20=27.60%, 50=42.58% lat (msec) : 100=6.25%, 250=0.52% cpu : usr=0.09%, sys=13.91%, ctx=2131, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183676: Mon Aug 17 02:04:07 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(6256KiB/17463msec) clat (usec): min=42, max=104769, avg=24986.60, stdev=14586.35 lat (usec): min=43, max=104770, avg=24987.61, stdev=14586.38 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 128], 10.00th=[ 11076], 20.00th=[ 14615], | 30.00th=[ 17695], 40.00th=[ 20055], 50.00th=[ 23462], 60.00th=[ 26346], | 70.00th=[ 30016], 80.00th=[ 34341], 90.00th=[ 40633], 95.00th=[ 46400], | 99.00th=[ 83362], 99.50th=[ 95945], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 223, max= 574, per=26.78%, avg=361.82, stdev=85.04, samples=34 iops : min= 13, max= 35, avg=21.85, stdev= 5.35, samples=34 write: IOPS=21, BW=345KiB/s (354kB/s)(6032KiB/17463msec); 0 zone resets clat (usec): min=1374, max=106223, avg=20301.04, stdev=17416.63 lat (usec): min=1376, max=106226, avg=20304.46, stdev=17415.91 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2769], 10.00th=[ 3458], 20.00th=[ 4817], | 30.00th=[ 7439], 40.00th=[ 12125], 50.00th=[ 15533], 60.00th=[ 21627], | 70.00th=[ 25822], 80.00th=[ 32900], 90.00th=[ 42730], 95.00th=[ 55313], | 99.00th=[ 76022], 99.50th=[ 94897], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 95, max= 504, per=24.03%, avg=341.53, stdev=103.11, samples=34 iops : min= 5, max= 31, avg=20.59, stdev= 6.55, samples=34 lat (usec) : 50=0.52%, 100=1.30%, 250=1.17%, 500=0.26% lat (msec) : 2=1.17%, 4=5.21%, 10=12.76%, 20=26.04%, 50=46.22% lat (msec) : 100=5.08%, 250=0.26% cpu : usr=0.11%, sys=14.27%, ctx=2129, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183677: Mon Aug 17 02:04:07 2026 read: IOPS=22, BW=357KiB/s (366kB/s)(6032KiB/16874msec) clat (usec): min=34, max=102893, avg=23908.35, stdev=15514.58 lat (usec): min=35, max=102894, avg=23909.36, stdev=15514.55 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 113], 20.00th=[ 13566], | 30.00th=[ 16450], 40.00th=[ 19006], 50.00th=[ 21890], 60.00th=[ 25035], | 70.00th=[ 28967], 80.00th=[ 34341], 90.00th=[ 42206], 95.00th=[ 51643], | 99.00th=[ 77071], 99.50th=[ 83362], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 159, max= 606, per=26.31%, avg=355.39, stdev=104.39, samples=33 iops : min= 9, max= 37, avg=21.45, stdev= 6.54, samples=33 write: IOPS=23, BW=371KiB/s (380kB/s)(6256KiB/16874msec); 0 zone resets clat (usec): min=1375, max=115146, avg=19828.94, stdev=17856.28 lat (usec): min=1377, max=115148, avg=19830.92, stdev=17856.20 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2376], 10.00th=[ 3261], 20.00th=[ 4555], | 30.00th=[ 6390], 40.00th=[ 10945], 50.00th=[ 15270], 60.00th=[ 19268], | 70.00th=[ 24249], 80.00th=[ 32375], 90.00th=[ 47973], 95.00th=[ 54789], | 99.00th=[ 73925], 99.50th=[ 90702], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 191, max= 574, per=26.07%, avg=370.52, stdev=93.11, samples=33 iops : min= 11, max= 35, avg=22.42, stdev= 5.86, samples=33 lat (usec) : 50=0.39%, 100=3.78%, 250=1.43%, 500=0.13% lat (msec) : 2=1.69%, 4=6.77%, 10=11.72%, 20=26.82%, 50=40.10% lat (msec) : 100=6.90%, 250=0.26% cpu : usr=0.06%, sys=13.94%, ctx=2101, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1351KiB/s (1384kB/s), 325KiB/s-358KiB/s (332kB/s-367kB/s), io=23.4MiB (24.5MB), run=16874-17726msec WRITE: bw=1422KiB/s (1456kB/s), 345KiB/s-371KiB/s (354kB/s-380kB/s), io=24.6MiB (25.8MB), run=16874-17726msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183679: Mon Aug 17 02:04:13 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5920KiB/23636msec) clat (msec): min=5, max=105, avg=25.86, stdev=20.29 lat (msec): min=5, max=105, avg=25.87, stdev=20.29 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 55], 95.00th=[ 72], | 99.00th=[ 95], 99.50th=[ 104], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 63, max= 672, per=24.15%, avg=244.65, stdev=135.46, samples=46 iops : min= 3, max= 42, avg=14.52, stdev= 8.51, samples=46 write: IOPS=16, BW=269KiB/s (276kB/s)(6368KiB/23636msec); 0 zone resets clat (msec): min=9, max=218, avg=35.23, stdev=23.39 lat (msec): min=9, max=218, avg=35.23, stdev=23.39 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 49], 90.00th=[ 64], 95.00th=[ 81], | 99.00th=[ 122], 99.50th=[ 186], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 63, max= 606, per=25.06%, avg=267.09, stdev=136.49, samples=46 iops : min= 3, max= 37, avg=15.93, stdev= 8.58, samples=46 lat (msec) : 10=7.94%, 20=33.98%, 50=41.67%, 100=15.23%, 250=1.17% cpu : usr=0.11%, sys=5.35%, ctx=1375, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183680: Mon Aug 17 02:04:13 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(5744KiB/23322msec) clat (msec): min=4, max=137, avg=24.01, stdev=18.52 lat (msec): min=4, max=137, avg=24.01, stdev=18.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 64], | 99.00th=[ 89], 99.50th=[ 121], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 666, per=24.74%, avg=250.58, stdev=127.90, samples=45 iops : min= 1, max= 41, avg=14.91, stdev= 8.04, samples=45 write: IOPS=17, BW=281KiB/s (287kB/s)(6544KiB/23322msec); 0 zone resets clat (msec): min=10, max=187, avg=35.60, stdev=21.53 lat (msec): min=10, max=187, avg=35.61, stdev=21.53 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 75], | 99.00th=[ 99], 99.50th=[ 122], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 702, per=26.25%, avg=279.78, stdev=131.06, samples=46 iops : min= 1, max= 43, avg=16.74, stdev= 8.24, samples=46 lat (msec) : 10=6.51%, 20=33.20%, 50=45.05%, 100=14.32%, 250=0.91% cpu : usr=0.10%, sys=5.42%, ctx=1345, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183681: Mon Aug 17 02:04:13 2026 read: IOPS=16, BW=266KiB/s (272kB/s)(6256KiB/23546msec) clat (msec): min=4, max=139, avg=25.27, stdev=20.13 lat (msec): min=4, max=139, avg=25.27, stdev=20.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 52], 95.00th=[ 69], | 99.00th=[ 107], 99.50th=[ 132], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 608, per=26.22%, avg=265.59, stdev=137.68, samples=46 iops : min= 3, max= 38, avg=15.85, stdev= 8.68, samples=46 write: IOPS=16, BW=256KiB/s (262kB/s)(6032KiB/23546msec); 0 zone resets clat (msec): min=8, max=215, avg=35.91, stdev=24.20 lat (msec): min=8, max=215, avg=35.92, stdev=24.20 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 88], | 99.00th=[ 124], 99.50th=[ 144], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 63, max= 603, per=23.74%, avg=253.07, stdev=123.84, samples=46 iops : min= 3, max= 37, avg=15.04, stdev= 7.79, samples=46 lat (msec) : 10=6.64%, 20=33.20%, 50=43.75%, 100=14.97%, 250=1.43% cpu : usr=0.09%, sys=5.49%, ctx=1375, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183682: Mon Aug 17 02:04:13 2026 read: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23353msec) clat (msec): min=5, max=154, avg=25.15, stdev=20.82 lat (msec): min=5, max=154, avg=25.15, stdev=20.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 55], 95.00th=[ 68], | 99.00th=[ 105], 99.50th=[ 140], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 96, max= 637, per=25.23%, avg=255.63, stdev=127.82, samples=46 iops : min= 6, max= 39, avg=15.22, stdev= 7.94, samples=46 write: IOPS=16, BW=268KiB/s (274kB/s)(6256KiB/23353msec); 0 zone resets clat (msec): min=10, max=169, avg=35.11, stdev=22.06 lat (msec): min=10, max=169, avg=35.12, stdev=22.06 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 49], 90.00th=[ 64], 95.00th=[ 77], | 99.00th=[ 124], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 95, max= 736, per=25.09%, avg=267.50, stdev=131.86, samples=46 iops : min= 5, max= 46, avg=15.96, stdev= 8.34, samples=46 lat (msec) : 10=7.29%, 20=34.38%, 50=42.84%, 100=13.80%, 250=1.69% cpu : usr=0.07%, sys=5.32%, ctx=1389, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1013KiB/s (1038kB/s), 246KiB/s-266KiB/s (252kB/s-272kB/s), io=23.4MiB (24.5MB), run=23322-23636msec WRITE: bw=1066KiB/s (1092kB/s), 256KiB/s-281KiB/s (262kB/s-287kB/s), io=24.6MiB (25.8MB), run=23322-23636msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183692: Mon Aug 17 02:04:23 2026 read: IOPS=2, BW=2141KiB/s (2192kB/s)(7168KiB/3348msec) clat (usec): min=475, max=1943.7k, avg=355192.97, stdev=702348.93 lat (usec): min=476, max=1943.7k, avg=355194.28, stdev=702349.40 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 79168], 30.00th=[ 86508], 40.00th=[ 86508], | 50.00th=[ 88605], 60.00th=[ 114820], 70.00th=[ 114820], | 80.00th=[ 173016], 90.00th=[1937769], 95.00th=[1937769], | 99.00th=[1937769], 99.50th=[1937769], 99.90th=[1937769], | 99.95th=[1937769], 99.99th=[1937769] bw ( KiB/s): min= 2043, max= 8175, per=100.00%, avg=5109.00, stdev=4335.98, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1529KiB/s (1566kB/s)(5120KiB/3348msec); 0 zone resets clat (msec): min=107, max=220, avg=157.31, stdev=44.14 lat (msec): min=107, max=220, avg=157.38, stdev=44.15 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 2043, max= 6095, per=57.91%, avg=4069.00, stdev=2865.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 100=25.00%, 250=58.33%, 2000=8.33% cpu : usr=0.00%, sys=20.68%, ctx=672, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183693: Mon Aug 17 02:04:23 2026 read: IOPS=0, BW=505KiB/s (517kB/s)(2048KiB/4058msec) clat (usec): min=717, max=136501, avg=68609.70, stdev=96013.49 lat (usec): min=719, max=136503, avg=68611.50, stdev=96014.36 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 717], 10.00th=[ 717], 20.00th=[ 717], | 30.00th=[ 717], 40.00th=[ 717], 50.00th=[ 717], 60.00th=[137364], | 70.00th=[137364], 80.00th=[137364], 90.00th=[137364], 95.00th=[137364], | 99.00th=[137364], 99.50th=[137364], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 1865, max= 2043, per=38.93%, avg=1954.00, stdev=125.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2523KiB/s (2584kB/s)(10.0MiB/4058msec); 0 zone resets clat (msec): min=79, max=2048, avg=375.76, stdev=608.33 lat (msec): min=79, max=2048, avg=375.90, stdev=608.29 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 117], | 30.00th=[ 121], 40.00th=[ 131], 50.00th=[ 142], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 625], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 4063, max= 4087, per=58.05%, avg=4079.00, stdev=13.86, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=15.45%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183694: Mon Aug 17 02:04:23 2026 read: IOPS=1, BW=1638KiB/s (1678kB/s)(6144KiB/3750msec) clat (usec): min=535, max=379467, avg=95462.22, stdev=147818.22 lat (usec): min=537, max=379469, avg=95463.31, stdev=147818.33 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 13435], 50.00th=[ 13435], 60.00th=[ 45876], | 70.00th=[132645], 80.00th=[132645], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2043, max= 8126, per=100.00%, avg=5084.50, stdev=4301.33, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1638KiB/s (1678kB/s)(6144KiB/3750msec); 0 zone resets clat (msec): min=117, max=2152, avg=526.44, stdev=797.92 lat (msec): min=117, max=2152, avg=526.56, stdev=797.91 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 211], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 3670, max= 4087, per=56.07%, avg=3940.00, stdev=234.13, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 20=8.33%, 50=8.33%, 250=41.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=13.68%, ctx=335, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183695: Mon Aug 17 02:04:23 2026 read: IOPS=1, BW=1255KiB/s (1285kB/s)(5120KiB/4080msec) clat (usec): min=439, max=193219, avg=84466.45, stdev=83697.76 lat (usec): min=440, max=193219, avg=84467.66, stdev=83697.44 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 668], 40.00th=[ 668], 50.00th=[100140], 60.00th=[100140], | 70.00th=[127402], 80.00th=[127402], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 4063, max= 4087, per=81.19%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1757KiB/s (1799kB/s)(7168KiB/4080msec); 0 zone resets clat (msec): min=149, max=2080, avg=509.96, stdev=696.92 lat (msec): min=149, max=2084, avg=510.67, stdev=698.08 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 180], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 300], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1950, max= 4087, per=40.25%, avg=2828.40, stdev=1124.12, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=15.00%, ctx=202, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5020KiB/s (5140kB/s), 505KiB/s-2141KiB/s (517kB/s-2192kB/s), io=20.0MiB (20.0MB), run=3348-4080msec WRITE: bw=7027KiB/s (7196kB/s), 1529KiB/s-2523KiB/s (1566kB/s-2584kB/s), io=28.0MiB (29.4MB), run=3348-4080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183696: Mon Aug 17 02:04:23 2026 read: IOPS=1, BW=1513KiB/s (1549kB/s)(7168KiB/4739msec) clat (msec): min=56, max=1679, avg=556.64, stdev=625.39 lat (msec): min=56, max=1679, avg=556.86, stdev=625.24 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 153], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 313], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 1200], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 2019, max= 4063, per=70.22%, avg=3034.00, stdev=1160.67, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1080KiB/s (1106kB/s)(5120KiB/4739msec); 0 zone resets clat (msec): min=66, max=171, avg=96.06, stdev=43.31 lat (msec): min=67, max=171, avg=96.16, stdev=43.31 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 86], 60.00th=[ 86], | 70.00th=[ 89], 80.00th=[ 89], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 2039, max= 6023, per=66.63%, avg=4031.00, stdev=2817.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=41.67%, 250=25.00%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.70%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183697: Mon Aug 17 02:04:23 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4554msec) clat (msec): min=47, max=477, avg=262.43, stdev=304.17 lat (msec): min=47, max=477, avg=262.43, stdev=304.17 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 48], 40.00th=[ 48], 50.00th=[ 48], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1753, max= 2039, per=43.88%, avg=1896.00, stdev=202.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2249KiB/s (2303kB/s)(10.0MiB/4554msec); 0 zone resets clat (msec): min=51, max=2586, avg=399.86, stdev=782.66 lat (msec): min=52, max=2586, avg=399.97, stdev=782.66 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 61], | 30.00th=[ 62], 40.00th=[ 70], 50.00th=[ 74], 60.00th=[ 153], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 550], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2011, max= 8159, per=84.05%, avg=5085.00, stdev=4347.29, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 lat (msec) : 50=8.33%, 100=41.67%, 250=25.00%, 500=8.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=4.20%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183698: Mon Aug 17 02:04:23 2026 read: IOPS=1, BW=1328KiB/s (1360kB/s)(6144KiB/4626msec) clat (msec): min=69, max=394, avg=165.50, stdev=123.31 lat (msec): min=69, max=394, avg=165.50, stdev=123.31 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 157], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2031, max= 4079, per=78.11%, avg=3375.00, stdev=1164.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1328KiB/s (1360kB/s)(6144KiB/4626msec); 0 zone resets clat (msec): min=36, max=2654, avg=549.48, stdev=1033.19 lat (msec): min=36, max=2654, avg=549.56, stdev=1033.19 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 165], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2031, max= 4015, per=48.52%, avg=2935.50, stdev=1050.03, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=41.67%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.87%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183699: Mon Aug 17 02:04:23 2026 read: IOPS=1, BW=1082KiB/s (1107kB/s)(5120KiB/4734msec) clat (msec): min=38, max=163, avg=79.45, stdev=49.82 lat (msec): min=38, max=163, avg=79.45, stdev=49.82 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 64], 60.00th=[ 64], | 70.00th=[ 84], 80.00th=[ 84], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 2039, max= 6023, per=93.29%, avg=4031.00, stdev=2817.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1514KiB/s (1550kB/s)(7168KiB/4734msec); 0 zone resets clat (msec): min=66, max=2558, avg=593.00, stdev=880.57 lat (msec): min=66, max=2559, avg=593.09, stdev=880.55 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 83], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 313], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 518], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1845, max= 2039, per=32.84%, avg=1986.60, stdev=80.28, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=16.67%, 100=33.33%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=5.96%, ctx=130, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4322KiB/s (4425kB/s), 450KiB/s-1513KiB/s (461kB/s-1549kB/s), io=20.0MiB (20.0MB), run=4554-4739msec WRITE: bw=6050KiB/s (6195kB/s), 1080KiB/s-2249KiB/s (1106kB/s-2303kB/s), io=28.0MiB (29.4MB), run=4554-4739msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183706: Mon Aug 17 02:04:31 2026 read: IOPS=1, BW=7623KiB/s (7806kB/s)(12.0MiB/1612msec) clat (msec): min=449, max=587, avg=528.43, stdev=71.11 lat (msec): min=449, max=587, avg=528.43, stdev=71.11 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 5587, max= 8031, per=82.45%, avg=6809.00, stdev=1728.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=22.59%, ctx=546, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183707: Mon Aug 17 02:04:31 2026 read: IOPS=0, BW=2065KiB/s (2114kB/s)(4096KiB/1984msec) clat (nsec): min=459950k, max=459950k, avg=459950074.00, stdev= 0.00 lat (nsec): min=459952k, max=459952k, avg=459952274.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 6543, max= 6543, per=79.23%, avg=6543.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4129KiB/s (4228kB/s)(8192KiB/1984msec); 0 zone resets clat (msec): min=549, max=924, avg=736.75, stdev=264.98 lat (msec): min=549, max=924, avg=737.09, stdev=265.03 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8031, max= 8031, per=48.63%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.48%, ctx=257, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183708: Mon Aug 17 02:04:31 2026 write: IOPS=1, BW=6407KiB/s (6560kB/s)(12.0MiB/1918msec); 0 zone resets clat (msec): min=199, max=873, avg=614.27, stdev=362.71 lat (msec): min=200, max=874, avg=614.62, stdev=362.71 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8031, max= 8031, per=48.63%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.04%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183709: Mon Aug 17 02:04:31 2026 write: IOPS=2, BW=8696KiB/s (8905kB/s)(12.0MiB/1413msec); 0 zone resets clat (msec): min=287, max=559, avg=452.46, stdev=145.10 lat (msec): min=287, max=559, avg=452.97, stdev=145.22 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6872, max= 6872, per=41.61%, avg=6872.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=11.69%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8258KiB/s (8456kB/s), 2065KiB/s-7623KiB/s (2114kB/s-7806kB/s), io=16.0MiB (16.8MB), run=1612-1984msec WRITE: bw=16.1MiB/s (16.9MB/s), 4129KiB/s-8696KiB/s (4228kB/s-8905kB/s), io=32.0MiB (33.6MB), run=1413-1984msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183710: Mon Aug 17 02:04:32 2026 read: IOPS=1, BW=5665KiB/s (5801kB/s)(12.0MiB/2169msec) clat (msec): min=146, max=961, avg=676.23, stdev=459.00 lat (msec): min=146, max=961, avg=676.23, stdev=459.00 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.26%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183711: Mon Aug 17 02:04:32 2026 read: IOPS=0, BW=1872KiB/s (1917kB/s)(4096KiB/2188msec) clat (nsec): min=859290k, max=859290k, avg=859290039.00, stdev= 0.00 lat (nsec): min=859293k, max=859293k, avg=859292693.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3744KiB/s (3834kB/s)(8192KiB/2188msec); 0 zone resets clat (msec): min=548, max=682, avg=615.52, stdev=95.27 lat (msec): min=548, max=683, avg=615.90, stdev=95.29 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=54.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=8.96%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183712: Mon Aug 17 02:04:32 2026 write: IOPS=1, BW=7728KiB/s (7914kB/s)(12.0MiB/1590msec); 0 zone resets clat (msec): min=211, max=847, avg=500.58, stdev=322.03 lat (msec): min=211, max=847, avg=500.85, stdev=322.00 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 6617, max= 6617, per=44.18%, avg=6617.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.58%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183713: Mon Aug 17 02:04:32 2026 write: IOPS=1, BW=6543KiB/s (6700kB/s)(12.0MiB/1878msec); 0 zone resets clat (msec): min=327, max=740, avg=578.17, stdev=219.85 lat (msec): min=331, max=740, avg=579.70, stdev=217.96 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8159, max= 8192, per=54.59%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.73%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7488KiB/s (7668kB/s), 1872KiB/s-5665KiB/s (1917kB/s-5801kB/s), io=16.0MiB (16.8MB), run=2169-2188msec WRITE: bw=14.6MiB/s (15.3MB/s), 3744KiB/s-7728KiB/s (3834kB/s-7914kB/s), io=32.0MiB (33.6MB), run=1590-2188msec