== sanity test 398b: DIO and buffer IO race ============== 22:23:55 (1781231035) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.69293 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145623: Thu Jun 11 22:26:52 2026 read: IOPS=9, BW=39.7KiB/s (40.6kB/s)(5992KiB/151068msec) clat (usec): min=35, max=638674, avg=51682.80, stdev=42390.41 lat (usec): min=35, max=638676, avg=51685.73, stdev=42392.90 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 78], 10.00th=[ 15401], 20.00th=[ 23200], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 60556], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[126354], | 99.00th=[177210], 99.50th=[210764], 99.90th=[509608], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 103, per=25.71%, avg=39.85, stdev=16.90, samples=292 iops : min= 1, max= 25, avg= 9.29, stdev= 4.23, samples=292 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6296KiB/151068msec); 0 zone resets clat (usec): min=1168, max=1201.0k, avg=46308.75, stdev=55033.94 lat (usec): min=1169, max=1201.0k, avg=46310.85, stdev=55033.90 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1631], 10.00th=[ 2442], | 20.00th=[ 5342], 30.00th=[ 10421], 40.00th=[ 21365], | 50.00th=[ 32900], 60.00th=[ 45876], 70.00th=[ 60556], | 80.00th=[ 79168], 90.00th=[ 105382], 95.00th=[ 135267], | 99.00th=[ 206570], 99.50th=[ 252707], 99.90th=[ 408945], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 127, per=25.84%, avg=41.85, stdev=19.63, samples=292 iops : min= 1, max= 31, avg= 9.79, stdev= 4.93, samples=292 lat (usec) : 50=0.13%, 100=3.09%, 250=0.46%, 500=0.07% lat (msec) : 2=4.04%, 4=4.46%, 10=6.74%, 20=8.46%, 50=34.21% lat (msec) : 100=27.54%, 250=10.32%, 500=0.39%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.81%, ctx=6805, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145625: Thu Jun 11 22:26:52 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(5940KiB/152450msec) clat (usec): min=41, max=445805, avg=51442.66, stdev=37161.64 lat (usec): min=41, max=445807, avg=51447.53, stdev=37163.84 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 112], 10.00th=[ 18220], 20.00th=[ 25560], | 30.00th=[ 31589], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[183501], 99.50th=[217056], 99.90th=[329253], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 5, max= 95, per=25.24%, avg=39.12, stdev=18.28, samples=295 iops : min= 1, max= 23, avg= 9.10, stdev= 4.59, samples=295 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6348KiB/152450msec); 0 zone resets clat (usec): min=1114, max=1249.6k, avg=47502.77, stdev=56239.34 lat (usec): min=1115, max=1249.6k, avg=47515.63, stdev=56245.97 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1614], 10.00th=[ 2540], | 20.00th=[ 6128], 30.00th=[ 11731], 40.00th=[ 22676], | 50.00th=[ 34341], 60.00th=[ 45876], 70.00th=[ 61080], | 80.00th=[ 81265], 90.00th=[ 108528], 95.00th=[ 139461], | 99.00th=[ 200279], 99.50th=[ 233833], 99.90th=[ 413139], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 5, max= 111, per=25.66%, avg=41.57, stdev=20.06, samples=297 iops : min= 1, max= 27, avg= 9.72, stdev= 5.05, samples=297 lat (usec) : 50=0.10%, 100=2.18%, 250=0.49%, 500=0.03%, 750=0.20% lat (usec) : 1000=0.03% lat (msec) : 2=4.07%, 4=3.29%, 10=6.93%, 20=8.20%, 50=35.22% lat (msec) : 100=28.58%, 250=10.38%, 500=0.26%, 2000=0.03% cpu : usr=0.07%, sys=4.89%, ctx=7062, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145627: Thu Jun 11 22:26:52 2026 read: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6028KiB/154863msec) clat (usec): min=37, max=291947, avg=49427.97, stdev=35123.00 lat (usec): min=38, max=291949, avg=49432.80, stdev=35127.04 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 79], 10.00th=[ 14746], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[170918], 99.50th=[191890], 99.90th=[287310], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 112, per=25.28%, avg=39.18, stdev=19.54, samples=297 iops : min= 1, max= 28, avg= 9.12, stdev= 4.92, samples=297 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6260KiB/154863msec); 0 zone resets clat (usec): min=1218, max=1432.0k, avg=50918.49, stdev=59979.20 lat (usec): min=1220, max=1432.0k, avg=50921.96, stdev=59980.06 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1696], 10.00th=[ 3556], | 20.00th=[ 8455], 30.00th=[ 15926], 40.00th=[ 26608], | 50.00th=[ 36439], 60.00th=[ 50070], 70.00th=[ 64750], | 80.00th=[ 85459], 90.00th=[ 112722], 95.00th=[ 141558], | 99.00th=[ 219153], 99.50th=[ 252707], 99.90th=[ 387974], | 99.95th=[1434452], 99.99th=[1434452] bw ( KiB/s): min= 7, max= 118, per=24.76%, avg=40.11, stdev=17.89, samples=301 iops : min= 1, max= 29, avg= 9.35, stdev= 4.52, samples=301 lat (usec) : 50=0.20%, 100=2.80%, 250=0.52%, 500=0.10%, 750=0.10% lat (msec) : 2=3.06%, 4=2.47%, 10=5.86%, 20=9.44%, 50=35.35% lat (msec) : 100=29.17%, 250=10.55%, 500=0.36%, 2000=0.03% cpu : usr=0.08%, sys=4.83%, ctx=7203, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145629: Thu Jun 11 22:26:52 2026 read: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6052KiB/151854msec) clat (usec): min=32, max=309109, avg=50401.19, stdev=36041.89 lat (usec): min=32, max=309109, avg=50403.18, stdev=36042.03 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 72], 10.00th=[ 14615], 20.00th=[ 23987], | 30.00th=[ 30802], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[120062], | 99.00th=[173016], 99.50th=[200279], 99.90th=[225444], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 103, per=25.93%, avg=40.20, stdev=18.13, samples=291 iops : min= 1, max= 25, avg= 9.37, stdev= 4.56, samples=291 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6236KiB/151854msec); 0 zone resets clat (usec): min=1150, max=1494.5k, avg=48054.38, stdev=59487.07 lat (usec): min=1151, max=1494.5k, avg=48059.46, stdev=59489.50 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1696], 10.00th=[ 3097], | 20.00th=[ 6915], 30.00th=[ 12518], 40.00th=[ 23725], | 50.00th=[ 34341], 60.00th=[ 46924], 70.00th=[ 61604], | 80.00th=[ 81265], 90.00th=[ 108528], 95.00th=[ 139461], | 99.00th=[ 204473], 99.50th=[ 231736], 99.90th=[ 383779], | 99.95th=[1501561], 99.99th=[1501561] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=41.12, stdev=19.15, samples=293 iops : min= 1, max= 27, avg= 9.60, stdev= 4.80, samples=293 lat (usec) : 50=0.39%, 100=3.29%, 250=0.65%, 500=0.10% lat (msec) : 2=3.35%, 4=3.26%, 10=6.84%, 20=7.13%, 50=35.74% lat (msec) : 100=28.39%, 250=10.61%, 500=0.23%, 2000=0.03% cpu : usr=0.09%, sys=4.77%, ctx=6861, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.9KiB/s-39.9KiB/s (39.9kB/s-40.8kB/s), io=23.4MiB (24.6MB), run=151068-154863msec WRITE: bw=162KiB/s (166kB/s), 40.4KiB/s-41.7KiB/s (41.4kB/s-42.7kB/s), io=24.6MiB (25.7MB), run=151068-154863msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145622: Thu Jun 11 22:29:32 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(5992KiB/313196msec) clat (msec): min=7, max=1201, avg=47.00, stdev=54.26 lat (msec): min=7, max=1201, avg=47.01, stdev=54.26 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 124], | 99.00th=[ 249], 99.50th=[ 309], 99.90th=[ 523], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 95, per=28.85%, avg=21.92, stdev=14.90, samples=525 iops : min= 1, max= 23, avg= 4.83, stdev= 3.74, samples=525 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6296KiB/313196msec); 0 zone resets clat (msec): min=44, max=634, avg=153.85, stdev=72.11 lat (msec): min=44, max=634, avg=153.86, stdev=72.11 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 405], 99.50th=[ 451], 99.90th=[ 485], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 47, per=25.15%, avg=19.87, stdev= 8.93, samples=606 iops : min= 1, max= 11, avg= 4.31, stdev= 2.29, samples=606 lat (msec) : 10=0.85%, 20=10.51%, 50=23.14%, 100=21.55%, 250=38.54% lat (msec) : 500=5.31%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.37%, ctx=5538, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145624: Thu Jun 11 22:29:32 2026 read: IOPS=4, BW=18.9KiB/s (19.3kB/s)(5940KiB/314402msec) clat (msec): min=7, max=1307, avg=47.04, stdev=55.10 lat (msec): min=7, max=1307, avg=47.05, stdev=55.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 133], | 99.00th=[ 236], 99.50th=[ 288], 99.90th=[ 376], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 87, per=29.05%, avg=22.08, stdev=14.86, samples=516 iops : min= 1, max= 21, avg= 4.87, stdev= 3.75, samples=516 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6348KiB/314402msec); 0 zone resets clat (msec): min=41, max=484, avg=153.71, stdev=71.42 lat (msec): min=41, max=484, avg=153.72, stdev=71.42 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 249], 95.00th=[ 296], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 481], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 48, per=25.33%, avg=20.01, stdev= 9.14, samples=605 iops : min= 1, max= 12, avg= 4.35, stdev= 2.33, samples=605 lat (msec) : 10=1.17%, 20=11.52%, 50=22.14%, 100=21.97%, 250=37.86% lat (msec) : 500=5.31%, 2000=0.03% cpu : usr=0.04%, sys=1.36%, ctx=5551, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145626: Thu Jun 11 22:29:32 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(6028KiB/314953msec) clat (msec): min=6, max=482, avg=47.14, stdev=43.14 lat (msec): min=6, max=482, avg=47.15, stdev=43.14 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 95], 95.00th=[ 125], | 99.00th=[ 211], 99.50th=[ 259], 99.90th=[ 426], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 103, per=28.41%, avg=21.59, stdev=13.91, samples=536 iops : min= 1, max= 25, avg= 4.74, stdev= 3.48, samples=536 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6260KiB/314953msec); 0 zone resets clat (msec): min=39, max=1411, avg=155.45, stdev=79.74 lat (msec): min=39, max=1411, avg=155.46, stdev=79.73 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 251], 95.00th=[ 296], | 99.00th=[ 426], 99.50th=[ 464], 99.90th=[ 567], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 55, per=24.89%, avg=19.66, stdev= 9.13, samples=609 iops : min= 1, max= 13, avg= 4.26, stdev= 2.32, samples=609 lat (msec) : 10=0.88%, 20=9.67%, 50=24.02%, 100=21.94%, 250=38.15% lat (msec) : 500=5.21%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5686, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145628: Thu Jun 11 22:29:32 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6052KiB/313750msec) clat (msec): min=6, max=488, avg=46.22, stdev=46.19 lat (msec): min=6, max=488, avg=46.22, stdev=46.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 91], 95.00th=[ 134], | 99.00th=[ 247], 99.50th=[ 317], 99.90th=[ 405], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 86, per=29.29%, avg=22.26, stdev=14.66, samples=522 iops : min= 1, max= 21, avg= 4.91, stdev= 3.69, samples=522 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6236KiB/313750msec); 0 zone resets clat (msec): min=29, max=1482, avg=156.02, stdev=81.79 lat (msec): min=29, max=1482, avg=156.03, stdev=81.80 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 205], 90.00th=[ 255], 95.00th=[ 292], | 99.00th=[ 418], 99.50th=[ 481], 99.90th=[ 667], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7, max= 48, per=24.95%, avg=19.71, stdev= 9.27, samples=604 iops : min= 1, max= 12, avg= 4.27, stdev= 2.35, samples=604 lat (msec) : 10=1.17%, 20=10.81%, 50=23.96%, 100=20.90%, 250=37.37% lat (msec) : 500=5.63%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.35%, ctx=5568, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.2KiB/s (78.1kB/s), 18.9KiB/s-19.3KiB/s (19.3kB/s-19.8kB/s), io=23.4MiB (24.6MB), run=313196-314953msec WRITE: bw=79.8KiB/s (81.7kB/s), 19.9KiB/s-20.2KiB/s (20.4kB/s-20.7kB/s), io=24.6MiB (25.7MB), run=313196-314953msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145694: Thu Jun 11 22:30:16 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5920KiB/31858msec) clat (usec): min=34, max=190668, avg=44736.37, stdev=33974.59 lat (usec): min=34, max=190669, avg=44743.22, stdev=33980.71 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 17695], | 30.00th=[ 31065], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[160433], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 347, per=24.60%, avg=182.32, stdev=81.86, samples=62 iops : min= 1, max= 21, avg=10.63, stdev= 5.16, samples=62 write: IOPS=12, BW=200KiB/s (205kB/s)(6368KiB/31858msec); 0 zone resets clat (usec): min=1597, max=370492, avg=37681.84, stdev=40387.32 lat (usec): min=1599, max=370493, avg=37687.15, stdev=40387.66 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2540], 10.00th=[ 3490], 20.00th=[ 5538], | 30.00th=[ 8586], 40.00th=[ 13566], 50.00th=[ 23725], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 63701], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[156238], 99.50th=[173016], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 30, max= 384, per=25.51%, avg=198.73, stdev=79.25, samples=62 iops : min= 1, max= 24, avg=11.68, stdev= 4.99, samples=62 lat (usec) : 50=1.04%, 100=7.16%, 250=0.65% lat (msec) : 2=1.30%, 4=5.60%, 10=10.42%, 20=7.68%, 50=33.72% lat (msec) : 100=25.00%, 250=7.29%, 500=0.13% cpu : usr=0.09%, sys=5.31%, ctx=1561, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145695: Thu Jun 11 22:30:16 2026 read: IOPS=11, BW=181KiB/s (186kB/s)(5744KiB/31708msec) clat (usec): min=41, max=404234, avg=49726.48, stdev=39670.61 lat (usec): min=42, max=404236, avg=49735.86, stdev=39676.44 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 87], 20.00th=[ 23987], | 30.00th=[ 33162], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[202376], 99.50th=[214959], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 62, max= 415, per=24.33%, avg=180.27, stdev=64.64, samples=62 iops : min= 3, max= 25, avg=10.52, stdev= 4.08, samples=62 write: IOPS=12, BW=206KiB/s (211kB/s)(6544KiB/31708msec); 0 zone resets clat (usec): min=1631, max=300400, avg=33613.99, stdev=36995.41 lat (usec): min=1633, max=300402, avg=33616.65, stdev=36995.23 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2376], 10.00th=[ 3392], 20.00th=[ 6194], | 30.00th=[ 8586], 40.00th=[ 12911], 50.00th=[ 18482], 60.00th=[ 30802], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 82314], 95.00th=[112722], | 99.00th=[156238], 99.50th=[177210], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 446, per=26.34%, avg=205.21, stdev=93.02, samples=62 iops : min= 1, max= 27, avg=12.08, stdev= 5.84, samples=62 lat (usec) : 50=0.13%, 100=5.60%, 250=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.69%, 10=11.72%, 20=10.55%, 50=31.64% lat (msec) : 100=25.91%, 250=6.64%, 500=0.26% cpu : usr=0.07%, sys=5.84%, ctx=1594, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145696: Thu Jun 11 22:30:16 2026 read: IOPS=12, BW=194KiB/s (198kB/s)(6256KiB/32310msec) clat (usec): min=39, max=225295, avg=44333.52, stdev=34933.12 lat (usec): min=39, max=225296, avg=44338.93, stdev=34939.06 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 17695], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[177210], 99.50th=[204473], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 474, per=26.63%, avg=197.34, stdev=89.63, samples=62 iops : min= 1, max= 29, avg=11.58, stdev= 5.66, samples=62 write: IOPS=11, BW=187KiB/s (191kB/s)(6032KiB/32310msec); 0 zone resets clat (usec): min=1602, max=367008, avg=38814.12, stdev=42715.84 lat (usec): min=1604, max=367009, avg=38818.26, stdev=42714.99 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2212], 10.00th=[ 3752], 20.00th=[ 6849], | 30.00th=[ 10814], 40.00th=[ 17695], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[202376], 99.50th=[320865], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 31, max= 380, per=23.61%, avg=183.89, stdev=84.16, samples=63 iops : min= 1, max= 23, avg=10.73, stdev= 5.33, samples=63 lat (usec) : 50=1.30%, 100=6.38%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=1.30%, 4=4.43%, 10=8.59%, 20=7.94%, 50=34.64% lat (msec) : 100=27.99%, 250=5.34%, 500=0.39% cpu : usr=0.06%, sys=5.59%, ctx=1599, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145697: Thu Jun 11 22:30:16 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31353msec) clat (usec): min=37, max=351497, avg=42813.21, stdev=37438.07 lat (usec): min=38, max=353302, avg=42820.55, stdev=37476.47 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 285], | 30.00th=[ 26346], 40.00th=[ 31327], 50.00th=[ 38536], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[170918], 99.50th=[193987], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 32, max= 448, per=27.07%, avg=200.60, stdev=84.17, samples=58 iops : min= 2, max= 28, avg=11.78, stdev= 5.28, samples=58 write: IOPS=12, BW=200KiB/s (204kB/s)(6256KiB/31353msec); 0 zone resets clat (usec): min=1773, max=332978, avg=37856.18, stdev=44917.25 lat (usec): min=1776, max=332982, avg=37862.17, stdev=44915.93 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2147], 10.00th=[ 3032], 20.00th=[ 5342], | 30.00th=[ 9110], 40.00th=[ 12518], 50.00th=[ 22938], 60.00th=[ 33817], | 70.00th=[ 47973], 80.00th=[ 64750], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[270533], 99.50th=[316670], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 476, per=25.43%, avg=198.11, stdev=90.73, samples=61 iops : min= 1, max= 29, avg=11.62, stdev= 5.74, samples=61 lat (usec) : 50=0.91%, 100=7.81%, 250=1.04%, 500=0.52%, 1000=0.13% lat (msec) : 2=1.69%, 4=6.12%, 10=9.11%, 20=9.38%, 50=31.38% lat (msec) : 100=25.26%, 250=5.99%, 500=0.65% cpu : usr=0.09%, sys=5.41%, ctx=1494, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=741KiB/s (759kB/s), 181KiB/s-194KiB/s (186kB/s-198kB/s), io=23.4MiB (24.5MB), run=31353-32310msec WRITE: bw=780KiB/s (799kB/s), 187KiB/s-206KiB/s (191kB/s-211kB/s), io=24.6MiB (25.8MB), run=31353-32310msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145690: Thu Jun 11 22:31:00 2026 read: IOPS=4, BW=76.7KiB/s (78.6kB/s)(5920KiB/77167msec) clat (msec): min=7, max=374, avg=46.34, stdev=48.48 lat (msec): min=7, max=374, avg=46.35, stdev=48.48 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 84], 95.00th=[ 138], | 99.00th=[ 284], 99.50th=[ 355], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 318, per=27.51%, avg=85.29, stdev=52.31, samples=136 iops : min= 1, max= 19, avg= 4.54, stdev= 3.31, samples=136 write: IOPS=5, BW=82.5KiB/s (84.5kB/s)(6368KiB/77167msec); 0 zone resets clat (msec): min=55, max=625, avg=149.71, stdev=62.70 lat (msec): min=55, max=625, avg=149.72, stdev=62.70 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 81], 10.00th=[ 89], 20.00th=[ 104], | 30.00th=[ 114], 40.00th=[ 123], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 234], 95.00th=[ 262], | 99.00th=[ 338], 99.50th=[ 380], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 31, max= 160, per=26.10%, avg=85.08, stdev=34.37, samples=147 iops : min= 1, max= 10, avg= 4.52, stdev= 2.25, samples=147 lat (msec) : 10=0.52%, 20=9.11%, 50=26.17%, 100=18.36%, 250=41.80% lat (msec) : 500=3.91%, 750=0.13% cpu : usr=0.04%, sys=1.52%, ctx=1421, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145691: Thu Jun 11 22:31:00 2026 read: IOPS=4, BW=74.7KiB/s (76.5kB/s)(5744KiB/76890msec) clat (msec): min=6, max=368, avg=44.07, stdev=46.81 lat (msec): min=6, max=368, avg=44.07, stdev=46.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 129], | 99.00th=[ 262], 99.50th=[ 363], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 21, max= 351, per=28.67%, avg=88.87, stdev=61.92, samples=126 iops : min= 1, max= 21, avg= 4.76, stdev= 3.90, samples=126 write: IOPS=5, BW=85.1KiB/s (87.2kB/s)(6544KiB/76890msec); 0 zone resets clat (msec): min=42, max=629, avg=148.95, stdev=64.76 lat (msec): min=42, max=629, avg=148.96, stdev=64.75 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 241], 95.00th=[ 268], | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 31, max= 191, per=26.64%, avg=86.84, stdev=35.03, samples=147 iops : min= 1, max= 11, avg= 4.63, stdev= 2.28, samples=147 lat (msec) : 10=0.52%, 20=12.89%, 50=22.40%, 100=18.62%, 250=40.89% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.04%, sys=1.41%, ctx=1373, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145692: Thu Jun 11 22:31:00 2026 read: IOPS=5, BW=83.8KiB/s (85.9kB/s)(6256KiB/74613msec) clat (msec): min=6, max=367, avg=44.12, stdev=42.69 lat (msec): min=6, max=367, avg=44.12, stdev=42.69 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 230], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 320, per=29.98%, avg=92.95, stdev=64.47, samples=133 iops : min= 1, max= 20, avg= 5.02, stdev= 4.16, samples=133 write: IOPS=5, BW=80.8KiB/s (82.8kB/s)(6032KiB/74613msec); 0 zone resets clat (msec): min=53, max=482, avg=151.57, stdev=66.86 lat (msec): min=53, max=482, avg=151.58, stdev=66.86 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 68], 10.00th=[ 86], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 194], 90.00th=[ 234], 95.00th=[ 296], | 99.00th=[ 372], 99.50th=[ 405], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 191, per=25.00%, avg=81.51, stdev=34.55, samples=145 iops : min= 1, max= 11, avg= 4.30, stdev= 2.22, samples=145 lat (msec) : 10=0.65%, 20=11.07%, 50=26.69%, 100=18.36%, 250=38.67% lat (msec) : 500=4.56% cpu : usr=0.03%, sys=1.45%, ctx=1425, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145693: Thu Jun 11 22:31:00 2026 read: IOPS=4, BW=79.2KiB/s (81.1kB/s)(6032KiB/76206msec) clat (msec): min=7, max=339, avg=45.61, stdev=46.46 lat (msec): min=7, max=339, avg=45.61, stdev=46.46 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 96], 95.00th=[ 146], | 99.00th=[ 259], 99.50th=[ 309], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 286, per=30.42%, avg=94.31, stdev=61.05, samples=125 iops : min= 1, max= 17, avg= 5.09, stdev= 3.85, samples=125 write: IOPS=5, BW=82.1KiB/s (84.1kB/s)(6256KiB/76206msec); 0 zone resets clat (msec): min=44, max=382, avg=150.05, stdev=62.62 lat (msec): min=44, max=382, avg=150.06, stdev=62.62 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 167], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 21, max= 160, per=25.97%, avg=84.66, stdev=33.98, samples=145 iops : min= 1, max= 10, avg= 4.50, stdev= 2.23, samples=145 lat (msec) : 10=0.26%, 20=11.20%, 50=26.56%, 100=17.45%, 250=39.19% lat (msec) : 500=5.34% cpu : usr=0.03%, sys=1.43%, ctx=1399, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=310KiB/s (318kB/s), 74.7KiB/s-83.8KiB/s (76.5kB/s-85.9kB/s), io=23.4MiB (24.5MB), run=74613-77167msec WRITE: bw=327KiB/s (334kB/s), 80.8KiB/s-85.1KiB/s (82.8kB/s-87.2kB/s), io=24.6MiB (25.8MB), run=74613-77167msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145717: Thu Jun 11 22:31:15 2026 read: IOPS=1, BW=1671KiB/s (1711kB/s)(7168KiB/4290msec) clat (msec): min=2, max=413, avg=227.42, stdev=139.16 lat (msec): min=2, max=413, avg=227.42, stdev=139.16 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 138], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 211], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 376], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2039, max= 3930, per=76.84%, avg=3043.00, stdev=950.91, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1193KiB/s (1222kB/s)(5120KiB/4290msec); 0 zone resets clat (msec): min=244, max=900, avg=506.11, stdev=242.35 lat (msec): min=244, max=900, avg=506.21, stdev=242.38 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1950, max= 2039, per=36.27%, avg=2010.75, stdev=42.05, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.55%, ctx=293, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145718: Thu Jun 11 22:31:15 2026 read: IOPS=0, BW=396KiB/s (406kB/s)(2048KiB/5171msec) clat (msec): min=287, max=351, avg=319.14, stdev=45.27 lat (msec): min=287, max=351, avg=319.15, stdev=45.27 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1592, max= 1950, per=44.72%, avg=1771.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1980KiB/s (2028kB/s)(10.0MiB/5171msec); 0 zone resets clat (msec): min=184, max=751, avg=450.99, stdev=199.47 lat (msec): min=184, max=751, avg=451.08, stdev=199.44 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 203], | 30.00th=[ 211], 40.00th=[ 443], 50.00th=[ 477], 60.00th=[ 493], | 70.00th=[ 498], 80.00th=[ 550], 90.00th=[ 701], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1965, max= 4055, per=52.26%, avg=2897.50, stdev=988.94, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=14.00%, ctx=183, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145719: Thu Jun 11 22:31:15 2026 read: IOPS=1, BW=1587KiB/s (1625kB/s)(6144KiB/3871msec) clat (usec): min=509, max=438786, avg=212354.04, stdev=196259.74 lat (usec): min=510, max=438787, avg=212355.03, stdev=196259.85 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[181404], 50.00th=[181404], 60.00th=[214959], | 70.00th=[438305], 80.00th=[438305], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 1783, max= 4079, per=83.27%, avg=3297.67, stdev=1311.96, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1587KiB/s (1625kB/s)(6144KiB/3871msec); 0 zone resets clat (msec): min=90, max=1063, avg=395.11, stdev=363.36 lat (msec): min=91, max=1063, avg=395.21, stdev=363.36 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 439], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1783, max= 4079, per=53.40%, avg=2960.75, stdev=1265.52, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=13.00%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145720: Thu Jun 11 22:31:15 2026 read: IOPS=1, BW=1354KiB/s (1386kB/s)(5120KiB/3782msec) clat (usec): min=472, max=321536, avg=184093.69, stdev=155636.22 lat (usec): min=473, max=321537, avg=184094.80, stdev=155636.32 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 474], | 30.00th=[ 29492], 40.00th=[ 29492], 50.00th=[274727], 60.00th=[274727], | 70.00th=[295699], 80.00th=[295699], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1895KiB/s (1941kB/s)(7168KiB/3782msec); 0 zone resets clat (msec): min=154, max=643, avg=395.22, stdev=158.28 lat (msec): min=154, max=643, avg=395.33, stdev=158.25 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 292], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 384], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 518], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1783, max= 4079, per=49.72%, avg=2756.20, stdev=1144.45, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=18.33%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3961KiB/s (4056kB/s), 396KiB/s-1671KiB/s (406kB/s-1711kB/s), io=20.0MiB (20.0MB), run=3782-5171msec WRITE: bw=5545KiB/s (5678kB/s), 1193KiB/s-1980KiB/s (1222kB/s-2028kB/s), io=28.0MiB (29.4MB), run=3782-5171msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145722: Thu Jun 11 22:31:16 2026 read: IOPS=1, BW=1401KiB/s (1434kB/s)(7168KiB/5118msec) clat (msec): min=126, max=821, avg=274.15, stdev=247.09 lat (msec): min=126, max=821, avg=274.15, stdev=247.09 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 140], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 171], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 275], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1402, max= 4079, per=67.06%, avg=2286.20, stdev=1034.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=1000KiB/s (1024kB/s)(5120KiB/5118msec); 0 zone resets clat (msec): min=410, max=1117, avg=592.27, stdev=300.74 lat (msec): min=410, max=1117, avg=592.63, stdev=300.55 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1796, max= 2048, per=40.72%, avg=1943.75, stdev=120.15, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.30%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145723: Thu Jun 11 22:31:16 2026 read: IOPS=0, BW=355KiB/s (364kB/s)(2048KiB/5761msec) clat (msec): min=174, max=237, avg=205.77, stdev=44.35 lat (msec): min=174, max=237, avg=205.77, stdev=44.35 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1917, max= 1946, per=56.66%, avg=1931.50, stdev=20.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1777KiB/s (1820kB/s)(10.0MiB/5761msec); 0 zone resets clat (msec): min=226, max=1532, avg=530.97, stdev=448.70 lat (msec): min=226, max=1532, avg=531.06, stdev=448.70 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 257], | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 388], | 70.00th=[ 405], 80.00th=[ 464], 90.00th=[ 1183], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 1861, max= 4079, per=53.14%, avg=2536.43, stdev=1020.08, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=58.33%, 2000=16.67% cpu : usr=0.00%, sys=4.29%, ctx=69, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145724: Thu Jun 11 22:31:16 2026 read: IOPS=1, BW=1081KiB/s (1107kB/s)(6144KiB/5682msec) clat (msec): min=129, max=873, avg=330.43, stdev=275.76 lat (msec): min=129, max=873, avg=330.43, stdev=275.76 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 230], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1917, max= 4071, per=73.25%, avg=2497.00, stdev=1050.55, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1081KiB/s (1107kB/s)(6144KiB/5682msec); 0 zone resets clat (msec): min=275, max=918, avg=565.55, stdev=244.76 lat (msec): min=275, max=918, avg=565.62, stdev=244.76 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 609], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1861, max= 2043, per=41.53%, avg=1982.00, stdev=69.33, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=3.57%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145725: Thu Jun 11 22:31:16 2026 read: IOPS=0, BW=852KiB/s (873kB/s)(5120KiB/6007msec) clat (msec): min=74, max=859, avg=369.04, stdev=339.92 lat (msec): min=74, max=859, avg=369.04, stdev=339.92 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1961, max= 4031, per=78.53%, avg=2677.00, stdev=1173.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1193KiB/s (1222kB/s)(7168KiB/6007msec); 0 zone resets clat (msec): min=104, max=1243, avg=557.54, stdev=458.58 lat (msec): min=104, max=1243, avg=557.62, stdev=458.58 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 112], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 393], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 953], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1861, max= 2043, per=41.13%, avg=1963.25, stdev=76.23, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=25.00% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.43%, ctx=109, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3409KiB/s (3491kB/s), 355KiB/s-1401KiB/s (364kB/s-1434kB/s), io=20.0MiB (20.0MB), run=5118-6007msec WRITE: bw=4773KiB/s (4888kB/s), 1000KiB/s-1777KiB/s (1024kB/s-1820kB/s), io=28.0MiB (29.4MB), run=5118-6007msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Thu Jun 11 22:31:29 2026 read: IOPS=1, BW=4697KiB/s (4810kB/s)(12.0MiB/2616msec) clat (msec): min=755, max=968, avg=848.49, stdev=109.26 lat (msec): min=755, max=968, avg=848.49, stdev=109.26 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=13.61%, ctx=299, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145733: Thu Jun 11 22:31:29 2026 read: IOPS=0, BW=1485KiB/s (1521kB/s)(4096KiB/2758msec) clat (nsec): min=681797k, max=681797k, avg=681797447.00, stdev= 0.00 lat (nsec): min=681800k, max=681800k, avg=681800356.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5618, max= 5618, per=94.58%, avg=5618.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2970KiB/s (3042kB/s)(8192KiB/2758msec); 0 zone resets clat (msec): min=648, max=1397, avg=1023.06, stdev=529.19 lat (msec): min=652, max=1397, avg=1025.27, stdev=526.64 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8000, max= 8000, per=77.35%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.11%, sys=5.26%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145734: Thu Jun 11 22:31:29 2026 write: IOPS=0, BW=3879KiB/s (3972kB/s)(12.0MiB/3168msec); 0 zone resets clat (msec): min=859, max=1257, avg=1044.02, stdev=200.76 lat (msec): min=860, max=1263, avg=1046.55, stdev=203.19 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8094, max= 8159, per=78.57%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.99%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145735: Thu Jun 11 22:31:29 2026 write: IOPS=1, BW=4828KiB/s (4944kB/s)(12.0MiB/2545msec); 0 zone resets clat (msec): min=694, max=1002, avg=833.05, stdev=156.43 lat (msec): min=694, max=1002, avg=833.43, stdev=156.42 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8175, max= 8192, per=79.12%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.39%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5941KiB/s (6083kB/s), 1485KiB/s-4697KiB/s (1521kB/s-4810kB/s), io=16.0MiB (16.8MB), run=2616-2758msec WRITE: bw=10.1MiB/s (10.6MB/s), 2970KiB/s-4828KiB/s (3042kB/s-4944kB/s), io=32.0MiB (33.6MB), run=2545-3168msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145737: Thu Jun 11 22:31:30 2026 read: IOPS=1, BW=4473KiB/s (4581kB/s)(12.0MiB/2747msec) clat (msec): min=337, max=1606, avg=915.09, stdev=642.00 lat (msec): min=337, max=1606, avg=915.09, stdev=642.00 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.61%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145738: Thu Jun 11 22:31:30 2026 read: IOPS=0, BW=1428KiB/s (1462kB/s)(4096KiB/2868msec) clat (nsec): min=558159k, max=558159k, avg=558159312.00, stdev= 0.00 lat (nsec): min=558161k, max=558161k, avg=558160515.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7013, max= 7013, per=100.00%, avg=7013.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2856KiB/s (2925kB/s)(8192KiB/2868msec); 0 zone resets clat (msec): min=924, max=1382, avg=1153.69, stdev=323.56 lat (msec): min=925, max=1382, avg=1154.00, stdev=323.38 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7801, max= 7801, per=68.28%, avg=7801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.13%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145739: Thu Jun 11 22:31:30 2026 write: IOPS=1, BW=5418KiB/s (5548kB/s)(12.0MiB/2268msec); 0 zone resets clat (msec): min=362, max=1483, avg=755.02, stdev=631.18 lat (msec): min=362, max=1483, avg=755.41, stdev=631.10 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 6282, max= 8143, per=63.13%, avg=7212.50, stdev=1315.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=5.87%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145740: Thu Jun 11 22:31:30 2026 write: IOPS=1, BW=4787KiB/s (4902kB/s)(12.0MiB/2567msec); 0 zone resets clat (msec): min=395, max=1694, avg=854.43, stdev=728.51 lat (msec): min=396, max=1694, avg=855.04, stdev=728.31 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 6930, max= 6930, per=60.66%, avg=6930.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.17%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5713KiB/s (5850kB/s), 1428KiB/s-4473KiB/s (1462kB/s-4581kB/s), io=16.0MiB (16.8MB), run=2747-2868msec WRITE: bw=11.2MiB/s (11.7MB/s), 2856KiB/s-5418KiB/s (2925kB/s-5548kB/s), io=32.0MiB (33.6MB), run=2268-2868msec