== sanity test 398b: DIO and buffer IO race ============== 20:52:48 (1777423968) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.94012 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188449: Tue Apr 28 20:53:52 2026 read: IOPS=27, BW=110KiB/s (112kB/s)(5992KiB/54554msec) clat (usec): min=212, max=282402, avg=19498.19, stdev=12111.20 lat (usec): min=213, max=282403, avg=19503.34, stdev=12110.28 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 7570], 10.00th=[ 9241], 20.00th=[ 11338], | 30.00th=[ 13304], 40.00th=[ 15139], 50.00th=[ 17433], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 26608], 90.00th=[ 32375], 95.00th=[ 38536], | 99.00th=[ 53216], 99.50th=[ 56361], 99.90th=[ 72877], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 47, max= 184, per=24.99%, avg=109.20, stdev=32.01, samples=108 iops : min= 11, max= 46, avg=26.89, stdev= 8.05, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6296KiB/54554msec); 0 zone resets clat (usec): min=827, max=88501, avg=15994.28, stdev=12050.81 lat (usec): min=827, max=88503, avg=15995.30, stdev=12050.97 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2835], 10.00th=[ 3294], 20.00th=[ 4817], | 30.00th=[ 7767], 40.00th=[10552], 50.00th=[13173], 60.00th=[16319], | 70.00th=[20317], 80.00th=[25035], 90.00th=[33817], 95.00th=[39584], | 99.00th=[52691], 99.50th=[58459], 99.90th=[70779], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 39, max= 200, per=25.05%, avg=114.74, stdev=34.29, samples=108 iops : min= 9, max= 50, avg=28.26, stdev= 8.71, samples=108 lat (usec) : 250=0.03%, 500=0.29%, 750=0.65%, 1000=0.26% lat (msec) : 2=0.78%, 4=7.45%, 10=16.57%, 20=39.19%, 50=33.43% lat (msec) : 100=1.30%, 500=0.03% cpu : usr=0.10%, sys=26.66%, ctx=10043, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188450: Tue Apr 28 20:53:52 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5940KiB/54882msec) clat (usec): min=396, max=90485, avg=19648.94, stdev=10695.24 lat (usec): min=397, max=90486, avg=19653.08, stdev=10695.43 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 7439], 10.00th=[ 9110], 20.00th=[11207], | 30.00th=[13435], 40.00th=[15533], 50.00th=[17957], 60.00th=[20055], | 70.00th=[23200], 80.00th=[26870], 90.00th=[32375], 95.00th=[38011], | 99.00th=[58983], 99.50th=[65274], 99.90th=[81265], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 13, max= 176, per=24.72%, avg=108.01, stdev=33.95, samples=109 iops : min= 3, max= 44, avg=26.59, stdev= 8.56, samples=109 write: IOPS=28, BW=116KiB/s (118kB/s)(6348KiB/54882msec); 0 zone resets clat (usec): min=704, max=283221, avg=16098.30, stdev=13948.93 lat (usec): min=705, max=283222, avg=16099.29, stdev=13948.96 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2835], 10.00th=[ 3294], 20.00th=[ 4948], | 30.00th=[ 7570], 40.00th=[ 10290], 50.00th=[ 12780], 60.00th=[ 16188], | 70.00th=[ 20055], 80.00th=[ 25035], 90.00th=[ 33162], 95.00th=[ 40633], | 99.00th=[ 53216], 99.50th=[ 63701], 99.90th=[ 86508], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 39, max= 240, per=25.13%, avg=115.09, stdev=36.31, samples=109 iops : min= 9, max= 60, avg=28.36, stdev= 9.22, samples=109 lat (usec) : 500=0.23%, 750=0.78%, 1000=0.49% lat (msec) : 2=0.91%, 4=7.19%, 10=17.35%, 20=37.76%, 50=33.72% lat (msec) : 100=1.53%, 500=0.03% cpu : usr=0.10%, sys=26.36%, ctx=10138, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188451: Tue Apr 28 20:53:52 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(6028KiB/54438msec) clat (usec): min=149, max=86072, avg=19599.99, stdev=10251.75 lat (usec): min=150, max=86073, avg=19600.94, stdev=10251.95 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 7832], 10.00th=[ 9110], 20.00th=[11076], | 30.00th=[13173], 40.00th=[15401], 50.00th=[17433], 60.00th=[20055], | 70.00th=[22938], 80.00th=[27132], 90.00th=[33162], 95.00th=[39060], | 99.00th=[51119], 99.50th=[55837], 99.90th=[68682], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 19, max= 184, per=25.28%, avg=110.46, stdev=33.11, samples=108 iops : min= 4, max= 46, avg=27.19, stdev= 8.37, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54438msec); 0 zone resets clat (usec): min=856, max=303552, avg=15810.43, stdev=13817.77 lat (usec): min=856, max=303554, avg=15811.49, stdev=13817.80 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2769], 10.00th=[ 3326], 20.00th=[ 4686], | 30.00th=[ 7570], 40.00th=[ 10290], 50.00th=[ 12649], 60.00th=[ 15664], | 70.00th=[ 20055], 80.00th=[ 25035], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 52167], 99.50th=[ 62129], 99.90th=[ 67634], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 26, max= 208, per=25.01%, avg=114.53, stdev=37.86, samples=108 iops : min= 6, max= 52, avg=28.21, stdev= 9.56, samples=108 lat (usec) : 250=0.10%, 500=0.20%, 750=0.39%, 1000=0.20% lat (msec) : 2=1.04%, 4=7.03%, 10=17.81%, 20=38.44%, 50=33.53% lat (msec) : 100=1.24%, 500=0.03% cpu : usr=0.09%, sys=26.56%, ctx=10218, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188452: Tue Apr 28 20:53:52 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6052KiB/54585msec) clat (usec): min=219, max=277732, avg=19513.47, stdev=12224.39 lat (usec): min=220, max=277732, avg=19514.29, stdev=12224.46 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15664], 50.00th=[ 17695], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 26084], 90.00th=[ 33424], 95.00th=[ 39060], | 99.00th=[ 50594], 99.50th=[ 57934], 99.90th=[ 85459], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 33, max= 190, per=25.19%, avg=110.08, stdev=30.38, samples=108 iops : min= 8, max= 47, avg=27.10, stdev= 7.68, samples=108 write: IOPS=28, BW=114KiB/s (117kB/s)(6236KiB/54585msec); 0 zone resets clat (usec): min=657, max=83955, avg=15983.31, stdev=11921.68 lat (usec): min=657, max=83956, avg=15984.24, stdev=11921.76 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2835], 10.00th=[ 3195], 20.00th=[ 4555], | 30.00th=[ 8094], 40.00th=[11076], 50.00th=[13566], 60.00th=[16581], | 70.00th=[20055], 80.00th=[25035], 90.00th=[32375], 95.00th=[38536], | 99.00th=[52691], 99.50th=[58983], 99.90th=[74974], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 46, max= 216, per=24.83%, avg=113.74, stdev=37.33, samples=108 iops : min= 11, max= 54, avg=28.02, stdev= 9.42, samples=108 lat (usec) : 250=0.07%, 500=0.23%, 750=0.88%, 1000=0.46% lat (msec) : 2=0.68%, 4=8.11%, 10=14.78%, 20=40.76%, 50=32.71% lat (msec) : 100=1.30%, 500=0.03% cpu : usr=0.09%, sys=26.51%, ctx=10180, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (448kB/s), 108KiB/s-111KiB/s (111kB/s-114kB/s), io=23.4MiB (24.6MB), run=54438-54882msec WRITE: bw=458KiB/s (469kB/s), 114KiB/s-116KiB/s (117kB/s-118kB/s), io=24.6MiB (25.7MB), run=54438-54882msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188444: Tue Apr 28 20:53:58 2026 read: IOPS=24, BW=99.1KiB/s (102kB/s)(5992KiB/60442msec) clat (msec): min=2, max=293, avg=17.83, stdev=15.56 lat (msec): min=2, max=293, avg=17.83, stdev=15.56 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 74], 99.90th=[ 101], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 392, per=24.87%, avg=98.47, stdev=74.38, samples=120 iops : min= 7, max= 98, avg=24.22, stdev=18.72, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6296KiB/60442msec); 0 zone resets clat (msec): min=4, max=125, avg=21.31, stdev=15.66 lat (msec): min=4, max=125, avg=21.31, stdev=15.66 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 97], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 13, max= 416, per=24.94%, avg=103.50, stdev=77.64, samples=120 iops : min= 3, max= 104, avg=25.47, stdev=19.54, samples=120 lat (msec) : 4=1.37%, 10=31.64%, 20=28.52%, 50=33.98%, 100=4.43% lat (msec) : 250=0.03%, 500=0.03% cpu : usr=0.07%, sys=14.71%, ctx=6875, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188445: Tue Apr 28 20:53:58 2026 read: IOPS=24, BW=98.2KiB/s (101kB/s)(5940KiB/60484msec) clat (msec): min=2, max=293, avg=17.63, stdev=15.36 lat (msec): min=2, max=293, avg=17.64, stdev=15.36 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 62], 99.50th=[ 66], 99.90th=[ 85], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 6, max= 424, per=24.64%, avg=97.58, stdev=76.81, samples=120 iops : min= 1, max= 106, avg=23.99, stdev=19.34, samples=120 write: IOPS=26, BW=105KiB/s (107kB/s)(6348KiB/60484msec); 0 zone resets clat (msec): min=3, max=126, avg=21.49, stdev=15.27 lat (msec): min=3, max=126, avg=21.49, stdev=15.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 68], 99.50th=[ 82], 99.90th=[ 95], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 31, max= 392, per=25.03%, avg=103.87, stdev=75.30, samples=120 iops : min= 7, max= 98, avg=25.57, stdev=18.94, samples=120 lat (msec) : 4=1.56%, 10=31.28%, 20=28.32%, 50=34.11%, 100=4.65% lat (msec) : 250=0.03%, 500=0.03% cpu : usr=0.08%, sys=14.87%, ctx=6798, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188446: Tue Apr 28 20:53:58 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6028KiB/60110msec) clat (usec): min=2684, max=95853, avg=17290.75, stdev=13291.91 lat (usec): min=2685, max=95854, avg=17291.54, stdev=13292.17 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4359], 10.00th=[ 4752], 20.00th=[ 5669], | 30.00th=[ 8455], 40.00th=[10945], 50.00th=[13566], 60.00th=[16712], | 70.00th=[20317], 80.00th=[26346], 90.00th=[35390], 95.00th=[43254], | 99.00th=[61080], 99.50th=[69731], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 15, max= 408, per=25.15%, avg=99.58, stdev=77.42, samples=119 iops : min= 3, max= 102, avg=24.47, stdev=19.49, samples=119 write: IOPS=26, BW=104KiB/s (107kB/s)(6260KiB/60110msec); 0 zone resets clat (msec): min=4, max=295, avg=21.64, stdev=16.70 lat (msec): min=4, max=295, avg=21.64, stdev=16.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 70], 99.50th=[ 82], 99.90th=[ 106], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 26, max= 400, per=24.87%, avg=103.20, stdev=73.70, samples=119 iops : min= 6, max= 100, avg=25.39, stdev=18.56, samples=119 lat (msec) : 4=1.40%, 10=30.99%, 20=29.82%, 50=33.69%, 100=4.04% lat (msec) : 250=0.03%, 500=0.03% cpu : usr=0.08%, sys=15.05%, ctx=6817, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188447: Tue Apr 28 20:53:58 2026 read: IOPS=24, BW=99.9KiB/s (102kB/s)(6052KiB/60569msec) clat (msec): min=2, max=102, avg=17.65, stdev=14.06 lat (msec): min=2, max=102, avg=17.65, stdev=14.06 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 66], 99.50th=[ 77], 99.90th=[ 95], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 13, max= 384, per=24.86%, avg=98.43, stdev=75.25, samples=120 iops : min= 3, max= 96, avg=24.21, stdev=18.94, samples=120 write: IOPS=25, BW=103KiB/s (105kB/s)(6236KiB/60569msec); 0 zone resets clat (msec): min=3, max=292, avg=21.60, stdev=17.38 lat (msec): min=3, max=292, avg=21.60, stdev=17.38 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 89], 99.90th=[ 104], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 26, max= 416, per=24.44%, avg=101.42, stdev=77.01, samples=120 iops : min= 6, max= 104, avg=24.95, stdev=19.39, samples=120 lat (msec) : 4=1.82%, 10=31.25%, 20=28.39%, 50=33.92%, 100=4.52% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.07%, sys=14.59%, ctx=6881, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=396KiB/s (406kB/s), 98.2KiB/s-100KiB/s (101kB/s-103kB/s), io=23.4MiB (24.6MB), run=60110-60569msec WRITE: bw=415KiB/s (425kB/s), 103KiB/s-105KiB/s (105kB/s-107kB/s), io=24.6MiB (25.7MB), run=60110-60569msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188476: Tue Apr 28 20:54:18 2026 read: IOPS=24, BW=386KiB/s (396kB/s)(5920KiB/15322msec) clat (usec): min=244, max=88954, avg=20882.15, stdev=11426.79 lat (usec): min=245, max=88955, avg=20882.75, stdev=11426.87 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 5866], 10.00th=[ 9896], 20.00th=[12125], | 30.00th=[14615], 40.00th=[16909], 50.00th=[18744], 60.00th=[21365], | 70.00th=[24511], 80.00th=[28181], 90.00th=[36963], 95.00th=[41681], | 99.00th=[57934], 99.50th=[63701], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 158, max= 574, per=25.21%, avg=384.93, stdev=108.10, samples=30 iops : min= 9, max= 35, avg=23.57, stdev= 6.81, samples=30 write: IOPS=25, BW=416KiB/s (426kB/s)(6368KiB/15322msec); 0 zone resets clat (usec): min=1085, max=64264, avg=18906.72, stdev=12973.74 lat (usec): min=1086, max=64265, avg=18912.89, stdev=12971.04 clat percentiles (usec): | 1.00th=[ 2606], 5.00th=[ 4490], 10.00th=[ 5014], 20.00th=[ 7701], | 30.00th=[10290], 40.00th=[11994], 50.00th=[14746], 60.00th=[19006], | 70.00th=[24511], 80.00th=[29754], 90.00th=[36439], 95.00th=[44303], | 99.00th=[59507], 99.50th=[62653], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 192, max= 638, per=25.86%, avg=415.50, stdev=140.97, samples=30 iops : min= 12, max= 39, avg=25.50, stdev= 8.82, samples=30 lat (usec) : 250=0.13%, 500=0.52%, 750=0.52%, 1000=0.52% lat (msec) : 2=0.65%, 4=1.30%, 10=16.93%, 20=38.02%, 50=38.93% lat (msec) : 100=2.47% cpu : usr=0.09%, sys=28.62%, ctx=3149, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188478: Tue Apr 28 20:54:18 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(5744KiB/15529msec) clat (usec): min=514, max=61067, avg=21723.49, stdev=11255.72 lat (usec): min=515, max=61068, avg=21724.52, stdev=11255.35 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 8029], 10.00th=[10028], 20.00th=[12911], | 30.00th=[14877], 40.00th=[16909], 50.00th=[19006], 60.00th=[21890], | 70.00th=[25560], 80.00th=[29754], 90.00th=[39584], 95.00th=[43254], | 99.00th=[57934], 99.50th=[58983], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 127, max= 576, per=24.24%, avg=370.13, stdev=124.44, samples=30 iops : min= 7, max= 36, avg=22.63, stdev= 7.82, samples=30 write: IOPS=26, BW=421KiB/s (432kB/s)(6544KiB/15529msec); 0 zone resets clat (usec): min=1249, max=77284, avg=18845.23, stdev=12299.13 lat (usec): min=1251, max=77285, avg=18846.28, stdev=12299.25 clat percentiles (usec): | 1.00th=[ 2180], 5.00th=[ 4490], 10.00th=[ 5473], 20.00th=[ 8586], | 30.00th=[10814], 40.00th=[13435], 50.00th=[16712], 60.00th=[19530], | 70.00th=[22676], 80.00th=[27657], 90.00th=[34866], 95.00th=[40633], | 99.00th=[62653], 99.50th=[68682], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 159, max= 670, per=25.77%, avg=414.17, stdev=136.92, samples=30 iops : min= 9, max= 41, avg=25.40, stdev= 8.56, samples=30 lat (usec) : 750=0.78%, 1000=0.26% lat (msec) : 2=0.39%, 4=0.91%, 10=15.49%, 20=39.58%, 50=40.36% lat (msec) : 100=2.21% cpu : usr=0.10%, sys=28.10%, ctx=3220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188480: Tue Apr 28 20:54:18 2026 read: IOPS=24, BW=399KiB/s (409kB/s)(6256KiB/15677msec) clat (usec): min=466, max=77343, avg=21247.74, stdev=11632.70 lat (usec): min=467, max=77344, avg=21248.34, stdev=11632.77 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 1139], 10.00th=[ 9503], 20.00th=[11731], | 30.00th=[14877], 40.00th=[17433], 50.00th=[19530], 60.00th=[22152], | 70.00th=[24773], 80.00th=[28705], 90.00th=[36963], 95.00th=[43779], | 99.00th=[56361], 99.50th=[62653], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 190, max= 702, per=26.16%, avg=399.52, stdev=131.51, samples=31 iops : min= 11, max= 43, avg=24.48, stdev= 8.23, samples=31 write: IOPS=24, BW=385KiB/s (394kB/s)(6032KiB/15677msec); 0 zone resets clat (usec): min=1026, max=98232, avg=19284.98, stdev=12755.05 lat (usec): min=1027, max=98233, avg=19286.24, stdev=12755.15 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4686], 10.00th=[ 5997], 20.00th=[ 8848], | 30.00th=[11469], 40.00th=[13566], 50.00th=[16450], 60.00th=[19792], | 70.00th=[23725], 80.00th=[27919], 90.00th=[35914], 95.00th=[42206], | 99.00th=[58459], 99.50th=[76022], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 190, max= 608, per=23.58%, avg=378.87, stdev=123.43, samples=31 iops : min= 11, max= 38, avg=23.19, stdev= 7.84, samples=31 lat (usec) : 500=0.26%, 750=1.56%, 1000=0.39% lat (msec) : 2=0.78%, 4=1.04%, 10=14.58%, 20=37.11%, 50=41.93% lat (msec) : 100=2.34% cpu : usr=0.10%, sys=27.86%, ctx=3439, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188482: Tue Apr 28 20:54:18 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(6032KiB/15597msec) clat (usec): min=449, max=66064, avg=21750.09, stdev=11263.32 lat (usec): min=450, max=66065, avg=21750.69, stdev=11263.36 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 3621], 10.00th=[ 9765], 20.00th=[13435], | 30.00th=[15533], 40.00th=[17695], 50.00th=[20055], 60.00th=[22414], | 70.00th=[25560], 80.00th=[29492], 90.00th=[37487], 95.00th=[43779], | 99.00th=[53216], 99.50th=[65274], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 192, max= 574, per=25.30%, avg=386.26, stdev=106.85, samples=31 iops : min= 12, max= 35, avg=23.68, stdev= 6.74, samples=31 write: IOPS=25, BW=401KiB/s (411kB/s)(6256KiB/15597msec); 0 zone resets clat (usec): min=1237, max=67128, avg=18667.47, stdev=12169.93 lat (usec): min=1238, max=67130, avg=18668.60, stdev=12170.01 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 4490], 10.00th=[ 5145], 20.00th=[ 8291], | 30.00th=[10421], 40.00th=[12911], 50.00th=[15270], 60.00th=[18482], | 70.00th=[23200], 80.00th=[28967], 90.00th=[35390], 95.00th=[41157], | 99.00th=[54264], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 158, max= 640, per=24.99%, avg=401.58, stdev=127.43, samples=31 iops : min= 9, max= 40, avg=24.61, stdev= 8.01, samples=31 lat (usec) : 500=0.39%, 750=1.04%, 1000=0.26% lat (msec) : 2=0.91%, 4=1.04%, 10=15.89%, 20=37.50%, 50=41.15% lat (msec) : 100=1.82% cpu : usr=0.11%, sys=28.42%, ctx=3302, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1528KiB/s (1565kB/s), 370KiB/s-399KiB/s (379kB/s-409kB/s), io=23.4MiB (24.5MB), run=15322-15677msec WRITE: bw=1607KiB/s (1646kB/s), 385KiB/s-421KiB/s (394kB/s-432kB/s), io=24.6MiB (25.8MB), run=15322-15677msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188475: Tue Apr 28 20:54:20 2026 read: IOPS=21, BW=351KiB/s (359kB/s)(5920KiB/16885msec) clat (msec): min=2, max=107, avg=19.83, stdev=14.86 lat (msec): min=2, max=107, avg=19.83, stdev=14.86 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 68], 99.50th=[ 95], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 95, max= 992, per=23.72%, avg=336.30, stdev=173.99, samples=33 iops : min= 5, max= 62, avg=20.45, stdev=11.11, samples=33 write: IOPS=23, BW=377KiB/s (386kB/s)(6368KiB/16885msec); 0 zone resets clat (usec): min=3140, max=86095, avg=23837.12, stdev=15106.31 lat (usec): min=3140, max=86097, avg=23838.66, stdev=15106.09 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 6390], 10.00th=[ 7701], 20.00th=[10421], | 30.00th=[13435], 40.00th=[16319], 50.00th=[19792], 60.00th=[24773], | 70.00th=[30278], 80.00th=[35914], 90.00th=[43254], 95.00th=[53740], | 99.00th=[70779], 99.50th=[76022], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 128, max= 1152, per=24.57%, avg=366.58, stdev=191.32, samples=33 iops : min= 8, max= 72, avg=22.36, stdev=12.06, samples=33 lat (msec) : 4=1.43%, 10=20.31%, 20=34.90%, 50=37.11%, 100=6.12% lat (msec) : 250=0.13% cpu : usr=0.10%, sys=15.31%, ctx=1944, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188477: Tue Apr 28 20:54:20 2026 read: IOPS=21, BW=341KiB/s (349kB/s)(5744KiB/16838msec) clat (usec): min=3790, max=94851, avg=20153.41, stdev=13762.44 lat (usec): min=3791, max=94851, avg=20153.97, stdev=13762.49 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5800], 10.00th=[ 6915], 20.00th=[ 9372], | 30.00th=[11338], 40.00th=[13304], 50.00th=[15926], 60.00th=[19530], | 70.00th=[23725], 80.00th=[29754], 90.00th=[39060], 95.00th=[47973], | 99.00th=[63701], 99.50th=[77071], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 159, max= 864, per=23.80%, avg=337.45, stdev=153.12, samples=33 iops : min= 9, max= 54, avg=20.55, stdev= 9.67, samples=33 write: IOPS=24, BW=389KiB/s (398kB/s)(6544KiB/16838msec); 0 zone resets clat (msec): min=5, max=101, avg=23.33, stdev=14.36 lat (msec): min=5, max=101, avg=23.33, stdev=14.36 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 54], | 99.00th=[ 67], 99.50th=[ 74], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 126, max= 1184, per=25.31%, avg=377.67, stdev=209.25, samples=33 iops : min= 7, max= 74, avg=23.06, stdev=13.25, samples=33 lat (msec) : 4=0.26%, 10=18.62%, 20=36.85%, 50=39.19%, 100=4.95% lat (msec) : 250=0.13% cpu : usr=0.02%, sys=15.36%, ctx=1857, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188479: Tue Apr 28 20:54:20 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6256KiB/16807msec) clat (msec): min=3, max=103, avg=19.15, stdev=14.14 lat (msec): min=3, max=103, avg=19.15, stdev=14.15 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 49], | 99.00th=[ 67], 99.50th=[ 70], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 127, max= 1344, per=26.03%, avg=369.15, stdev=221.89, samples=33 iops : min= 7, max= 84, avg=22.52, stdev=14.05, samples=33 write: IOPS=22, BW=359KiB/s (368kB/s)(6032KiB/16807msec); 0 zone resets clat (usec): min=5026, max=80648, avg=24661.16, stdev=14988.95 lat (usec): min=5027, max=80649, avg=24662.42, stdev=14989.02 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[11207], | 30.00th=[14222], 40.00th=[16909], 50.00th=[20579], 60.00th=[25822], | 70.00th=[31065], 80.00th=[37487], 90.00th=[45351], 95.00th=[52691], | 99.00th=[67634], 99.50th=[74974], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 159, max= 896, per=23.58%, avg=351.79, stdev=157.11, samples=33 iops : min= 9, max= 56, avg=21.42, stdev= 9.99, samples=33 lat (msec) : 4=0.39%, 10=20.05%, 20=38.80%, 50=35.55%, 100=5.08% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=15.44%, ctx=1922, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188481: Tue Apr 28 20:54:20 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(6032KiB/16848msec) clat (msec): min=2, max=103, avg=19.17, stdev=14.40 lat (msec): min=2, max=103, avg=19.17, stdev=14.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 71], 99.50th=[ 89], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 159, max= 1152, per=24.54%, avg=348.00, stdev=194.02, samples=33 iops : min= 9, max= 72, avg=21.18, stdev=12.32, samples=33 write: IOPS=23, BW=371KiB/s (380kB/s)(6256KiB/16848msec); 0 zone resets clat (msec): min=5, max=108, avg=24.50, stdev=14.64 lat (msec): min=5, max=108, avg=24.50, stdev=14.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 66], 99.50th=[ 79], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 127, max= 1056, per=24.48%, avg=365.21, stdev=176.80, samples=33 iops : min= 7, max= 66, avg=22.27, stdev=11.26, samples=33 lat (msec) : 4=0.26%, 10=21.35%, 20=34.38%, 50=38.15%, 100=5.60% lat (msec) : 250=0.26% cpu : usr=0.07%, sys=15.75%, ctx=1894, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1419KiB/s (1453kB/s), 341KiB/s-372KiB/s (349kB/s-381kB/s), io=23.4MiB (24.5MB), run=16807-16885msec WRITE: bw=1492KiB/s (1528kB/s), 359KiB/s-389KiB/s (368kB/s-398kB/s), io=24.6MiB (25.8MB), run=16807-16885msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188494: Tue Apr 28 20:54:29 2026 read: IOPS=2, BW=2888KiB/s (2957kB/s)(7168KiB/2482msec) clat (usec): min=1096, max=264501, avg=139104.97, stdev=79154.34 lat (usec): min=1098, max=264502, avg=139106.05, stdev=79154.31 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[104334], | 30.00th=[130548], 40.00th=[130548], 50.00th=[143655], 60.00th=[156238], | 70.00th=[156238], 80.00th=[175113], 90.00th=[265290], 95.00th=[265290], | 99.00th=[265290], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 3961, max= 5678, per=76.26%, avg=4819.50, stdev=1214.10, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2063KiB/s (2112kB/s)(5120KiB/2482msec); 0 zone resets clat (msec): min=155, max=442, avg=297.97, stdev=107.13 lat (msec): min=155, max=442, avg=298.03, stdev=107.13 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1961, max= 4087, per=30.24%, avg=2676.00, stdev=1222.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=48.69%, ctx=1024, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188496: Tue Apr 28 20:54:29 2026 read: IOPS=0, BW=632KiB/s (647kB/s)(2048KiB/3240msec) clat (msec): min=111, max=185, avg=148.70, stdev=52.39 lat (msec): min=111, max=185, avg=148.70, stdev=52.39 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1984, max= 2039, per=31.83%, avg=2011.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3160KiB/s (3236kB/s)(10.0MiB/3240msec); 0 zone resets clat (msec): min=47, max=520, avg=292.75, stdev=164.24 lat (msec): min=47, max=520, avg=292.83, stdev=164.23 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 118], | 30.00th=[ 176], 40.00th=[ 207], 50.00th=[ 218], 60.00th=[ 305], | 70.00th=[ 409], 80.00th=[ 439], 90.00th=[ 489], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1961, max= 4087, per=31.78%, avg=2811.80, stdev=1121.60, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=48.69%, ctx=417, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188497: Tue Apr 28 20:54:29 2026 read: IOPS=2, BW=2343KiB/s (2399kB/s)(6144KiB/2622msec) clat (usec): min=866, max=297735, avg=62306.39, stdev=117845.34 lat (usec): min=866, max=297736, avg=62307.12, stdev=117845.59 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 930], | 30.00th=[ 930], 40.00th=[ 1139], 50.00th=[ 1139], 60.00th=[ 10028], | 70.00th=[ 63177], 80.00th=[ 63177], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2039, max= 4087, per=53.00%, avg=3349.67, stdev=1138.03, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2343KiB/s (2399kB/s)(6144KiB/2622msec); 0 zone resets clat (msec): min=175, max=648, avg=365.67, stdev=158.97 lat (msec): min=175, max=649, avg=365.72, stdev=158.98 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 363], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1921, max= 4079, per=27.09%, avg=2396.80, stdev=941.41, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=16.67% lat (msec) : 2=8.33%, 20=8.33%, 100=8.33%, 250=8.33%, 500=41.67% lat (msec) : 750=8.33% cpu : usr=0.08%, sys=39.60%, ctx=137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188498: Tue Apr 28 20:54:29 2026 read: IOPS=2, BW=2404KiB/s (2461kB/s)(5120KiB/2130msec) clat (usec): min=1025, max=166075, avg=49230.95, stdev=70903.04 lat (usec): min=1027, max=166076, avg=49231.78, stdev=70902.82 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1029], 10.00th=[ 1029], 20.00th=[ 1029], | 30.00th=[ 1205], 40.00th=[ 1205], 50.00th=[ 10552], 60.00th=[ 10552], | 70.00th=[ 67634], 80.00th=[ 67634], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 1980, max= 6131, per=64.17%, avg=4055.50, stdev=2935.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3365KiB/s (3446kB/s)(7168KiB/2130msec); 0 zone resets clat (msec): min=127, max=531, avg=260.88, stdev=137.06 lat (msec): min=128, max=531, avg=260.93, stdev=137.07 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 167], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 222], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 334], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1965, max= 5941, per=45.18%, avg=3997.67, stdev=1989.50, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 2=16.67%, 20=8.33%, 100=8.33%, 250=41.67%, 500=16.67% lat (msec) : 750=8.33% cpu : usr=0.05%, sys=53.36%, ctx=341, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6321KiB/s (6473kB/s), 632KiB/s-2888KiB/s (647kB/s-2957kB/s), io=20.0MiB (20.0MB), run=2130-3240msec WRITE: bw=8849KiB/s (9062kB/s), 2063KiB/s-3365KiB/s (2112kB/s-3446kB/s), io=28.0MiB (29.4MB), run=2130-3240msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188491: Tue Apr 28 20:54:29 2026 read: IOPS=2, BW=2409KiB/s (2466kB/s)(7168KiB/2976msec) clat (msec): min=81, max=459, avg=200.03, stdev=140.55 lat (msec): min=81, max=459, avg=200.03, stdev=140.55 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 112], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 138], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 334], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 4071, max= 5988, per=78.68%, avg=5029.50, stdev=1355.52, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1720KiB/s (1762kB/s)(5120KiB/2976msec); 0 zone resets clat (msec): min=146, max=624, avg=300.94, stdev=198.03 lat (msec): min=146, max=624, avg=301.00, stdev=198.03 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1988, max= 4063, per=30.12%, avg=2695.33, stdev=1184.67, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=17.18%, ctx=169, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188492: Tue Apr 28 20:54:29 2026 read: IOPS=0, BW=647KiB/s (663kB/s)(2048KiB/3163msec) clat (msec): min=62, max=157, avg=109.61, stdev=67.29 lat (msec): min=62, max=157, avg=109.61, stdev=67.29 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 1950, max= 2031, per=31.14%, avg=1990.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3237KiB/s (3315kB/s)(10.0MiB/3163msec); 0 zone resets clat (msec): min=74, max=605, avg=292.38, stdev=179.93 lat (msec): min=74, max=605, avg=292.44, stdev=179.92 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 86], | 30.00th=[ 142], 40.00th=[ 176], 50.00th=[ 222], 60.00th=[ 347], | 70.00th=[ 372], 80.00th=[ 430], 90.00th=[ 477], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1950, max= 5699, per=32.91%, avg=2945.17, stdev=1562.08, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=20.46%, ctx=173, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188493: Tue Apr 28 20:54:29 2026 read: IOPS=1, BW=1918KiB/s (1964kB/s)(6144KiB/3204msec) clat (msec): min=45, max=477, avg=229.37, stdev=177.46 lat (msec): min=45, max=477, avg=229.37, stdev=177.46 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 330], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1988, max= 3799, per=38.54%, avg=2463.25, stdev=890.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1918KiB/s (1964kB/s)(6144KiB/3204msec); 0 zone resets clat (msec): min=80, max=570, avg=297.28, stdev=176.78 lat (msec): min=80, max=570, avg=297.34, stdev=176.79 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 284], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1899, max= 2031, per=22.20%, avg=1986.60, stdev=53.91, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.64%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188495: Tue Apr 28 20:54:29 2026 read: IOPS=1, BW=1662KiB/s (1702kB/s)(5120KiB/3080msec) clat (msec): min=75, max=323, avg=175.97, stdev=108.95 lat (msec): min=75, max=323, avg=175.97, stdev=108.95 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2035, max= 6095, per=63.60%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2327KiB/s (2383kB/s)(7168KiB/3080msec); 0 zone resets clat (msec): min=94, max=693, avg=304.65, stdev=197.14 lat (msec): min=94, max=694, avg=304.72, stdev=197.14 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 176], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 376], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1984, max= 3976, per=29.78%, avg=2665.00, stdev=1135.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=22.25%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6392KiB/s (6545kB/s), 647KiB/s-2409KiB/s (663kB/s-2466kB/s), io=20.0MiB (20.0MB), run=2976-3204msec WRITE: bw=8949KiB/s (9164kB/s), 1720KiB/s-3237KiB/s (1762kB/s-3315kB/s), io=28.0MiB (29.4MB), run=2976-3204msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188505: Tue Apr 28 20:54:38 2026 read: IOPS=1, BW=7797KiB/s (7984kB/s)(12.0MiB/1576msec) clat (msec): min=399, max=578, avg=478.28, stdev=91.02 lat (msec): min=399, max=578, avg=478.29, stdev=91.02 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=58.48%, ctx=2563, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188506: Tue Apr 28 20:54:38 2026 read: IOPS=0, BW=2412KiB/s (2470kB/s)(4096KiB/1698msec) clat (nsec): min=453449k, max=453449k, avg=453448768.00, stdev= 0.00 lat (nsec): min=453449k, max=453449k, avg=453449498.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 8192, max= 8192, per=84.91%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4824KiB/s (4940kB/s)(8192KiB/1698msec); 0 zone resets clat (msec): min=471, max=634, avg=553.16, stdev=115.34 lat (msec): min=471, max=634, avg=553.40, stdev=115.35 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8192, max= 8192, per=56.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=21.27%, ctx=971, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188507: Tue Apr 28 20:54:38 2026 write: IOPS=1, BW=5469KiB/s (5600kB/s)(12.0MiB/2247msec); 0 zone resets clat (msec): min=192, max=1616, avg=723.58, stdev=778.17 lat (msec): min=192, max=1617, avg=723.89, stdev=778.26 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8192, max= 8192, per=56.18%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.68%, ctx=86, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188508: Tue Apr 28 20:54:38 2026 write: IOPS=2, BW=8593KiB/s (8799kB/s)(12.0MiB/1430msec); 0 zone resets clat (msec): min=114, max=1007, avg=428.59, stdev=501.82 lat (msec): min=114, max=1007, avg=428.81, stdev=501.86 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min=15814, max=15814, per=100.00%, avg=15814.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.07%, sys=22.95%, ctx=97, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9649KiB/s (9881kB/s), 2412KiB/s-7797KiB/s (2470kB/s-7984kB/s), io=16.0MiB (16.8MB), run=1576-1698msec WRITE: bw=14.2MiB/s (14.9MB/s), 4824KiB/s-8593KiB/s (4940kB/s-8799kB/s), io=32.0MiB (33.6MB), run=1430-2247msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188509: Tue Apr 28 20:54:38 2026 read: IOPS=1, BW=7995KiB/s (8187kB/s)(12.0MiB/1537msec) clat (msec): min=297, max=820, avg=505.31, stdev=277.82 lat (msec): min=297, max=820, avg=505.31, stdev=277.82 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.55%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188510: Tue Apr 28 20:54:38 2026 read: IOPS=0, BW=1855KiB/s (1900kB/s)(4096KiB/2208msec) clat (nsec): min=679047k, max=679047k, avg=679047435.00, stdev= 0.00 lat (nsec): min=679050k, max=679050k, avg=679050072.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3710KiB/s (3799kB/s)(8192KiB/2208msec); 0 zone resets clat (msec): min=375, max=1101, avg=738.50, stdev=512.77 lat (msec): min=376, max=1101, avg=738.68, stdev=512.84 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.26%, ctx=102, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188511: Tue Apr 28 20:54:38 2026 write: IOPS=1, BW=6056KiB/s (6202kB/s)(12.0MiB/2029msec); 0 zone resets clat (msec): min=187, max=980, avg=659.03, stdev=417.33 lat (msec): min=187, max=981, avg=659.31, stdev=417.34 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8192, max= 8192, per=55.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.44%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188512: Tue Apr 28 20:54:38 2026 write: IOPS=1, BW=6454KiB/s (6609kB/s)(12.0MiB/1904msec); 0 zone resets clat (msec): min=410, max=873, avg=605.61, stdev=239.91 lat (msec): min=410, max=873, avg=605.89, stdev=239.89 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 5475, max= 8192, per=46.05%, avg=6833.50, stdev=1921.21, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=20.23%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7420KiB/s (7598kB/s), 1855KiB/s-7995KiB/s (1900kB/s-8187kB/s), io=16.0MiB (16.8MB), run=1537-2208msec WRITE: bw=14.5MiB/s (15.2MB/s), 3710KiB/s-6454KiB/s (3799kB/s-6609kB/s), io=32.0MiB (33.6MB), run=1904-2208msec