== sanity test 398b: DIO and buffer IO race ============== 11:04:51 (1780326291) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.78582 s, 18.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148082: Mon Jun 1 11:05:57 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5992KiB/56171msec) clat (usec): min=34, max=592763, avg=19009.38, stdev=19322.68 lat (usec): min=36, max=592764, avg=19011.30, stdev=19321.85 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 105], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[ 11863], 40.00th=[ 13960], 50.00th=[ 16319], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[177210], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 13, max= 176, per=24.89%, avg=106.03, stdev=30.52, samples=111 iops : min= 3, max= 44, avg=26.10, stdev= 7.71, samples=111 write: IOPS=28, BW=112KiB/s (115kB/s)(6296KiB/56171msec); 0 zone resets clat (usec): min=773, max=185914, avg=17449.24, stdev=16802.45 lat (usec): min=773, max=185914, avg=17450.63, stdev=16802.41 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1467], 10.00th=[ 1958], 20.00th=[ 2835], | 30.00th=[ 4883], 40.00th=[ 9765], 50.00th=[ 13435], 60.00th=[ 17957], | 70.00th=[ 23200], 80.00th=[ 28705], 90.00th=[ 37487], 95.00th=[ 45876], | 99.00th=[ 77071], 99.50th=[ 86508], 99.90th=[160433], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 40, max= 183, per=25.12%, avg=112.04, stdev=29.49, samples=110 iops : min= 10, max= 45, avg=27.60, stdev= 7.37, samples=110 lat (usec) : 50=0.49%, 100=1.82%, 250=0.68%, 500=0.10%, 1000=0.36% lat (msec) : 2=5.08%, 4=8.33%, 10=13.96%, 20=32.62%, 50=33.79% lat (msec) : 100=2.57%, 250=0.16%, 750=0.03% cpu : usr=0.14%, sys=15.12%, ctx=7673, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148083: Mon Jun 1 11:05:57 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5940KiB/55769msec) clat (usec): min=30, max=130757, avg=18370.49, stdev=12166.35 lat (usec): min=30, max=130758, avg=18371.45, stdev=12166.37 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 123], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[ 11731], 40.00th=[ 13566], 50.00th=[ 16057], 60.00th=[ 18744], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 31851], 95.00th=[ 38011], | 99.00th=[ 62129], 99.50th=[ 78119], 99.90th=[124257], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 6, max= 184, per=24.95%, avg=106.30, stdev=28.82, samples=110 iops : min= 1, max= 46, avg=26.15, stdev= 7.25, samples=110 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55769msec); 0 zone resets clat (usec): min=792, max=588101, avg=17808.59, stdev=21792.69 lat (usec): min=794, max=588102, avg=17811.17, stdev=21792.60 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1532], 10.00th=[ 1991], 20.00th=[ 3130], | 30.00th=[ 5276], 40.00th=[ 10028], 50.00th=[ 13960], 60.00th=[ 17695], | 70.00th=[ 22676], 80.00th=[ 28705], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 70779], 99.50th=[103285], 99.90th=[152044], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 6, max= 198, per=25.36%, avg=113.11, stdev=31.46, samples=110 iops : min= 1, max= 49, avg=27.86, stdev= 7.92, samples=110 lat (usec) : 50=0.26%, 100=1.89%, 250=0.46%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.42% lat (msec) : 2=4.82%, 4=7.85%, 10=14.65%, 20=34.24%, 50=32.45% lat (msec) : 100=2.47%, 250=0.33%, 750=0.03% cpu : usr=0.12%, sys=15.02%, ctx=7688, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148084: Mon Jun 1 11:05:57 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(6028KiB/55582msec) clat (usec): min=24, max=162208, avg=17637.48, stdev=11922.19 lat (usec): min=24, max=162209, avg=17638.54, stdev=11922.23 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 90], 10.00th=[ 7046], 20.00th=[ 9765], | 30.00th=[ 11600], 40.00th=[ 13173], 50.00th=[ 15401], 60.00th=[ 17957], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 30540], 95.00th=[ 36963], | 99.00th=[ 55313], 99.50th=[ 65799], 99.90th=[131597], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 47, max= 192, per=25.72%, avg=109.56, stdev=31.49, samples=109 iops : min= 11, max= 48, avg=26.97, stdev= 7.90, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6260KiB/55582msec); 0 zone resets clat (usec): min=731, max=640210, avg=18382.41, stdev=22572.13 lat (usec): min=732, max=640211, avg=18386.32, stdev=22571.74 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1500], 10.00th=[ 2057], 20.00th=[ 3163], | 30.00th=[ 5932], 40.00th=[ 10421], 50.00th=[ 14484], 60.00th=[ 18482], | 70.00th=[ 23462], 80.00th=[ 29230], 90.00th=[ 38536], 95.00th=[ 48497], | 99.00th=[ 70779], 99.50th=[ 86508], 99.90th=[133694], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 48, max= 200, per=25.45%, avg=113.52, stdev=31.47, samples=109 iops : min= 12, max= 50, avg=27.96, stdev= 7.89, samples=109 lat (usec) : 50=0.55%, 100=2.51%, 250=0.46%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=4.46%, 4=7.71%, 10=13.44%, 20=34.54%, 50=32.78% lat (msec) : 100=2.83%, 250=0.23%, 750=0.03% cpu : usr=0.12%, sys=14.96%, ctx=7597, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148085: Mon Jun 1 11:05:57 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56250msec) clat (usec): min=22, max=179607, avg=18418.11, stdev=12920.04 lat (usec): min=22, max=179607, avg=18419.16, stdev=12919.96 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 90], 10.00th=[ 7242], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13304], 50.00th=[ 15533], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26608], 90.00th=[ 32375], 95.00th=[ 39584], | 99.00th=[ 63177], 99.50th=[ 72877], 99.90th=[109577], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 32, max= 184, per=25.21%, avg=107.41, stdev=30.81, samples=110 iops : min= 8, max= 46, avg=26.44, stdev= 7.76, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56250msec); 0 zone resets clat (usec): min=810, max=651825, avg=18058.27, stdev=22657.34 lat (usec): min=811, max=651826, avg=18059.47, stdev=22657.35 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1565], 10.00th=[ 1991], 20.00th=[ 2966], | 30.00th=[ 5604], 40.00th=[ 10159], 50.00th=[ 14091], 60.00th=[ 18220], | 70.00th=[ 22938], 80.00th=[ 28705], 90.00th=[ 39060], 95.00th=[ 48497], | 99.00th=[ 67634], 99.50th=[ 89654], 99.90th=[123208], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 32, max= 190, per=24.81%, avg=110.64, stdev=29.13, samples=110 iops : min= 8, max= 47, avg=27.25, stdev= 7.34, samples=110 lat (usec) : 50=0.65%, 100=2.12%, 250=0.49%, 500=0.03%, 1000=0.23% lat (msec) : 2=4.95%, 4=7.49%, 10=14.55%, 20=33.17%, 50=33.11% lat (msec) : 100=3.03%, 250=0.16%, 750=0.03% cpu : usr=0.12%, sys=15.16%, ctx=7639, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=427KiB/s (437kB/s), 107KiB/s-108KiB/s (109kB/s-111kB/s), io=23.4MiB (24.6MB), run=55582-56250msec WRITE: bw=447KiB/s (458kB/s), 111KiB/s-114KiB/s (114kB/s-117kB/s), io=24.6MiB (25.7MB), run=55582-56250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148087: Mon Jun 1 11:06:41 2026 read: IOPS=14, BW=59.6KiB/s (61.0kB/s)(5992KiB/100525msec) clat (msec): min=3, max=604, avg=16.86, stdev=21.82 lat (msec): min=3, max=604, avg=16.86, stdev=21.82 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 89], 99.50th=[ 104], 99.90th=[ 192], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 168, per=25.17%, avg=59.91, stdev=34.00, samples=198 iops : min= 1, max= 42, avg=14.56, stdev= 8.60, samples=198 write: IOPS=15, BW=62.6KiB/s (64.1kB/s)(6296KiB/100525msec); 0 zone resets clat (msec): min=15, max=164, avg=47.72, stdev=23.78 lat (msec): min=15, max=164, avg=47.72, stdev=23.78 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 126], 99.50th=[ 138], 99.90th=[ 161], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 15, max= 136, per=25.03%, avg=62.58, stdev=27.82, samples=199 iops : min= 3, max= 34, avg=15.23, stdev= 7.08, samples=199 lat (msec) : 4=0.65%, 10=19.63%, 20=18.82%, 50=40.98%, 100=17.42% lat (msec) : 250=2.47%, 750=0.03% cpu : usr=0.08%, sys=4.38%, ctx=5691, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148088: Mon Jun 1 11:06:41 2026 read: IOPS=14, BW=59.2KiB/s (60.6kB/s)(5940KiB/100382msec) clat (msec): min=3, max=601, avg=16.36, stdev=20.87 lat (msec): min=3, max=601, avg=16.36, stdev=20.87 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 82], 99.50th=[ 97], 99.90th=[ 136], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 160, per=24.84%, avg=59.11, stdev=33.94, samples=198 iops : min= 1, max= 40, avg=14.35, stdev= 8.62, samples=198 write: IOPS=15, BW=63.2KiB/s (64.8kB/s)(6348KiB/100382msec); 0 zone resets clat (msec): min=15, max=202, avg=47.84, stdev=24.39 lat (msec): min=15, max=202, avg=47.84, stdev=24.39 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 66], 90.00th=[ 80], 95.00th=[ 93], | 99.00th=[ 134], 99.50th=[ 148], 99.90th=[ 180], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 15, max= 128, per=25.22%, avg=63.06, stdev=27.77, samples=198 iops : min= 3, max= 32, avg=15.34, stdev= 7.05, samples=198 lat (msec) : 4=0.26%, 10=19.99%, 20=18.78%, 50=41.28%, 100=17.51% lat (msec) : 250=2.15%, 750=0.03% cpu : usr=0.08%, sys=4.44%, ctx=5535, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148089: Mon Jun 1 11:06:41 2026 read: IOPS=15, BW=60.2KiB/s (61.7kB/s)(6028KiB/100124msec) clat (msec): min=3, max=153, avg=16.43, stdev=14.48 lat (msec): min=3, max=153, avg=16.43, stdev=14.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 73], 99.50th=[ 101], 99.90th=[ 127], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 184, per=25.27%, avg=60.15, stdev=32.93, samples=198 iops : min= 1, max= 46, avg=14.62, stdev= 8.32, samples=198 write: IOPS=15, BW=62.5KiB/s (64.0kB/s)(6260KiB/100124msec); 0 zone resets clat (msec): min=14, max=635, avg=48.05, stdev=28.34 lat (msec): min=14, max=635, avg=48.05, stdev=28.34 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 65], 90.00th=[ 83], 95.00th=[ 94], | 99.00th=[ 128], 99.50th=[ 150], 99.90th=[ 201], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 128, per=24.98%, avg=62.45, stdev=28.03, samples=198 iops : min= 1, max= 32, avg=15.19, stdev= 7.15, samples=198 lat (msec) : 4=0.26%, 10=18.68%, 20=19.66%, 50=41.70%, 100=17.45% lat (msec) : 250=2.21%, 750=0.03% cpu : usr=0.07%, sys=4.49%, ctx=5691, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148090: Mon Jun 1 11:06:41 2026 read: IOPS=15, BW=60.5KiB/s (61.0kB/s)(6052KiB/99997msec) clat (msec): min=3, max=134, avg=16.44, stdev=15.06 lat (msec): min=3, max=134, avg=16.44, stdev=15.06 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 44], | 99.00th=[ 84], 99.50th=[ 105], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 192, per=25.56%, avg=60.83, stdev=34.40, samples=197 iops : min= 1, max= 48, avg=14.78, stdev= 8.69, samples=197 write: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6236KiB/99997msec); 0 zone resets clat (msec): min=15, max=636, avg=48.09, stdev=28.08 lat (msec): min=15, max=636, avg=48.09, stdev=28.08 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 54], 80.00th=[ 65], 90.00th=[ 82], 95.00th=[ 97], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 178], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 15, max= 136, per=24.95%, avg=62.37, stdev=27.41, samples=198 iops : min= 3, max= 34, avg=15.17, stdev= 6.99, samples=198 lat (msec) : 4=0.42%, 10=20.18%, 20=17.84%, 50=42.38%, 100=16.83% lat (msec) : 250=2.31%, 750=0.03% cpu : usr=0.08%, sys=4.47%, ctx=5719, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=239KiB/s (245kB/s), 59.2KiB/s-60.5KiB/s (60.6kB/s-61.0kB/s), io=23.4MiB (24.6MB), run=99997-100525msec WRITE: bw=250KiB/s (256kB/s), 62.4KiB/s-63.2KiB/s (63.9kB/s-64.8kB/s), io=24.6MiB (25.7MB), run=99997-100525msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148120: Mon Jun 1 11:06:59 2026 read: IOPS=29, BW=475KiB/s (486kB/s)(5920KiB/12468msec) clat (usec): min=39, max=82118, avg=17618.35, stdev=12332.14 lat (usec): min=40, max=82118, avg=17619.14, stdev=12332.17 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 82], 10.00th=[ 111], 20.00th=[10290], | 30.00th=[11863], 40.00th=[14222], 50.00th=[15795], 60.00th=[18482], | 70.00th=[21890], 80.00th=[25035], 90.00th=[31589], 95.00th=[38536], | 99.00th=[62129], 99.50th=[78119], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 256, max= 638, per=24.42%, avg=466.83, stdev=100.27, samples=24 iops : min= 16, max= 39, avg=28.75, stdev= 6.26, samples=24 write: IOPS=31, BW=511KiB/s (523kB/s)(6368KiB/12468msec); 0 zone resets clat (usec): min=1327, max=76994, avg=14670.33, stdev=11722.34 lat (usec): min=1329, max=76995, avg=14676.94, stdev=11733.45 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2311], 10.00th=[ 2999], 20.00th=[ 3982], | 30.00th=[ 5538], 40.00th=[ 8291], 50.00th=[11863], 60.00th=[15533], | 70.00th=[19792], 80.00th=[23725], 90.00th=[30540], 95.00th=[36439], | 99.00th=[52167], 99.50th=[62129], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 191, max= 800, per=25.43%, avg=511.71, stdev=132.58, samples=24 iops : min= 11, max= 50, avg=31.58, stdev= 8.39, samples=24 lat (usec) : 50=0.39%, 100=3.52%, 250=2.86% lat (msec) : 2=1.82%, 4=8.72%, 10=14.58%, 20=35.81%, 50=30.86% lat (msec) : 100=1.43% cpu : usr=0.10%, sys=21.06%, ctx=1995, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148122: Mon Jun 1 11:06:59 2026 read: IOPS=28, BW=459KiB/s (470kB/s)(5744KiB/12523msec) clat (usec): min=47, max=73264, avg=17885.01, stdev=11577.63 lat (usec): min=47, max=73264, avg=17885.81, stdev=11577.57 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 90], 10.00th=[ 149], 20.00th=[10290], | 30.00th=[12911], 40.00th=[14353], 50.00th=[16188], 60.00th=[18482], | 70.00th=[20841], 80.00th=[25035], 90.00th=[32113], 95.00th=[37487], | 99.00th=[66847], 99.50th=[71828], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 256, max= 768, per=23.81%, avg=455.29, stdev=119.50, samples=24 iops : min= 16, max= 48, avg=28.04, stdev= 7.47, samples=24 write: IOPS=32, BW=523KiB/s (535kB/s)(6544KiB/12523msec); 0 zone resets clat (usec): min=1369, max=78440, avg=14786.93, stdev=12874.67 lat (usec): min=1371, max=78508, avg=14789.08, stdev=12875.43 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2089], 10.00th=[ 3064], 20.00th=[ 4228], | 30.00th=[ 5473], 40.00th=[ 7701], 50.00th=[10945], 60.00th=[15008], | 70.00th=[18744], 80.00th=[23725], 90.00th=[31851], 95.00th=[41157], | 99.00th=[60556], 99.50th=[68682], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 320, max= 768, per=25.30%, avg=509.13, stdev=112.85, samples=24 iops : min= 20, max= 48, avg=31.42, stdev= 7.15, samples=24 lat (usec) : 50=0.13%, 100=2.73%, 250=1.95%, 500=0.13% lat (msec) : 2=2.21%, 4=7.55%, 10=18.75%, 20=36.59%, 50=28.26% lat (msec) : 100=1.69% cpu : usr=0.08%, sys=20.92%, ctx=2074, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148124: Mon Jun 1 11:06:59 2026 read: IOPS=31, BW=502KiB/s (514kB/s)(6256KiB/12457msec) clat (usec): min=38, max=82942, avg=16794.70, stdev=11111.45 lat (usec): min=39, max=82943, avg=16796.27, stdev=11110.76 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 75], 10.00th=[ 119], 20.00th=[ 9634], | 30.00th=[11600], 40.00th=[13698], 50.00th=[15533], 60.00th=[18220], | 70.00th=[21365], 80.00th=[24249], 90.00th=[28967], 95.00th=[32637], | 99.00th=[62129], 99.50th=[80217], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 352, max= 702, per=26.30%, avg=502.92, stdev=87.81, samples=24 iops : min= 22, max= 43, avg=31.00, stdev= 5.47, samples=24 write: IOPS=30, BW=484KiB/s (496kB/s)(6032KiB/12457msec); 0 zone resets clat (usec): min=1097, max=98148, avg=15400.61, stdev=12974.68 lat (usec): min=1098, max=98148, avg=15402.18, stdev=12974.67 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2212], 10.00th=[ 3032], 20.00th=[ 4228], | 30.00th=[ 6128], 40.00th=[ 7898], 50.00th=[11469], 60.00th=[16581], | 70.00th=[20055], 80.00th=[25297], 90.00th=[32113], 95.00th=[39584], | 99.00th=[56886], 99.50th=[60031], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 192, max= 672, per=23.52%, avg=473.25, stdev=128.05, samples=24 iops : min= 12, max= 42, avg=29.17, stdev= 8.03, samples=24 lat (usec) : 50=0.65%, 100=3.26%, 250=2.08%, 500=0.26% lat (msec) : 2=1.69%, 4=6.90%, 10=18.49%, 20=33.98%, 50=31.12% lat (msec) : 100=1.56% cpu : usr=0.15%, sys=20.55%, ctx=2160, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148126: Mon Jun 1 11:06:59 2026 read: IOPS=30, BW=488KiB/s (500kB/s)(6032KiB/12359msec) clat (usec): min=19, max=66289, avg=16874.79, stdev=11980.71 lat (usec): min=19, max=66290, avg=16876.25, stdev=11980.38 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 76], 10.00th=[ 91], 20.00th=[ 7963], | 30.00th=[11469], 40.00th=[13435], 50.00th=[15664], 60.00th=[18220], | 70.00th=[21627], 80.00th=[25560], 90.00th=[32900], 95.00th=[37487], | 99.00th=[53740], 99.50th=[62653], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 207, max= 640, per=25.23%, avg=482.38, stdev=105.37, samples=24 iops : min= 12, max= 40, avg=29.71, stdev= 6.73, samples=24 write: IOPS=31, BW=506KiB/s (518kB/s)(6256KiB/12359msec); 0 zone resets clat (usec): min=1098, max=77525, avg=14956.49, stdev=13285.90 lat (usec): min=1100, max=77528, avg=14957.94, stdev=13285.98 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2089], 10.00th=[ 2933], 20.00th=[ 3687], | 30.00th=[ 5211], 40.00th=[ 7177], 50.00th=[10683], 60.00th=[14746], | 70.00th=[19530], 80.00th=[24773], 90.00th=[32900], 95.00th=[41157], | 99.00th=[59507], 99.50th=[59507], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 296, max= 864, per=25.15%, avg=505.96, stdev=124.40, samples=24 iops : min= 18, max= 54, avg=31.21, stdev= 7.81, samples=24 lat (usec) : 20=0.13%, 50=0.78%, 100=4.82%, 250=2.47%, 500=0.26% lat (usec) : 750=0.13% lat (msec) : 2=2.34%, 4=9.77%, 10=16.41%, 20=30.99%, 50=29.82% lat (msec) : 100=2.08% cpu : usr=0.15%, sys=20.42%, ctx=2057, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1913KiB/s (1959kB/s), 459KiB/s-502KiB/s (470kB/s-514kB/s), io=23.4MiB (24.5MB), run=12359-12523msec WRITE: bw=2012KiB/s (2061kB/s), 484KiB/s-523KiB/s (496kB/s-535kB/s), io=24.6MiB (25.8MB), run=12359-12523msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148121: Mon Jun 1 11:07:11 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(5920KiB/24079msec) clat (msec): min=4, max=137, avg=16.37, stdev=15.46 lat (msec): min=4, max=137, avg=16.37, stdev=15.46 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 35], 95.00th=[ 49], | 99.00th=[ 72], 99.50th=[ 104], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 480, per=24.59%, avg=242.74, stdev=107.29, samples=47 iops : min= 1, max= 30, avg=14.74, stdev= 6.72, samples=47 write: IOPS=16, BW=264KiB/s (271kB/s)(6368KiB/24079msec); 0 zone resets clat (msec): min=20, max=147, avg=45.01, stdev=20.33 lat (msec): min=20, max=147, avg=45.01, stdev=20.33 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 50], 80.00th=[ 58], 90.00th=[ 74], 95.00th=[ 86], | 99.00th=[ 115], 99.50th=[ 134], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 95, max= 448, per=25.39%, avg=263.85, stdev=102.20, samples=47 iops : min= 5, max= 28, avg=16.06, stdev= 6.43, samples=47 lat (msec) : 10=21.35%, 20=16.54%, 50=45.05%, 100=15.49%, 250=1.56% cpu : usr=0.06%, sys=5.32%, ctx=1477, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148123: Mon Jun 1 11:07:11 2026 read: IOPS=14, BW=237KiB/s (243kB/s)(5744KiB/24253msec) clat (msec): min=3, max=108, avg=15.00, stdev=14.04 lat (msec): min=3, max=108, avg=15.00, stdev=14.03 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 32], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 31, max= 576, per=24.41%, avg=240.94, stdev=133.89, samples=47 iops : min= 1, max= 36, avg=14.66, stdev= 8.40, samples=47 write: IOPS=16, BW=270KiB/s (276kB/s)(6544KiB/24253msec); 0 zone resets clat (msec): min=18, max=174, avg=46.03, stdev=21.65 lat (msec): min=18, max=174, avg=46.03, stdev=21.65 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 42], 60.00th=[ 45], | 70.00th=[ 51], 80.00th=[ 59], 90.00th=[ 71], 95.00th=[ 82], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 96, max= 480, per=25.87%, avg=268.75, stdev=98.94, samples=48 iops : min= 6, max= 30, avg=16.40, stdev= 6.20, samples=48 lat (msec) : 4=0.13%, 10=23.31%, 20=14.97%, 50=43.23%, 100=16.93% lat (msec) : 250=1.43% cpu : usr=0.06%, sys=5.26%, ctx=1508, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148125: Mon Jun 1 11:07:11 2026 read: IOPS=16, BW=265KiB/s (271kB/s)(6256KiB/23647msec) clat (msec): min=3, max=106, avg=16.18, stdev=15.08 lat (msec): min=3, max=106, avg=16.18, stdev=15.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 53], | 99.00th=[ 78], 99.50th=[ 83], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 63, max= 704, per=26.87%, avg=265.26, stdev=150.13, samples=47 iops : min= 3, max= 44, avg=16.17, stdev= 9.48, samples=47 write: IOPS=15, BW=255KiB/s (261kB/s)(6032KiB/23647msec); 0 zone resets clat (msec): min=15, max=155, avg=45.60, stdev=21.43 lat (msec): min=15, max=155, avg=45.60, stdev=21.43 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 58], 90.00th=[ 74], 95.00th=[ 92], | 99.00th=[ 125], 99.50th=[ 146], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 95, max= 416, per=24.55%, avg=255.04, stdev=101.66, samples=47 iops : min= 5, max= 26, avg=15.53, stdev= 6.32, samples=47 lat (msec) : 4=0.13%, 10=23.96%, 20=17.45%, 50=39.84%, 100=16.80% lat (msec) : 250=1.82% cpu : usr=0.05%, sys=5.56%, ctx=1511, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148127: Mon Jun 1 11:07:11 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24187msec) clat (msec): min=4, max=109, avg=15.92, stdev=16.30 lat (msec): min=4, max=109, avg=15.92, stdev=16.30 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 34], 95.00th=[ 49], | 99.00th=[ 97], 99.50th=[ 107], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 31, max= 512, per=25.11%, avg=247.85, stdev=121.86, samples=48 iops : min= 1, max= 32, avg=15.08, stdev= 7.61, samples=48 write: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24187msec); 0 zone resets clat (msec): min=15, max=181, avg=46.20, stdev=22.17 lat (msec): min=15, max=181, avg=46.20, stdev=22.17 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 77], 95.00th=[ 87], | 99.00th=[ 130], 99.50th=[ 148], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 64, max= 448, per=24.87%, avg=258.44, stdev=105.81, samples=48 iops : min= 4, max= 28, avg=15.75, stdev= 6.67, samples=48 lat (msec) : 10=24.87%, 20=14.71%, 50=42.71%, 100=16.28%, 250=1.43% cpu : usr=0.07%, sys=5.28%, ctx=1550, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=988KiB/s (1011kB/s), 237KiB/s-265KiB/s (243kB/s-271kB/s), io=23.4MiB (24.5MB), run=23647-24253msec WRITE: bw=1039KiB/s (1064kB/s), 255KiB/s-270KiB/s (261kB/s-276kB/s), io=24.6MiB (25.8MB), run=23647-24253msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148136: Mon Jun 1 11:07:19 2026 read: IOPS=2, BW=2644KiB/s (2707kB/s)(7168KiB/2711msec) clat (msec): min=100, max=158, avg=125.32, stdev=20.31 lat (msec): min=100, max=158, avg=125.32, stdev=20.31 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 109], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 123], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 140], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 2003, max= 5851, per=69.54%, avg=3983.33, stdev=1926.47, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1889KiB/s (1934kB/s)(5120KiB/2711msec); 0 zone resets clat (msec): min=102, max=1249, avg=362.78, stdev=496.74 lat (msec): min=102, max=1249, avg=362.86, stdev=496.73 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1950, max= 4096, per=33.45%, avg=2683.00, stdev=1223.98, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=91.67%, 2000=8.33% cpu : usr=0.04%, sys=33.36%, ctx=716, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148138: Mon Jun 1 11:07:19 2026 read: IOPS=0, BW=573KiB/s (587kB/s)(2048KiB/3575msec) clat (msec): min=18, max=1872, avg=945.18, stdev=1311.06 lat (msec): min=18, max=1872, avg=945.18, stdev=1311.06 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 19], | 30.00th=[ 19], 40.00th=[ 19], 50.00th=[ 19], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 2031, max= 2048, per=35.61%, avg=2039.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2864KiB/s (2933kB/s)(10.0MiB/3575msec); 0 zone resets clat (msec): min=101, max=241, avg=162.09, stdev=48.01 lat (msec): min=101, max=241, avg=162.19, stdev=48.02 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 115], | 30.00th=[ 129], 40.00th=[ 138], 50.00th=[ 148], 60.00th=[ 157], | 70.00th=[ 161], 80.00th=[ 201], 90.00th=[ 232], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 6011, max= 6144, per=75.85%, avg=6083.33, stdev=67.26, samples=3 iops : min= 5, max= 6, avg= 5.33, stdev= 0.58, samples=3 lat (msec) : 20=8.33%, 250=83.33%, 2000=8.33% cpu : usr=0.03%, sys=29.18%, ctx=647, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148140: Mon Jun 1 11:07:19 2026 read: IOPS=2, BW=2157KiB/s (2208kB/s)(6144KiB/2849msec) clat (usec): min=517, max=768876, avg=181421.99, stdev=2926 rand-rw: (groupid=0, jobs=1): err= 0: pid=148137: Mon Jun 1 11:07:19 2026 read: IOPS=2, BW=2092KiB/s (2142kB/s)(7168KiB/3426msec) clat (msec): min=63, max=525, avg=201.34, stdev=156.05 lat (msec): min=63, max=525, avg=201.34, stdev=156.05 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 84], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 153], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 251], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2035, max= 4063, per=46.16%, avg=2548.50, stdev=1009.69, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1494KiB/s (1530kB/s)(5120KiB/3426msec); 0 zone resets clat (msec): min=135, max=1001, avg=375.68, stdev=354.31 lat (msec): min=135, max=1001, avg=375.76, stdev=354.31 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2031, max= 6095, per=52.56%, avg=4063.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.90%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148139: Mon Jun 1 11:07:19 2026 read: IOPS=0, BW=557KiB/s (570kB/s)(2048KiB/3678msec) clat (msec): min=79, max=1637, avg=858.79, stdev=1101.66 lat (msec): min=79, max=1637, avg=858.79, stdev=1101.66 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 2031, max= 2048, per=36.94%, avg=2039.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2784KiB/s (2851kB/s)(10.0MiB/3678msec); 0 zone resets clat (msec): min=76, max=259, avg=155.99, stdev=63.04 lat (msec): min=76, max=259, avg=156.21, stdev=63.16 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 85], | 30.00th=[ 89], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 171], | 70.00th=[ 180], 80.00th=[ 215], 90.00th=[ 218], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 4063, max= 8192, per=70.37%, avg=5439.33, stdev=2383.88, samples=3 iops : min= 3, max= 8, avg= 4.67, stdev= 2.89, samples=3 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=14.31%, ctx=269, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148141: Mon Jun 1 11:07:19 2026 read: IOPS=1, BW=1739KiB/s (1780kB/s)(6144KiB/3534msec) clat (msec):81.09 lat (usec): min=518, max=768876, avg=181422.96, stdev=292680.81 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 83362], 50.00th=[ 83362], 60.00th=[114820], | 70.00th=[120062], 80.00th=[120062], 90.00th=[767558], 95.00th=[767558], | 99.00th=[767558], 99.50th=[767558], 99.90th=[767558], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 2003, max= 4096, per=44.50%, avg=2548.75, stdev=1031.72, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=2, BW=2157KiB/s (2208kB/s)(6144KiB/2849msec); 0 zone resets clat (msec): min=102, max=631, avg=287.50, stdev=202.49 lat (msec): min=102, max=631, avg=287.60, stdev=202.46 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 347], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2003, max= 4015, per=31.53%, avg=2528.50, stdev=991.23, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=24.44%, ctx=515, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148142: Mon Jun 1 11:07:19 2026 read: IOPS=1, BW=1685KiB/s (1726kB/s)(5120KiB/3038msec) clat (usec): min=335, max=1162.0k, avg=283200.54, stdev=495849.28 lat (usec): min=335, max=1162.0k, avg=283201.57, stdev=495849.28 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], | 20.00th=[ 334], 30.00th=[ 498], 40.00th=[ 498], | 50.00th=[ 93848], 60.00th=[ 93848], 70.00th=[ 158335], | 80.00th=[ 158335], 90.00th=[1166017], 95.00th=[1166017], | 99.00th=[1166017], 99.50th=[1166017], 99.90th=[1166017], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 2048, max= 6144, per=71.51%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2359KiB/s (2416kB/s)(7168KiB/3038msec); 0 zone resets clat (msec): min=61, max=397, avg=225.96, stdev=135.59 lat (msec): min=61, max=397, avg=226.02, stdev=135.61 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 91], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 186], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 372], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1954, max= 6144, per=50.31%, avg=4035.00, stdev=2095.14, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 lat (usec) : 500=16.67% lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=25.95%, ctx=708, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5729KiB/s (5866kB/s), 573KiB/s-2644KiB/s (587kB/s-2707kB/s), io=20.0MiB (20.0MB), run=2711-3575msec WRITE: bw=8020KiB/s (8213kB/s), 1889KiB/s-2864KiB/s (1934kB/s-2933kB/s), io=28.0MiB (29.4MB), run=2711-3575msec min=51, max=189, avg=102.61, stdev=52.57 lat (msec): min=51, max=189, avg=102.61, stdev=52.57 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 121], | 70.00th=[ 125], 80.00th=[ 125], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 4063, max= 4071, per=73.66%, avg=4067.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1739KiB/s (1780kB/s)(6144KiB/3534msec); 0 zone resets clat (msec): min=92, max=1917, avg=463.84, stdev=713.80 lat (msec): min=93, max=1917, avg=463.93, stdev=713.80 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 209], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 2035, max= 4079, per=43.89%, avg=3392.33, stdev=1175.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=58.33%, 2000=8.33% cpu : usr=0.00%, sys=9.62%, ctx=125, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148143: Mon Jun 1 11:07:19 2026 read: IOPS=1, BW=1380KiB/s (1414kB/s)(5120KiB/3709msec) clat (msec): min=22, max=292, avg=95.35, stdev=111.92 lat (msec): min=22, max=292, avg=95.35, stdev=111.92 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], | 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 46], | 70.00th=[ 78], 80.00th=[ 78], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2031, max= 6144, per=74.04%, avg=4087.50, stdev=2908.33, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1933KiB/s (1979kB/s)(7168KiB/3709msec); 0 zone resets clat (msec): min=72, max=1257, avg=454.62, stdev=423.33 lat (msec): min=72, max=1257, avg=454.70, stdev=423.32 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 94], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 384], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 701], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2015, max= 2048, per=26.32%, avg=2034.60, stdev=13.87, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 50=25.00%, 100=25.00%, 250=8.33%, 500=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.06%, ctx=209, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5522KiB/s (5654kB/s), 557KiB/s-2092KiB/s (570kB/s-2142kB/s), io=20.0MiB (20.0MB), run=3426-3709msec WRITE: bw=7730KiB/s (7916kB/s), 1494KiB/s-2784KiB/s (1530kB/s-2851kB/s), io=28.0MiB (29.4MB), run=3426-3709msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148153: Mon Jun 1 11:07:26 2026 read: IOPS=2, BW=8605KiB/s (8812kB/s)(12.0MiB/1428msec) clat (msec): min=387, max=527, avg=451.32, stdev=70.87 lat (msec): min=387, max=527, avg=451.33, stdev=70.87 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 5979, max= 8192, per=71.96%, avg=7085.50, stdev=1564.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=32.31%, ctx=1516, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148154: Mon Jun 1 11:07:26 2026 read: IOPS=0, BW=2462KiB/s (2521kB/s)(4096KiB/1664msec) clat (nsec): min=428517k, max=428517k, avg=428516744.00, stdev= 0.00 lat (nsec): min=428520k, max=428520k, avg=428519784.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5809, max= 5809, per=59.00%, avg=5809.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4923KiB/s (5041kB/s)(8192KiB/1664msec); 0 zone resets clat (msec): min=547, max=633, avg=590.91, stdev=60.86 lat (msec): min=548, max=634, avg=591.25, stdev=60.95 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8192, max= 8192, per=42.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.43%, ctx=443, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148155: Mon Jun 1 11:07:26 2026 write: IOPS=1, BW=7157KiB/s (7328kB/s)(12.0MiB/1717msec); 0 zone resets clat (msec): min=158, max=809, avg=562.45, stdev=352.58 lat (msec): min=158, max=810, avg=562.86, stdev=352.72 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=42.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.23%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148156: Mon Jun 1 11:07:26 2026 write: IOPS=2, BW=8440KiB/s (8642kB/s)(12.0MiB/1456msec); 0 zone resets clat (msec): min=341, max=598, avg=453.02, stdev=131.90 lat (msec): min=342, max=599, avg=453.38, stdev=131.94 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5649, max= 8192, per=36.26%, avg=6920.50, stdev=1798.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=11.48%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9846KiB/s (10.1MB/s), 2462KiB/s-8605KiB/s (2521kB/s-8812kB/s), io=16.0MiB (16.8MB), run=1428-1664msec WRITE: bw=18.6MiB/s (19.5MB/s), 4923KiB/s-8440KiB/s (5041kB/s-8642kB/s), io=32.0MiB (33.6MB), run=1456-1717msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148149: Mon Jun 1 11:07:26 2026 read: IOPS=1, BW=7969KiB/s (8160kB/s)(12.0MiB/1542msec) clat (msec): min=435, max=556, avg=506.25, stdev=63.10 lat (msec): min=435, max=556, avg=506.25, stdev=63.10 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 5696, max= 8159, per=65.20%, avg=6927.50, stdev=1741.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.77%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148150: Mon Jun 1 11:07:26 2026 read: IOPS=0, BW=2747KiB/s (2813kB/s)(4096KiB/1491msec) clat (nsec): min=130346k, max=130346k, avg=130345895.00, stdev= 0.00 lat (nsec): min=130348k, max=130348k, avg=130348450.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 131], 80.00th=[ 131], 90.00th=[ 131], 95.00th=[ 131], | 99.00th=[ 131], 99.50th=[ 131], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 7907, max= 7907, per=74.42%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5494KiB/s (5626kB/s)(8192KiB/1491msec); 0 zone resets clat (msec): min=642, max=676, avg=659.73, stdev=24.02 lat (msec): min=643, max=677, avg=660.03, stdev=24.05 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=47.45%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=11.54%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148151: Mon Jun 1 11:07:26 2026 write: IOPS=1, BW=6461KiB/s (6616kB/s)(12.0MiB/1902msec); 0 zone resets clat (msec): min=73, max=1161, avg=618.23, stdev=543.84 lat (msec): min=74, max=1161, avg=618.64, stdev=543.79 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8159, per=47.36%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.42%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148152: Mon Jun 1 11:07:26 2026 write: IOPS=2, BW=8847KiB/s (9059kB/s)(12.0MiB/1389msec); 0 zone resets clat (msec): min=170, max=894, avg=447.00, stdev=391.50 lat (msec): min=170, max=895, avg=447.29, stdev=391.52 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min=15875, max=15875, per=92.15%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.73%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.4MiB/s (10.9MB/s), 2747KiB/s-7969KiB/s (2813kB/s-8160kB/s), io=16.0MiB (16.8MB), run=1491-1542msec WRITE: bw=16.8MiB/s (17.6MB/s), 5494KiB/s-8847KiB/s (5626kB/s-9059kB/s), io=32.0MiB (33.6MB), run=1389-1902msec