== sanity test 398b: DIO and buffer IO race ============== 00:45:08 (1789188308) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.91753 s, 17.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146442: Sat Sep 12 00:46:14 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5992KiB/56460msec) clat (usec): min=32, max=767392, avg=19102.28, stdev=24151.01 lat (usec): min=33, max=767393, avg=19103.59, stdev=24151.02 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 101], 10.00th=[ 6849], 20.00th=[ 9634], | 30.00th=[ 11600], 40.00th=[ 13435], 50.00th=[ 15401], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26608], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 66847], 99.50th=[ 86508], 99.90th=[204473], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 13, max= 184, per=24.88%, avg=105.50, stdev=29.16, samples=112 iops : min= 3, max= 46, avg=25.93, stdev= 7.34, samples=112 write: IOPS=27, BW=112KiB/s (114kB/s)(6296KiB/56460msec); 0 zone resets clat (usec): min=587, max=151587, avg=17520.98, stdev=16016.35 lat (usec): min=587, max=151588, avg=17522.97, stdev=16016.56 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 1549], 10.00th=[ 2089], 20.00th=[ 3163], | 30.00th=[ 5604], 40.00th=[ 10159], 50.00th=[ 14091], 60.00th=[ 17957], | 70.00th=[ 22152], 80.00th=[ 28705], 90.00th=[ 37487], 95.00th=[ 49021], | 99.00th=[ 69731], 99.50th=[ 77071], 99.90th=[132645], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 32, max= 207, per=25.23%, avg=112.04, stdev=32.27, samples=111 iops : min= 8, max= 51, avg=27.56, stdev= 8.08, samples=111 lat (usec) : 50=0.33%, 100=1.95%, 250=1.56%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.59% lat (msec) : 2=3.94%, 4=7.91%, 10=14.78%, 20=33.46%, 50=31.80% lat (msec) : 100=3.22%, 250=0.26%, 1000=0.03% cpu : usr=0.13%, sys=16.83%, ctx=7567, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146443: Sat Sep 12 00:46:14 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5940KiB/56539msec) clat (usec): min=39, max=143238, avg=18623.09, stdev=12449.44 lat (usec): min=39, max=143239, avg=18624.15, stdev=12449.50 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 126], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[ 11731], 40.00th=[ 13960], 50.00th=[ 16188], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 63177], 99.50th=[ 81265], 99.90th=[108528], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 6, max= 192, per=24.65%, avg=104.54, stdev=30.84, samples=112 iops : min= 1, max= 48, avg=25.68, stdev= 7.76, samples=112 write: IOPS=28, BW=112KiB/s (115kB/s)(6348KiB/56539msec); 0 zone resets clat (usec): min=717, max=725796, avg=18028.17, stdev=23973.89 lat (usec): min=719, max=725797, avg=18029.39, stdev=23973.92 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1369], 10.00th=[ 2008], 20.00th=[ 3163], | 30.00th=[ 5342], 40.00th=[ 9765], 50.00th=[ 13435], 60.00th=[ 17957], | 70.00th=[ 23725], 80.00th=[ 29230], 90.00th=[ 39060], 95.00th=[ 47973], | 99.00th=[ 72877], 99.50th=[ 92799], 99.90th=[110625], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 6, max= 191, per=25.10%, avg=111.43, stdev=33.52, samples=112 iops : min= 1, max= 47, avg=27.41, stdev= 8.39, samples=112 lat (usec) : 50=0.23%, 100=1.56%, 250=1.37%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.59% lat (msec) : 2=4.36%, 4=7.98%, 10=14.68%, 20=32.85%, 50=33.43% lat (msec) : 100=2.54%, 250=0.20%, 750=0.03% cpu : usr=0.13%, sys=17.08%, ctx=7648, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146444: Sat Sep 12 00:46:14 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(6028KiB/56290msec) clat (usec): min=21, max=125152, avg=18050.86, stdev=12128.11 lat (usec): min=21, max=125153, avg=18052.57, stdev=12127.96 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 99], 10.00th=[ 6980], 20.00th=[ 9241], | 30.00th=[ 11469], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 32113], 95.00th=[ 38011], | 99.00th=[ 61080], 99.50th=[ 66323], 99.90th=[124257], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 40, max= 167, per=25.68%, avg=108.87, stdev=31.33, samples=109 iops : min= 10, max= 41, avg=26.76, stdev= 7.79, samples=109 write: IOPS=27, BW=111KiB/s (114kB/s)(6260KiB/56290msec); 0 zone resets clat (usec): min=580, max=810129, avg=18419.10, stdev=26366.81 lat (usec): min=581, max=810131, avg=18420.52, stdev=26366.85 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1434], 10.00th=[ 2008], 20.00th=[ 3163], | 30.00th=[ 5604], 40.00th=[ 10028], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 22938], 80.00th=[ 29230], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 74974], 99.50th=[ 92799], 99.90th=[170918], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 16, max= 184, per=25.15%, avg=111.66, stdev=32.25, samples=110 iops : min= 4, max= 46, avg=27.46, stdev= 8.08, samples=110 lat (usec) : 50=0.33%, 100=2.18%, 250=1.30%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.72% lat (msec) : 2=4.39%, 4=7.45%, 10=15.23%, 20=32.29%, 50=32.62% lat (msec) : 100=3.16%, 250=0.23%, 1000=0.03% cpu : usr=0.14%, sys=17.04%, ctx=7554, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146445: Sat Sep 12 00:46:14 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56193msec) clat (usec): min=35, max=119939, avg=18393.17, stdev=12695.42 lat (usec): min=36, max=119940, avg=18394.65, stdev=12695.33 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 108], 10.00th=[ 6980], 20.00th=[ 9503], | 30.00th=[ 11469], 40.00th=[ 13435], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 22152], 80.00th=[ 26608], 90.00th=[ 32900], 95.00th=[ 39060], | 99.00th=[ 62653], 99.50th=[ 84411], 99.90th=[107480], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 40, max= 207, per=25.53%, avg=108.23, stdev=27.88, samples=110 iops : min= 10, max= 51, avg=26.61, stdev= 6.93, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56193msec); 0 zone resets clat (usec): min=694, max=745819, avg=18002.15, stdev=24560.53 lat (usec): min=694, max=745821, avg=18003.53, stdev=24560.55 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1483], 10.00th=[ 2114], 20.00th=[ 3195], | 30.00th=[ 5473], 40.00th=[ 9634], 50.00th=[ 13960], 60.00th=[ 18220], | 70.00th=[ 22938], 80.00th=[ 28967], 90.00th=[ 38011], 95.00th=[ 47449], | 99.00th=[ 68682], 99.50th=[ 81265], 99.90th=[173016], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 13, max= 207, per=24.93%, avg=110.70, stdev=33.57, samples=111 iops : min= 3, max= 51, avg=27.23, stdev= 8.39, samples=111 lat (usec) : 50=0.46%, 100=1.66%, 250=1.50%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.62% lat (msec) : 2=3.94%, 4=7.94%, 10=15.23%, 20=31.84%, 50=33.50% lat (msec) : 100=2.90%, 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=17.05%, ctx=7593, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=425KiB/s (435kB/s), 105KiB/s-108KiB/s (108kB/s-110kB/s), io=23.4MiB (24.6MB), run=56193-56539msec WRITE: bw=445KiB/s (455kB/s), 111KiB/s-112KiB/s (114kB/s-115kB/s), io=24.6MiB (25.7MB), run=56193-56539msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146438: Sat Sep 12 00:47:11 2026 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(5992KiB/113190msec) clat (msec): min=3, max=772, avg=17.20, stdev=24.08 lat (msec): min=3, max=772, avg=17.20, stdev=24.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 72], 99.50th=[ 92], 99.90th=[ 182], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 143, per=25.39%, avg=53.31, stdev=28.66, samples=222 iops : min= 1, max= 35, avg=12.86, stdev= 7.17, samples=222 write: IOPS=13, BW=55.6KiB/s (56.0kB/s)(6296KiB/113190msec); 0 zone resets clat (msec): min=20, max=222, avg=55.35, stdev=21.39 lat (msec): min=20, max=222, avg=55.35, stdev=21.39 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 57], | 70.00th=[ 63], 80.00th=[ 70], 90.00th=[ 83], 95.00th=[ 94], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 194], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 15, max= 88, per=25.33%, avg=55.72, stdev=17.05, samples=223 iops : min= 3, max= 22, avg=13.46, stdev= 4.29, samples=223 lat (msec) : 4=0.10%, 10=18.23%, 20=18.03%, 50=35.38%, 100=26.11% lat (msec) : 250=2.12%, 1000=0.03% cpu : usr=0.07%, sys=3.70%, ctx=5467, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146439: Sat Sep 12 00:47:11 2026 read: IOPS=13, BW=52.0KiB/s (53.2kB/s)(5940KiB/114227msec) clat (msec): min=4, max=745, avg=17.21, stdev=23.69 lat (msec): min=4, max=745, avg=17.21, stdev=23.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 43], | 99.00th=[ 78], 99.50th=[ 95], 99.90th=[ 182], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 135, per=24.79%, avg=52.06, stdev=27.73, samples=225 iops : min= 1, max= 33, avg=12.55, stdev= 6.95, samples=225 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6348KiB/114227msec); 0 zone resets clat (msec): min=13, max=186, avg=55.68, stdev=22.65 lat (msec): min=14, max=186, avg=55.68, stdev=22.65 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 57], | 70.00th=[ 63], 80.00th=[ 70], 90.00th=[ 85], 95.00th=[ 101], | 99.00th=[ 136], 99.50th=[ 155], 99.90th=[ 171], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 8, max= 104, per=25.11%, avg=55.25, stdev=17.97, samples=226 iops : min= 2, max= 26, avg=13.35, stdev= 4.54, samples=226 lat (msec) : 10=17.94%, 20=19.01%, 50=34.73%, 100=25.52%, 250=2.77% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=3.59%, ctx=5503, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146440: Sat Sep 12 00:47:11 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6028KiB/113437msec) clat (msec): min=3, max=137, avg=17.08, stdev=13.17 lat (msec): min=3, max=137, avg=17.09, stdev=13.17 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 77], 99.90th=[ 122], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 7, max= 152, per=25.57%, avg=53.71, stdev=25.65, samples=221 iops : min= 1, max= 38, avg=12.96, stdev= 6.45, samples=221 write: IOPS=13, BW=55.2KiB/s (56.5kB/s)(6260KiB/113437msec); 0 zone resets clat (msec): min=18, max=799, avg=55.84, stdev=28.92 lat (msec): min=18, max=799, avg=55.84, stdev=28.92 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 56], | 70.00th=[ 62], 80.00th=[ 70], 90.00th=[ 82], 95.00th=[ 94], | 99.00th=[ 131], 99.50th=[ 167], 99.90th=[ 239], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 104, per=24.98%, avg=54.96, stdev=17.78, samples=224 iops : min= 1, max= 26, avg=13.28, stdev= 4.47, samples=224 lat (msec) : 4=0.07%, 10=17.02%, 20=19.47%, 50=34.44%, 100=27.12% lat (msec) : 250=1.86%, 1000=0.03% cpu : usr=0.09%, sys=3.76%, ctx=5511, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146441: Sat Sep 12 00:47:11 2026 read: IOPS=13, BW=53.2KiB/s (54.4kB/s)(6052KiB/113830msec) clat (msec): min=3, max=158, avg=17.25, stdev=14.42 lat (msec): min=3, max=158, avg=17.25, stdev=14.42 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 72], 99.50th=[ 84], 99.90th=[ 153], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7, max= 174, per=25.50%, avg=53.56, stdev=26.57, samples=223 iops : min= 1, max= 43, avg=12.92, stdev= 6.64, samples=223 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6236KiB/113830msec); 0 zone resets clat (msec): min=18, max=774, avg=56.07, stdev=28.84 lat (msec): min=18, max=774, avg=56.08, stdev=28.84 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 57], | 70.00th=[ 63], 80.00th=[ 71], 90.00th=[ 84], 95.00th=[ 94], | 99.00th=[ 132], 99.50th=[ 159], 99.90th=[ 236], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 15, max= 103, per=24.82%, avg=54.61, stdev=18.00, samples=225 iops : min= 3, max= 25, avg=13.19, stdev= 4.54, samples=225 lat (msec) : 4=0.10%, 10=17.12%, 20=19.69%, 50=34.05%, 100=27.02% lat (msec) : 250=1.99%, 1000=0.03% cpu : usr=0.09%, sys=3.74%, ctx=5596, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.0KiB/s-53.2KiB/s (53.2kB/s-54.4kB/s), io=23.4MiB (24.6MB), run=113190-114227msec WRITE: bw=220KiB/s (225kB/s), 54.8KiB/s-55.6KiB/s (56.1kB/s-56.0kB/s), io=24.6MiB (25.7MB), run=113190-114227msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146482: Sat Sep 12 00:47:31 2026 read: IOPS=27, BW=434KiB/s (445kB/s)(5920KiB/13626msec) clat (usec): min=26, max=106579, avg=18273.64, stdev=13858.64 lat (usec): min=26, max=106580, avg=18277.47, stdev=13856.08 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 68], 10.00th=[ 99], 20.00th=[ 8848], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 17171], 60.00th=[ 19530], | 70.00th=[ 22152], 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 38011], | 99.00th=[ 74974], 99.50th=[ 91751], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 256, max= 669, per=25.89%, avg=425.85, stdev=92.86, samples=26 iops : min= 16, max= 41, avg=26.08, stdev= 5.73, samples=26 write: IOPS=29, BW=467KiB/s (479kB/s)(6368KiB/13626msec); 0 zone resets clat (usec): min=1002, max=115572, avg=17087.33, stdev=16223.00 lat (usec): min=1003, max=115573, avg=17090.23, stdev=16222.17 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2057], 10.00th=[ 2540], 20.00th=[ 3818], | 30.00th=[ 5538], 40.00th=[ 9110], 50.00th=[ 12125], 60.00th=[ 16450], | 70.00th=[ 20317], 80.00th=[ 28967], 90.00th=[ 39060], 95.00th=[ 47449], | 99.00th=[ 85459], 99.50th=[ 98042], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 220, max= 704, per=26.55%, avg=459.50, stdev=116.12, samples=26 iops : min= 13, max= 44, avg=28.19, stdev= 7.45, samples=26 lat (usec) : 50=0.91%, 100=3.91%, 250=2.60%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=8.85%, 10=13.93%, 20=32.81%, 50=31.64% lat (msec) : 100=2.47%, 250=0.26% cpu : usr=0.12%, sys=17.28%, ctx=1799, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146483: Sat Sep 12 00:47:31 2026 read: IOPS=25, BW=403KiB/s (412kB/s)(5744KiB/14269msec) clat (usec): min=41, max=97869, avg=19812.11, stdev=13627.83 lat (usec): min=42, max=97870, avg=19813.02, stdev=13627.84 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 105], 20.00th=[10421], | 30.00th=[14222], 40.00th=[16319], 50.00th=[19006], 60.00th=[21627], | 70.00th=[25560], 80.00th=[29230], 90.00th=[35914], 95.00th=[41681], | 99.00th=[73925], 99.50th=[83362], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 224, max= 638, per=24.31%, avg=399.86, stdev=101.10, samples=28 iops : min= 14, max= 39, avg=24.46, stdev= 6.27, samples=28 write: IOPS=28, BW=459KiB/s (470kB/s)(6544KiB/14269msec); 0 zone resets clat (usec): min=1204, max=117544, avg=17174.46, stdev=16021.77 lat (usec): min=1206, max=117545, avg=17176.48, stdev=16021.70 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2057], 10.00th=[ 2704], 20.00th=[ 4047], | 30.00th=[ 5473], 40.00th=[ 8848], 50.00th=[ 12780], 60.00th=[ 16909], | 70.00th=[ 22152], 80.00th=[ 28443], 90.00th=[ 38011], 95.00th=[ 46924], | 99.00th=[ 62653], 99.50th=[ 85459], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 288, max= 736, per=26.32%, avg=455.57, stdev=99.62, samples=28 iops : min= 18, max= 46, avg=27.93, stdev= 6.26, samples=28 lat (usec) : 50=0.26%, 100=3.91%, 250=2.60%, 750=0.26% lat (msec) : 2=1.95%, 4=8.59%, 10=14.06%, 20=29.17%, 50=36.46% lat (msec) : 100=2.47%, 250=0.26% cpu : usr=0.16%, sys=17.02%, ctx=1847, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146484: Sat Sep 12 00:47:31 2026 read: IOPS=26, BW=430KiB/s (440kB/s)(6256KiB/14552msec) clat (usec): min=33, max=112080, avg=20189.22, stdev=16175.22 lat (usec): min=34, max=112081, avg=20190.17, stdev=16175.24 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 77], 10.00th=[ 114], 20.00th=[ 9241], | 30.00th=[ 12649], 40.00th=[ 15401], 50.00th=[ 18220], 60.00th=[ 21365], | 70.00th=[ 23725], 80.00th=[ 29230], 90.00th=[ 36439], 95.00th=[ 49546], | 99.00th=[ 87557], 99.50th=[ 99091], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 193, max= 800, per=26.00%, avg=427.71, stdev=137.63, samples=28 iops : min= 12, max= 50, avg=26.21, stdev= 8.64, samples=28 write: IOPS=25, BW=415KiB/s (424kB/s)(6032KiB/14552msec); 0 zone resets clat (usec): min=1189, max=115081, avg=17260.76, stdev=16596.34 lat (usec): min=1191, max=115082, avg=17263.09, stdev=16596.24 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1958], 10.00th=[ 2606], 20.00th=[ 3818], | 30.00th=[ 5211], 40.00th=[ 8356], 50.00th=[ 13042], 60.00th=[ 16712], | 70.00th=[ 21365], 80.00th=[ 27919], 90.00th=[ 39584], 95.00th=[ 49021], | 99.00th=[ 77071], 99.50th=[102237], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 192, max= 608, per=23.11%, avg=400.07, stdev=119.34, samples=28 iops : min= 12, max= 38, avg=24.46, stdev= 7.55, samples=28 lat (usec) : 50=0.52%, 100=3.39%, 250=3.65%, 500=0.39%, 750=0.26% lat (msec) : 2=2.60%, 4=8.07%, 10=15.23%, 20=26.95%, 50=34.51% lat (msec) : 100=4.04%, 250=0.39% cpu : usr=0.10%, sys=16.13%, ctx=1841, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146485: Sat Sep 12 00:47:31 2026 read: IOPS=26, BW=416KiB/s (426kB/s)(6032KiB/14488msec) clat (usec): min=38, max=84288, avg=19117.91, stdev=13738.03 lat (usec): min=38, max=84290, avg=19118.82, stdev=13738.03 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 93], 20.00th=[ 8848], | 30.00th=[12780], 40.00th=[15139], 50.00th=[17695], 60.00th=[21365], | 70.00th=[25560], 80.00th=[28967], 90.00th=[35390], 95.00th=[42206], | 99.00th=[62129], 99.50th=[74974], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 110, max= 608, per=24.79%, avg=407.86, stdev=123.29, samples=28 iops : min= 6, max= 38, avg=24.93, stdev= 7.84, samples=28 write: IOPS=26, BW=432KiB/s (442kB/s)(6256KiB/14488msec); 0 zone resets clat (usec): min=1098, max=180858, avg=18306.71, stdev=19058.16 lat (usec): min=1100, max=180860, avg=18308.90, stdev=19058.42 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1909], 10.00th=[ 2376], 20.00th=[ 3589], | 30.00th=[ 5145], 40.00th=[ 8291], 50.00th=[ 13042], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 30278], 90.00th=[ 39584], 95.00th=[ 49021], | 99.00th=[ 82314], 99.50th=[128451], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 159, max= 657, per=24.58%, avg=425.46, stdev=118.80, samples=28 iops : min= 9, max= 41, avg=26.07, stdev= 7.48, samples=28 lat (usec) : 50=0.91%, 100=4.69%, 250=2.21%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.39%, 4=9.38%, 10=11.59%, 20=28.13%, 50=35.55% lat (msec) : 100=3.52%, 250=0.26% cpu : usr=0.13%, sys=16.26%, ctx=1798, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1646KiB/s (1685kB/s), 403KiB/s-434KiB/s (412kB/s-445kB/s), io=23.4MiB (24.5MB), run=13626-14552msec WRITE: bw=1732KiB/s (1773kB/s), 415KiB/s-467KiB/s (424kB/s-479kB/s), io=24.6MiB (25.8MB), run=13626-14552msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146478: Sat Sep 12 00:47:45 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28819msec) clat (msec): min=3, max=168, avg=19.99, stdev=20.46 lat (msec): min=3, max=168, avg=19.99, stdev=20.46 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 47], 95.00th=[ 61], | 99.00th=[ 104], 99.50th=[ 155], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 31, max= 448, per=24.47%, avg=203.37, stdev=107.82, samples=57 iops : min= 1, max= 28, avg=12.14, stdev= 6.78, samples=57 write: IOPS=13, BW=221KiB/s (226kB/s)(6368KiB/28819msec); 0 zone resets clat (msec): min=21, max=181, avg=53.72, stdev=24.50 lat (msec): min=21, max=181, avg=53.73, stdev=24.49 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 52], | 70.00th=[ 58], 80.00th=[ 71], 90.00th=[ 90], 95.00th=[ 104], | 99.00th=[ 134], 99.50th=[ 159], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 63, max= 416, per=25.15%, avg=219.79, stdev=95.25, samples=57 iops : min= 3, max= 26, avg=13.16, stdev= 6.10, samples=57 lat (msec) : 4=0.13%, 10=15.36%, 20=19.27%, 50=38.28%, 100=23.31% lat (msec) : 250=3.65% cpu : usr=0.06%, sys=3.89%, ctx=1458, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146479: Sat Sep 12 00:47:45 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28694msec) clat (msec): min=4, max=135, avg=17.18, stdev=17.52 lat (msec): min=4, max=135, avg=17.18, stdev=17.52 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 35], 95.00th=[ 55], | 99.00th=[ 99], 99.50th=[ 113], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 544, per=24.50%, avg=203.62, stdev=123.26, samples=55 iops : min= 1, max= 34, avg=12.15, stdev= 7.83, samples=55 write: IOPS=14, BW=228KiB/s (234kB/s)(6544KiB/28694msec); 0 zone resets clat (msec): min=20, max=182, avg=54.71, stdev=25.16 lat (msec): min=20, max=182, avg=54.71, stdev=25.16 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 62], 80.00th=[ 71], 90.00th=[ 91], 95.00th=[ 110], | 99.00th=[ 133], 99.50th=[ 140], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 95, max= 480, per=25.79%, avg=225.41, stdev=92.71, samples=56 iops : min= 5, max= 30, avg=13.50, stdev= 5.88, samples=56 lat (msec) : 10=20.05%, 20=17.19%, 50=36.59%, 100=22.14%, 250=4.04% cpu : usr=0.06%, sys=3.74%, ctx=1393, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146480: Sat Sep 12 00:47:45 2026 read: IOPS=13, BW=222KiB/s (228kB/s)(6256KiB/28125msec) clat (msec): min=3, max=118, avg=18.17, stdev=17.01 lat (msec): min=3, max=118, avg=18.17, stdev=17.01 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 63], | 99.00th=[ 89], 99.50th=[ 92], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 32, max= 608, per=26.99%, avg=224.29, stdev=136.72, samples=55 iops : min= 2, max= 38, avg=13.42, stdev= 8.62, samples=55 write: IOPS=13, BW=214KiB/s (220kB/s)(6032KiB/28125msec); 0 zone resets clat (msec): min=19, max=173, avg=55.50, stdev=24.88 lat (msec): min=19, max=173, avg=55.51, stdev=24.89 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 45], 50.00th=[ 49], 60.00th=[ 54], | 70.00th=[ 59], 80.00th=[ 72], 90.00th=[ 90], 95.00th=[ 109], | 99.00th=[ 144], 99.50th=[ 171], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 352, per=24.28%, avg=212.18, stdev=85.54, samples=55 iops : min= 3, max= 22, avg=12.65, stdev= 5.44, samples=55 lat (msec) : 4=0.13%, 10=20.44%, 20=17.19%, 50=35.94%, 100=22.79% lat (msec) : 250=3.52% cpu : usr=0.11%, sys=3.71%, ctx=1455, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146481: Sat Sep 12 00:47:45 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28288msec) clat (msec): min=4, max=161, avg=17.72, stdev=19.56 lat (msec): min=4, max=161, avg=17.72, stdev=19.56 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 54], | 99.00th=[ 123], 99.50th=[ 157], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 510, per=25.49%, avg=211.80, stdev=112.59, samples=56 iops : min= 1, max= 31, avg=12.64, stdev= 7.12, samples=56 write: IOPS=13, BW=221KiB/s (226kB/s)(6256KiB/28288msec); 0 zone resets clat (msec): min=22, max=165, avg=55.05, stdev=24.66 lat (msec): min=22, max=165, avg=55.05, stdev=24.66 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 62], 80.00th=[ 72], 90.00th=[ 87], 95.00th=[ 108], | 99.00th=[ 146], 99.50th=[ 161], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 95, max= 416, per=25.27%, avg=220.86, stdev=88.42, samples=56 iops : min= 5, max= 26, avg=13.21, stdev= 5.66, samples=56 lat (msec) : 10=20.44%, 20=17.97%, 50=36.20%, 100=21.35%, 250=4.04% cpu : usr=0.09%, sys=3.86%, ctx=1453, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=831KiB/s (851kB/s), 200KiB/s-222KiB/s (205kB/s-228kB/s), io=23.4MiB (24.5MB), run=28125-28819msec WRITE: bw=874KiB/s (895kB/s), 214KiB/s-228KiB/s (220kB/s-234kB/s), io=24.6MiB (25.8MB), run=28125-28819msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146499: Sat Sep 12 00:47:55 2026 read: IOPS=1, BW=1916KiB/s (1962kB/s)(7168KiB/3741msec) clat (usec): min=556, max=1157.5k, avg=356590.62, stdev=411892.17 lat (usec): min=557, max=1157.5k, avg=356593.48, stdev=411891.27 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 105382], 30.00th=[ 107480], 40.00th=[ 107480], | 50.00th=[ 175113], 60.00th=[ 299893], 70.00th=[ 299893], | 80.00th=[ 650118], 90.00th=[1149240], 95.00th=[1149240], | 99.00th=[1149240], 99.50th=[1149240], 99.90th=[1149240], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 1802, max= 4096, per=62.46%, avg=3009.25, stdev=1258.72, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1369KiB/s (1401kB/s)(5120KiB/3741msec); 0 zone resets clat (msec): min=132, max=549, avg=244.08, stdev=172.37 lat (msec): min=132, max=549, avg=244.17, stdev=172.35 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2048, max= 6131, per=60.62%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=32.01%, ctx=1116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146500: Sat Sep 12 00:47:55 2026 read: IOPS=0, BW=482KiB/s (493kB/s)(2048KiB/4250msec) clat (usec): min=894, max=63791, avg=32342.63, stdev=44475.08 lat (usec): min=895, max=63794, avg=32344.74, stdev=44476.58 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[ 898], 50.00th=[ 898], 60.00th=[63701], | 70.00th=[63701], 80.00th=[63701], 90.00th=[63701], 95.00th=[63701], | 99.00th=[63701], 99.50th=[63701], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 1802, max= 2011, per=39.57%, avg=1906.50, stdev=147.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2409KiB/s (2467kB/s)(10.0MiB/4250msec); 0 zone resets clat (msec): min=84, max=1459, avg=406.60, stdev=411.89 lat (msec): min=84, max=1459, avg=406.67, stdev=411.87 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 120], | 30.00th=[ 150], 40.00th=[ 163], 50.00th=[ 271], 60.00th=[ 321], | 70.00th=[ 338], 80.00th=[ 493], 90.00th=[ 667], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2048, max= 6131, per=60.40%, avg=4074.50, stdev=1667.23, samples=4 iops : min= 2, max= 5, avg= 3.50, stdev= 1.29, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=31.28%, ctx=365, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146501: Sat Sep 12 00:47:55 2026 read: IOPS=1, BW=1635KiB/s (1675kB/s)(6144KiB/3757msec) clat (usec): min=612, max=238502, avg=103849.98, stdev=117276.27 lat (usec): min=614, max=238502, avg=103851.66, stdev=117275.81 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 3359], 50.00th=[ 3359], 60.00th=[143655], | 70.00th=[235930], 80.00th=[235930], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 2011, max= 4096, per=70.53%, avg=3398.00, stdev=1201.19, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1635KiB/s (1675kB/s)(6144KiB/3757msec); 0 zone resets clat (msec): min=114, max=1849, avg=503.15, stdev=669.43 lat (msec): min=114, max=1849, avg=503.23, stdev=669.43 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 224], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 2011, max= 3624, per=36.04%, avg=2431.50, stdev=795.17, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=58.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=22.52%, ctx=381, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146502: Sat Sep 12 00:47:55 2026 read: IOPS=1, BW=1294KiB/s (1325kB/s)(5120KiB/3958msec) clat (usec): min=457, max=233576, avg=154875.32, stdev=97912.43 lat (usec): min=458, max=233578, avg=154876.90, stdev=97912.41 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[120062], 40.00th=[120062], 50.00th=[187696], 60.00th=[187696], | 70.00th=[231736], 80.00th=[231736], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 2011, max= 6131, per=84.50%, avg=4071.00, stdev=2913.28, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1811KiB/s (1854kB/s)(7168KiB/3958msec); 0 zone resets clat (msec): min=108, max=1658, avg=437.91, stdev=550.10 lat (msec): min=108, max=1658, avg=437.99, stdev=550.11 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 144], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 232], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 439], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1812, max= 2048, per=29.35%, avg=1979.75, stdev=113.19, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=37.20%, ctx=492, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4819KiB/s (4934kB/s), 482KiB/s-1916KiB/s (493kB/s-1962kB/s), io=20.0MiB (20.0MB), run=3741-4250msec WRITE: bw=6746KiB/s (6908kB/s), 1369KiB/s-2409KiB/s (1401kB/s-2467kB/s), io=28.0MiB (29.4MB), run=3741-4250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146494: Sat Sep 12 00:47:55 2026 read: IOPS=2, BW=2150KiB/s (2202kB/s)(7168KiB/3334msec) clat (msec): min=54, max=905, avg=216.57, stdev=306.69 lat (msec): min=54, max=905, avg=216.58, stdev=306.69 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 68], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 122], 60.00th=[ 125], | 70.00th=[ 125], 80.00th=[ 176], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2043, max= 5647, per=64.49%, avg=2946.50, stdev=1800.33, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1536KiB/s (1573kB/s)(5120KiB/3334msec); 0 zone resets clat (msec): min=196, max=643, avg=359.64, stdev=178.73 lat (msec): min=196, max=643, avg=359.74, stdev=178.75 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2027, max= 4087, per=42.53%, avg=2720.67, stdev=1183.33, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.23%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146495: Sat Sep 12 00:47:55 2026 read: IOPS=0, BW=457KiB/s (468kB/s)(2048KiB/4482msec) clat (msec): min=62, max=299, avg=180.91, stdev=167.42 lat (msec): min=62, max=299, avg=180.92, stdev=167.42 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1878, max= 2039, per=42.86%, avg=1958.50, stdev=113.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2285KiB/s (2340kB/s)(10.0MiB/4482msec); 0 zone resets clat (msec): min=52, max=1475, avg=408.10, stdev=469.84 lat (msec): min=52, max=1475, avg=408.18, stdev=469.84 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 126], 50.00th=[ 136], 60.00th=[ 224], | 70.00th=[ 300], 80.00th=[ 793], 90.00th=[ 810], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1976, max= 6144, per=47.61%, avg=3045.50, stdev=2065.85, samples=4 iops : min= 1, max= 6, avg= 2.25, stdev= 2.50, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.04%, sys=10.85%, ctx=132, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146496: Sat Sep 12 00:47:55 2026 read: IOPS=1, BW=1389KiB/s (1423kB/s)(6144KiB/4422msec) clat (msec): min=83, max=670, avg=285.32, stdev=227.35 lat (msec): min=83, max=670, avg=285.33, stdev=227.35 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 245], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1976, max= 2043, per=44.19%, avg=2019.25, stdev=30.69, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1389KiB/s (1423kB/s)(6144KiB/4422msec); 0 zone resets clat (msec): min=77, max=1585, avg=449.47, stdev=578.26 lat (msec): min=77, max=1585, avg=449.55, stdev=578.26 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 338], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 2019, max= 3644, per=38.10%, avg=2437.50, stdev=804.42, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.93%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146497: Sat Sep 12 00:47:55 2026 read: IOPS=1, BW=1421KiB/s (1455kB/s)(5120KiB/3603msec) clat (msec): min=134, max=212, avg=170.82, stdev=36.70 lat (msec): min=134, max=212, avg=170.82, stdev=36.70 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 3953, max= 4087, per=87.98%, avg=4020.00, stdev=94.75, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1989KiB/s (2037kB/s)(7168KiB/3603msec); 0 zone resets clat (msec): min=104, max=1517, avg=390.44, stdev=504.62 lat (msec): min=104, max=1517, avg=390.52, stdev=504.61 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 111], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 279], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 296], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1861, max= 6119, per=54.92%, avg=3513.00, stdev=2018.46, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 2.06, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=14.08%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4569KiB/s (4679kB/s), 457KiB/s-2150KiB/s (468kB/s-2202kB/s), io=20.0MiB (20.0MB), run=3334-4482msec WRITE: bw=6397KiB/s (6551kB/s), 1389KiB/s-2285KiB/s (1423kB/s-2340kB/s), io=28.0MiB (29.4MB), run=3334-4482msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146512: Sat Sep 12 00:48:04 2026 read: IOPS=1, BW=5980KiB/s (6123kB/s)(12.0MiB/2055msec) clat (msec): min=536, max=752, avg=667.27, stdev=115.39 lat (msec): min=536, max=752, avg=667.27, stdev=115.39 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7670, max= 8192, per=100.00%, avg=7931.00, stdev=369.11, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.05%, sys=48.10%, ctx=2497, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146513: Sat Sep 12 00:48:04 2026 read: IOPS=0, BW=1668KiB/s (1708kB/s)(4096KiB/2456msec) clat (nsec): min=691033k, max=691033k, avg=691033390.00, stdev= 0.00 lat (nsec): min=691036k, max=691036k, avg=691035652.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7670, max= 7670, per=100.00%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3336KiB/s (3416kB/s)(8192KiB/2456msec); 0 zone resets clat (msec): min=549, max=1110, avg=829.96, stdev=396.62 lat (msec): min=549, max=1110, avg=830.35, stdev=396.49 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8192, max= 8192, per=61.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=16.46%, ctx=756, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146514: Sat Sep 12 00:48:04 2026 write: IOPS=1, BW=4985KiB/s (5105kB/s)(12.0MiB/2465msec); 0 zone resets clat (msec): min=215, max=1159, avg=783.91, stdev=500.37 lat (msec): min=216, max=1160, avg=784.31, stdev=500.37 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8143, max= 8192, per=61.44%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=16.56%, ctx=107, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146515: Sat Sep 12 00:48:04 2026 write: IOPS=1, BW=5382KiB/s (5512kB/s)(12.0MiB/2283msec); 0 zone resets clat (msec): min=399, max=919, avg=732.40, stdev=289.06 lat (msec): min=399, max=920, avg=732.81, stdev=289.00 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7670, max= 8143, per=59.48%, avg=7906.50, stdev=334.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.04%, sys=19.46%, ctx=173, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6671KiB/s (6831kB/s), 1668KiB/s-5980KiB/s (1708kB/s-6123kB/s), io=16.0MiB (16.8MB), run=2055-2456msec WRITE: bw=12.0MiB/s (13.6MB/s), 3336KiB/s-5382KiB/s (3416kB/s-5512kB/s), io=32.0MiB (33.6MB), run=2283-2465msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146508: Sat Sep 12 00:48:04 2026 read: IOPS=1, BW=5734KiB/s (5872kB/s)(12.0MiB/2143msec) clat (msec): min=582, max=847, avg=699.07, stdev=135.32 lat (msec): min=582, max=847, avg=699.08, stdev=135.32 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7922, max= 8094, per=100.00%, avg=8008.00, stdev=121.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.61%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146509: Sat Sep 12 00:48:04 2026 read: IOPS=0, BW=3839KiB/s (3931kB/s)(4096KiB/1067msec) clat (nsec): min=96399k, max=96399k, avg=96398756.00, stdev= 0.00 lat (nsec): min=96402k, max=96402k, avg=96401521.00, stdev= 0.00 clat percentiles (usec): | 1.00th=[95945], 5.00th=[95945], 10.00th=[95945], 20.00th=[95945], | 30.00th=[95945], 40.00th=[95945], 50.00th=[95945], 60.00th=[95945], | 70.00th=[95945], 80.00th=[95945], 90.00th=[95945], 95.00th=[95945], | 99.00th=[95945], 99.50th=[95945], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7678KiB/s (7862kB/s)(8192KiB/1067msec); 0 zone resets clat (msec): min=282, max=640, avg=461.42, stdev=253.56 lat (msec): min=282, max=641, avg=461.78, stdev=253.65 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8175, max= 8175, per=67.06%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=26.74%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146510: Sat Sep 12 00:48:04 2026 write: IOPS=1, BW=4571KiB/s (4681kB/s)(12.0MiB/2688msec); 0 zone resets clat (msec): min=70, max=1667, avg=875.56, stdev=798.72 lat (msec): min=70, max=1668, avg=876.04, stdev=798.77 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8159, max= 8159, per=66.93%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.28%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146511: Sat Sep 12 00:48:04 2026 write: IOPS=1, BW=8052KiB/s (8246kB/s)(12.0MiB/1526msec); 0 zone resets clat (msec): min=136, max=1132, avg=500.68, stdev=549.18 lat (msec): min=136, max=1132, avg=501.13, stdev=549.28 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=11719, max=11719, per=96.14%, avg=11719.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.13%, sys=16.72%, ctx=163, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7645KiB/s (7829kB/s), 3839KiB/s-5734KiB/s (3931kB/s-5872kB/s), io=16.0MiB (16.8MB), run=1067-2143msec WRITE: bw=11.9MiB/s (12.5MB/s), 4571KiB/s-8052KiB/s (4681kB/s-8246kB/s), io=32.0MiB (33.6MB), run=1067-2688msec