== sanity test 398b: DIO and buffer IO race ============== 20:54:18 (1777424058) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.71743 s, 18.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189991: Tue Apr 28 20:55:14 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5992KiB/47078msec) clat (usec): min=402, max=656121, avg=17346.06, stdev=18532.02 lat (usec): min=402, max=656122, avg=17346.75, stdev=18532.02 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[ 10421], | 30.00th=[ 11994], 40.00th=[ 13566], 50.00th=[ 15664], 60.00th=[ 17695], | 70.00th=[ 19792], 80.00th=[ 22414], 90.00th=[ 27132], 95.00th=[ 31065], | 99.00th=[ 47449], 99.50th=[ 54789], 99.90th=[ 65274], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 39, max= 200, per=24.82%, avg=126.57, stdev=29.25, samples=93 iops : min= 9, max= 50, avg=31.24, stdev= 7.45, samples=93 write: IOPS=33, BW=134KiB/s (137kB/s)(6296KiB/47078msec); 0 zone resets clat (usec): min=711, max=57340, avg=13287.09, stdev=9894.37 lat (usec): min=711, max=57340, avg=13291.19, stdev=9906.61 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2638], 10.00th=[ 3032], 20.00th=[ 3785], | 30.00th=[ 5800], 40.00th=[ 8717], 50.00th=[11207], 60.00th=[13435], | 70.00th=[16909], 80.00th=[21627], 90.00th=[27395], 95.00th=[32637], | 99.00th=[42730], 99.50th=[45876], 99.90th=[53740], 99.95th=[57410], | 99.99th=[57410] bw ( KiB/s): min= 63, max= 208, per=24.80%, avg=132.41, stdev=31.30, samples=93 iops : min= 15, max= 52, avg=32.70, stdev= 7.80, samples=93 lat (usec) : 500=0.29%, 750=0.62%, 1000=0.23% lat (msec) : 2=0.91%, 4=10.29%, 10=19.63%, 20=41.67%, 50=25.91% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.12%, sys=25.80%, ctx=9488, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189992: Tue Apr 28 20:55:14 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5940KiB/46793msec) clat (usec): min=198, max=71202, avg=16653.66, stdev=8059.94 lat (usec): min=198, max=71203, avg=16654.32, stdev=8059.96 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[10290], | 30.00th=[11731], 40.00th=[13304], 50.00th=[15270], 60.00th=[17171], | 70.00th=[19530], 80.00th=[22152], 90.00th=[26346], 95.00th=[30540], | 99.00th=[42730], 99.50th=[50070], 99.90th=[66847], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 32, max= 183, per=24.85%, avg=126.75, stdev=27.03, samples=93 iops : min= 8, max= 45, avg=31.29, stdev= 6.79, samples=93 write: IOPS=33, BW=136KiB/s (139kB/s)(6348KiB/46793msec); 0 zone resets clat (usec): min=798, max=653254, avg=13792.84, stdev=18741.75 lat (usec): min=798, max=653254, avg=13793.61, stdev=18741.76 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2638], 10.00th=[ 3032], 20.00th=[ 3851], | 30.00th=[ 6587], 40.00th=[ 9372], 50.00th=[ 11600], 60.00th=[ 13829], | 70.00th=[ 17171], 80.00th=[ 21365], 90.00th=[ 26870], 95.00th=[ 31589], | 99.00th=[ 43779], 99.50th=[ 47973], 99.90th=[ 57934], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 55, max= 288, per=25.36%, avg=135.43, stdev=36.92, samples=93 iops : min= 13, max= 72, avg=33.46, stdev= 9.30, samples=93 lat (usec) : 250=0.03%, 500=0.33%, 750=0.46%, 1000=0.13% lat (msec) : 2=0.98%, 4=9.73%, 10=19.30%, 20=43.26%, 50=25.39% lat (msec) : 100=0.36%, 750=0.03% cpu : usr=0.11%, sys=26.10%, ctx=9283, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189993: Tue Apr 28 20:55:14 2026 read: IOPS=32, BW=131KiB/s (134kB/s)(6028KiB/46033msec) clat (usec): min=158, max=75575, avg=16523.61, stdev=8623.24 lat (usec): min=159, max=75576, avg=16524.33, stdev=8623.28 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[10028], | 30.00th=[11338], 40.00th=[13173], 50.00th=[15139], 60.00th=[17433], | 70.00th=[19268], 80.00th=[22152], 90.00th=[26346], 95.00th=[31065], | 99.00th=[45876], 99.50th=[61080], 99.90th=[70779], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 47, max= 207, per=25.58%, avg=130.46, stdev=28.26, samples=91 iops : min= 11, max= 51, avg=32.21, stdev= 7.01, samples=91 write: IOPS=33, BW=136KiB/s (139kB/s)(6260KiB/46033msec); 0 zone resets clat (usec): min=699, max=628159, avg=13379.37, stdev=18257.91 lat (usec): min=700, max=628159, avg=13380.21, stdev=18257.90 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2507], 10.00th=[ 2900], 20.00th=[ 3556], | 30.00th=[ 5669], 40.00th=[ 9110], 50.00th=[ 11207], 60.00th=[ 13435], | 70.00th=[ 16319], 80.00th=[ 21103], 90.00th=[ 26608], 95.00th=[ 30802], | 99.00th=[ 40633], 99.50th=[ 45351], 99.90th=[ 69731], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 71, max= 207, per=25.29%, avg=135.07, stdev=30.87, samples=91 iops : min= 17, max= 51, avg=33.36, stdev= 7.78, samples=91 lat (usec) : 250=0.03%, 500=0.46%, 750=0.98%, 1000=0.33% lat (msec) : 2=1.27%, 4=10.64%, 10=18.16%, 20=43.52%, 50=24.06% lat (msec) : 100=0.52%, 750=0.03% cpu : usr=0.09%, sys=26.01%, ctx=9230, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189994: Tue Apr 28 20:55:14 2026 read: IOPS=32, BW=130KiB/s (134kB/s)(6052KiB/46415msec) clat (usec): min=128, max=650381, avg=17090.60, stdev=18184.40 lat (usec): min=128, max=650382, avg=17092.20, stdev=18184.03 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 7308], 10.00th=[ 8455], 20.00th=[ 10421], | 30.00th=[ 11731], 40.00th=[ 13566], 50.00th=[ 15533], 60.00th=[ 17695], | 70.00th=[ 19530], 80.00th=[ 21890], 90.00th=[ 26084], 95.00th=[ 31065], | 99.00th=[ 47449], 99.50th=[ 50594], 99.90th=[ 60556], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 55, max= 199, per=25.48%, avg=129.93, stdev=26.39, samples=92 iops : min= 13, max= 49, avg=32.08, stdev= 6.65, samples=92 write: IOPS=33, BW=134KiB/s (138kB/s)(6236KiB/46415msec); 0 zone resets clat (usec): min=823, max=67101, avg=13067.12, stdev=9608.52 lat (usec): min=824, max=67102, avg=13067.97, stdev=9608.56 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2671], 10.00th=[ 2999], 20.00th=[ 3589], | 30.00th=[ 5538], 40.00th=[ 9110], 50.00th=[11076], 60.00th=[13566], | 70.00th=[16909], 80.00th=[21103], 90.00th=[26870], 95.00th=[30802], | 99.00th=[41157], 99.50th=[44827], 99.90th=[54789], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 71, max= 207, per=25.06%, avg=133.83, stdev=30.43, samples=92 iops : min= 17, max= 51, avg=33.05, stdev= 7.66, samples=92 lat (usec) : 250=0.07%, 500=0.39%, 750=0.75%, 1000=0.16% lat (msec) : 2=0.75%, 4=11.10%, 10=18.10%, 20=43.72%, 50=24.54% lat (msec) : 100=0.39%, 750=0.03% cpu : usr=0.13%, sys=26.23%, ctx=9233, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=510KiB/s (522kB/s), 127KiB/s-131KiB/s (130kB/s-134kB/s), io=23.4MiB (24.6MB), run=46033-47078msec WRITE: bw=534KiB/s (547kB/s), 134KiB/s-136KiB/s (137kB/s-139kB/s), io=24.6MiB (25.7MB), run=46033-47078msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189996: Tue Apr 28 20:55:21 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(5992KiB/54258msec) clat (msec): min=2, max=642, avg=15.52, stdev=19.63 lat (msec): min=2, max=642, avg=15.52, stdev=19.63 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 53], 99.50th=[ 61], 99.90th=[ 85], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 31, max= 352, per=25.10%, avg=110.93, stdev=67.04, samples=107 iops : min= 7, max= 88, avg=27.50, stdev=16.83, samples=107 write: IOPS=29, BW=116KiB/s (119kB/s)(6296KiB/54258msec); 0 zone resets clat (usec): min=4174, max=79138, avg=19659.43, stdev=12919.87 lat (usec): min=4175, max=79138, avg=19660.31, stdev=12919.87 clat percentiles (usec): | 1.00th=[ 5407], 5.00th=[ 6259], 10.00th=[ 7111], 20.00th=[ 8455], | 30.00th=[10421], 40.00th=[12780], 50.00th=[15926], 60.00th=[19530], | 70.00th=[24249], 80.00th=[29230], 90.00th=[37487], 95.00th=[44827], | 99.00th=[62129], 99.50th=[69731], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 39, max= 360, per=25.20%, avg=116.69, stdev=66.98, samples=107 iops : min= 9, max= 90, avg=28.93, stdev=16.84, samples=107 lat (msec) : 4=0.98%, 10=33.69%, 20=33.63%, 50=29.43%, 100=2.25% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=13.93%, ctx=6323, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189997: Tue Apr 28 20:55:21 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(5940KiB/53860msec) clat (msec): min=2, max=664, avg=15.76, stdev=20.19 lat (msec): min=2, max=664, avg=15.76, stdev=20.19 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 55], 99.50th=[ 58], 99.90th=[ 74], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 32, max= 391, per=25.15%, avg=111.15, stdev=68.93, samples=106 iops : min= 8, max= 97, avg=27.55, stdev=17.30, samples=106 write: IOPS=29, BW=118KiB/s (121kB/s)(6348KiB/53860msec); 0 zone resets clat (usec): min=4580, max=78513, avg=19160.24, stdev=12125.70 lat (usec): min=4580, max=78514, avg=19161.16, stdev=12125.68 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 6325], 10.00th=[ 7177], 20.00th=[ 8455], | 30.00th=[10290], 40.00th=[12911], 50.00th=[15664], 60.00th=[19792], | 70.00th=[23987], 80.00th=[28443], 90.00th=[35390], 95.00th=[41157], | 99.00th=[59507], 99.50th=[66847], 99.90th=[73925], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 48, max= 368, per=25.60%, avg=118.55, stdev=67.41, samples=106 iops : min= 12, max= 92, avg=29.40, stdev=16.93, samples=106 lat (msec) : 4=0.72%, 10=33.82%, 20=32.88%, 50=30.63%, 100=1.92% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=14.06%, ctx=6253, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189998: Tue Apr 28 20:55:21 2026 read: IOPS=27, BW=112KiB/s (114kB/s)(6028KiB/53978msec) clat (usec): min=2720, max=65915, avg=14957.22, stdev=10210.20 lat (usec): min=2721, max=65916, avg=14957.94, stdev=10210.19 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 4817], 10.00th=[ 5211], 20.00th=[ 6325], | 30.00th=[ 8094], 40.00th=[10028], 50.00th=[11863], 60.00th=[13829], | 70.00th=[17433], 80.00th=[22938], 90.00th=[29754], 95.00th=[35914], | 99.00th=[46924], 99.50th=[52691], 99.90th=[63701], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 16, max= 352, per=25.42%, avg=112.36, stdev=69.62, samples=106 iops : min= 4, max= 88, avg=27.85, stdev=17.46, samples=106 write: IOPS=28, BW=116KiB/s (119kB/s)(6260KiB/53978msec); 0 zone resets clat (msec): min=4, max=665, avg=20.05, stdev=20.65 lat (msec): min=4, max=665, avg=20.05, stdev=20.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 71], 99.90th=[ 80], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 40, max= 328, per=25.13%, avg=116.36, stdev=65.77, samples=106 iops : min= 10, max= 82, avg=28.85, stdev=16.53, samples=106 lat (msec) : 4=0.52%, 10=33.24%, 20=33.33%, 50=31.15%, 100=1.73% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=14.10%, ctx=6263, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189999: Tue Apr 28 20:55:21 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(6052KiB/53995msec) clat (usec): min=2702, max=61669, avg=15389.74, stdev=10756.74 lat (usec): min=2702, max=61670, avg=15390.39, stdev=10756.74 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 4817], 10.00th=[ 5211], 20.00th=[ 6259], | 30.00th=[ 8094], 40.00th=[10159], 50.00th=[11994], 60.00th=[14484], | 70.00th=[17957], 80.00th=[23200], 90.00th=[31327], 95.00th=[37487], | 99.00th=[51119], 99.50th=[56361], 99.90th=[61604], 99.95th=[61604], | 99.99th=[61604] bw ( KiB/s): min= 47, max= 352, per=25.44%, avg=112.43, stdev=67.01, samples=106 iops : min= 11, max= 88, avg=27.87, stdev=16.82, samples=106 write: IOPS=28, BW=115KiB/s (118kB/s)(6236KiB/53995msec); 0 zone resets clat (msec): min=4, max=656, avg=19.66, stdev=20.41 lat (msec): min=4, max=656, avg=19.66, stdev=20.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 36], 95.00th=[ 44], | 99.00th=[ 60], 99.50th=[ 68], 99.90th=[ 81], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 48, max= 352, per=25.08%, avg=116.13, stdev=68.50, samples=106 iops : min= 12, max= 88, avg=28.79, stdev=17.20, samples=106 lat (msec) : 4=0.39%, 10=33.37%, 20=34.28%, 50=29.75%, 100=2.18% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=14.08%, ctx=6121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=443KiB/s (453kB/s), 110KiB/s-112KiB/s (113kB/s-115kB/s), io=23.4MiB (24.6MB), run=53860-54258msec WRITE: bw=463KiB/s (474kB/s), 115KiB/s-118KiB/s (118kB/s-121kB/s), io=24.6MiB (25.7MB), run=53860-54258msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190018: Tue Apr 28 20:55:39 2026 read: IOPS=28, BW=461KiB/s (472kB/s)(5920KiB/12838msec) clat (usec): min=202, max=54566, avg=17747.70, stdev=9215.51 lat (usec): min=202, max=54567, avg=17748.40, stdev=9215.51 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 611], 10.00th=[ 8717], 20.00th=[11076], | 30.00th=[13042], 40.00th=[14877], 50.00th=[16909], 60.00th=[19006], | 70.00th=[20841], 80.00th=[23462], 90.00th=[28967], 95.00th=[33424], | 99.00th=[51119], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 350, max= 634, per=25.02%, avg=456.80, stdev=84.20, samples=25 iops : min= 21, max= 39, avg=28.00, stdev= 5.28, samples=25 write: IOPS=31, BW=496KiB/s (508kB/s)(6368KiB/12838msec); 0 zone resets clat (usec): min=1567, max=60520, avg=15655.38, stdev=10321.31 lat (usec): min=1568, max=60522, avg=15656.69, stdev=10321.34 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4178], 10.00th=[ 4621], 20.00th=[ 5473], | 30.00th=[ 8225], 40.00th=[10945], 50.00th=[13304], 60.00th=[16450], | 70.00th=[19792], 80.00th=[23725], 90.00th=[31327], 95.00th=[35390], | 99.00th=[45876], 99.50th=[46400], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 319, max= 734, per=25.71%, avg=493.96, stdev=106.41, samples=25 iops : min= 19, max= 45, avg=30.32, stdev= 6.61, samples=25 lat (usec) : 250=0.13%, 500=0.52%, 750=1.82%, 1000=0.26% lat (msec) : 2=0.52%, 4=2.34%, 10=20.70%, 20=41.15%, 50=31.90% lat (msec) : 100=0.65% cpu : usr=0.12%, sys=28.15%, ctx=2679, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190019: Tue Apr 28 20:55:39 2026 read: IOPS=27, BW=444KiB/s (455kB/s)(5744KiB/12935msec) clat (usec): min=375, max=59873, avg=18847.82, stdev=9281.27 lat (usec): min=375, max=59875, avg=18848.53, stdev=9281.22 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 3884], 10.00th=[ 8979], 20.00th=[11863], | 30.00th=[13698], 40.00th=[15664], 50.00th=[17695], 60.00th=[20055], | 70.00th=[22676], 80.00th=[25560], 90.00th=[30278], 95.00th=[34866], | 99.00th=[45351], 99.50th=[58983], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 254, max= 576, per=24.34%, avg=444.52, stdev=91.36, samples=25 iops : min= 15, max= 36, avg=27.24, stdev= 5.89, samples=25 write: IOPS=31, BW=506KiB/s (518kB/s)(6544KiB/12935msec); 0 zone resets clat (usec): min=1170, max=64747, avg=14993.22, stdev=10565.15 lat (usec): min=1171, max=64748, avg=14994.83, stdev=10565.21 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3523], 10.00th=[ 4113], 20.00th=[ 5080], | 30.00th=[ 7570], 40.00th=[10028], 50.00th=[12387], 60.00th=[15664], | 70.00th=[19006], 80.00th=[22414], 90.00th=[30278], 95.00th=[35390], | 99.00th=[47449], 99.50th=[48497], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 255, max= 734, per=26.11%, avg=501.56, stdev=112.90, samples=25 iops : min= 15, max= 45, avg=30.80, stdev= 6.95, samples=25 lat (usec) : 500=0.78%, 750=1.17%, 1000=0.13% lat (msec) : 2=0.65%, 4=4.30%, 10=20.18%, 20=39.58%, 50=32.55% lat (msec) : 100=0.65% cpu : usr=0.11%, sys=28.31%, ctx=2723, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190020: Tue Apr 28 20:55:39 2026 read: IOPS=29, BW=477KiB/s (488kB/s)(6256KiB/13114msec) clat (usec): min=375, max=59373, avg=18660.24, stdev=9181.17 lat (usec): min=376, max=59374, avg=18660.99, stdev=9181.19 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 750], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[14091], 40.00th=[15926], 50.00th=[17695], 60.00th=[20317], | 70.00th=[22676], 80.00th=[24511], 90.00th=[29230], 95.00th=[35390], | 99.00th=[51643], 99.50th=[58983], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 288, max= 608, per=26.15%, avg=477.52, stdev=79.50, samples=25 iops : min= 18, max= 38, avg=29.32, stdev= 5.01, samples=25 write: IOPS=28, BW=460KiB/s (471kB/s)(6032KiB/13114msec); 0 zone resets clat (usec): min=1380, max=59330, avg=15336.75, stdev=9989.28 lat (usec): min=1381, max=59332, avg=15338.77, stdev=9989.61 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 4359], 10.00th=[ 4752], 20.00th=[ 5866], | 30.00th=[ 8586], 40.00th=[10814], 50.00th=[12649], 60.00th=[16450], | 70.00th=[18744], 80.00th=[23200], 90.00th=[30016], 95.00th=[34341], | 99.00th=[49021], 99.50th=[50070], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 223, max= 760, per=23.24%, avg=446.48, stdev=133.02, samples=25 iops : min= 13, max= 47, avg=27.36, stdev= 8.32, samples=25 lat (usec) : 500=0.65%, 750=1.82%, 1000=0.13% lat (msec) : 2=0.26%, 4=1.56%, 10=20.44%, 20=41.02%, 50=33.33% lat (msec) : 100=0.78% cpu : usr=0.11%, sys=27.62%, ctx=2972, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190021: Tue Apr 28 20:55:39 2026 read: IOPS=28, BW=462KiB/s (473kB/s)(6032KiB/13067msec) clat (usec): min=374, max=58788, avg=18362.36, stdev=9477.63 lat (usec): min=374, max=58789, avg=18363.06, stdev=9477.64 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 644], 10.00th=[ 8979], 20.00th=[11600], | 30.00th=[13698], 40.00th=[15270], 50.00th=[17171], 60.00th=[19268], | 70.00th=[21890], 80.00th=[25560], 90.00th=[29230], 95.00th=[35390], | 99.00th=[50070], 99.50th=[57410], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 256, max= 683, per=24.77%, avg=452.28, stdev=91.33, samples=25 iops : min= 16, max= 42, avg=27.72, stdev= 5.65, samples=25 write: IOPS=29, BW=479KiB/s (490kB/s)(6256KiB/13067msec); 0 zone resets clat (usec): min=1709, max=57683, avg=15656.74, stdev=10691.44 lat (usec): min=1709, max=57684, avg=15658.08, stdev=10691.43 clat percentiles (usec): | 1.00th=[ 2507], 5.00th=[ 3982], 10.00th=[ 4490], 20.00th=[ 5735], | 30.00th=[ 8225], 40.00th=[10814], 50.00th=[13173], 60.00th=[15795], | 70.00th=[19006], 80.00th=[23725], 90.00th=[32637], 95.00th=[35914], | 99.00th=[51119], 99.50th=[53216], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 319, max= 761, per=24.64%, avg=473.36, stdev=105.71, samples=25 iops : min= 19, max= 47, avg=29.04, stdev= 6.67, samples=25 lat (usec) : 500=1.17%, 750=1.82% lat (msec) : 2=0.65%, 4=2.34%, 10=19.27%, 20=41.80%, 50=32.03% lat (msec) : 100=0.91% cpu : usr=0.15%, sys=27.85%, ctx=2787, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1826KiB/s (1870kB/s), 444KiB/s-477KiB/s (455kB/s-488kB/s), io=23.4MiB (24.5MB), run=12838-13114msec WRITE: bw=1922KiB/s (1968kB/s), 460KiB/s-506KiB/s (471kB/s-518kB/s), io=24.6MiB (25.8MB), run=12838-13114msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190023: Tue Apr 28 20:55:42 2026 read: IOPS=24, BW=396KiB/s (406kB/s)(5920KiB/14932msec) clat (usec): min=4022, max=60771, avg=16912.59, stdev=11961.77 lat (usec): min=4022, max=60771, avg=16913.35, stdev=11961.78 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5604], 10.00th=[ 5997], 20.00th=[ 7177], | 30.00th=[ 8979], 40.00th=[10945], 50.00th=[12780], 60.00th=[15008], | 70.00th=[18744], 80.00th=[24773], 90.00th=[35390], 95.00th=[42730], | 99.00th=[56361], 99.50th=[57410], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 192, max= 896, per=23.96%, avg=382.59, stdev=211.04, samples=29 iops : min= 12, max= 56, avg=23.45, stdev=13.39, samples=29 write: IOPS=26, BW=426KiB/s (437kB/s)(6368KiB/14932msec); 0 zone resets clat (usec): min=4168, max=78828, avg=21573.71, stdev=13693.01 lat (usec): min=4169, max=78829, avg=21575.35, stdev=13692.98 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 6849], 10.00th=[ 7963], 20.00th=[10028], | 30.00th=[12125], 40.00th=[13960], 50.00th=[17171], 60.00th=[21365], | 70.00th=[26608], 80.00th=[32375], 90.00th=[42730], 95.00th=[47973], | 99.00th=[62653], 99.50th=[72877], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 191, max= 1088, per=24.88%, avg=417.97, stdev=210.36, samples=29 iops : min= 11, max= 68, avg=25.66, stdev=13.33, samples=29 lat (msec) : 10=26.82%, 20=37.50%, 50=32.29%, 100=3.39% cpu : usr=0.07%, sys=14.04%, ctx=1744, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190024: Tue Apr 28 20:55:42 2026 read: IOPS=24, BW=385KiB/s (394kB/s)(5744KiB/14933msec) clat (usec): min=3012, max=76138, avg=17304.45, stdev=12518.76 lat (usec): min=3013, max=76139, avg=17305.82, stdev=12518.35 clat percentiles (usec): | 1.00th=[ 4113], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 7046], | 30.00th=[ 9634], 40.00th=[11731], 50.00th=[13304], 60.00th=[15270], | 70.00th=[19268], 80.00th=[25297], 90.00th=[35914], 95.00th=[45351], | 99.00th=[61080], 99.50th=[70779], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 128, max= 896, per=23.71%, avg=378.59, stdev=193.14, samples=29 iops : min= 8, max= 56, avg=23.21, stdev=12.26, samples=29 write: IOPS=27, BW=438KiB/s (449kB/s)(6544KiB/14933msec); 0 zone resets clat (usec): min=3862, max=81572, avg=21232.58, stdev=13421.26 lat (usec): min=3864, max=81574, avg=21234.40, stdev=13421.40 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7373], 10.00th=[ 8455], 20.00th=[ 9765], | 30.00th=[11600], 40.00th=[13566], 50.00th=[16909], 60.00th=[21365], | 70.00th=[26084], 80.00th=[31851], 90.00th=[41681], 95.00th=[46924], | 99.00th=[62129], 99.50th=[72877], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 221, max= 1120, per=25.30%, avg=425.07, stdev=230.78, samples=29 iops : min= 13, max= 70, avg=26.10, stdev=14.62, samples=29 lat (msec) : 4=0.52%, 10=25.52%, 20=37.89%, 50=32.29%, 100=3.78% cpu : usr=0.10%, sys=14.16%, ctx=1710, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190025: Tue Apr 28 20:55:42 2026 read: IOPS=26, BW=420KiB/s (430kB/s)(6256KiB/14902msec) clat (usec): min=3737, max=67961, avg=17112.98, stdev=12048.24 lat (usec): min=3738, max=67962, avg=17113.86, stdev=12048.22 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5473], 10.00th=[ 6325], 20.00th=[ 7963], | 30.00th=[ 9765], 40.00th=[11076], 50.00th=[13173], 60.00th=[15139], | 70.00th=[20055], 80.00th=[23987], 90.00th=[33817], 95.00th=[42206], | 99.00th=[61604], 99.50th=[65799], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 192, max= 1216, per=26.09%, avg=416.62, stdev=235.41, samples=29 iops : min= 12, max= 76, avg=25.59, stdev=14.90, samples=29 write: IOPS=25, BW=405KiB/s (414kB/s)(6032KiB/14902msec); 0 zone resets clat (usec): min=5536, max=88977, avg=21547.15, stdev=13438.08 lat (usec): min=5538, max=88978, avg=21548.73, stdev=13438.11 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 6915], 10.00th=[ 8160], 20.00th=[ 9372], | 30.00th=[11863], 40.00th=[14222], 50.00th=[17433], 60.00th=[21365], | 70.00th=[27132], 80.00th=[32637], 90.00th=[40633], 95.00th=[45351], | 99.00th=[60556], 99.50th=[71828], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 221, max= 1024, per=23.28%, avg=391.17, stdev=195.80, samples=29 iops : min= 13, max= 64, avg=24.00, stdev=12.40, samples=29 lat (msec) : 4=0.39%, 10=27.34%, 20=35.68%, 50=33.46%, 100=3.12% cpu : usr=0.08%, sys=14.34%, ctx=1745, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190026: Tue Apr 28 20:55:42 2026 read: IOPS=25, BW=402KiB/s (412kB/s)(6032KiB/14994msec) clat (usec): min=3235, max=70991, avg=17105.79, stdev=13232.64 lat (usec): min=3236, max=70991, avg=17106.59, stdev=13232.66 clat percentiles (usec): | 1.00th=[ 3687], 5.00th=[ 5342], 10.00th=[ 6128], 20.00th=[ 7046], | 30.00th=[ 8979], 40.00th=[10421], 50.00th=[12256], 60.00th=[14484], | 70.00th=[18482], 80.00th=[23725], 90.00th=[36439], 95.00th=[45876], | 99.00th=[63177], 99.50th=[67634], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 192, max= 1120, per=24.11%, avg=385.00, stdev=210.42, samples=29 iops : min= 12, max= 70, avg=23.59, stdev=13.31, samples=29 write: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/14994msec); 0 zone resets clat (usec): min=4500, max=84377, avg=21768.43, stdev=14072.83 lat (usec): min=4502, max=84378, avg=21770.00, stdev=14072.84 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 7046], 10.00th=[ 8225], 20.00th=[ 9765], | 30.00th=[11731], 40.00th=[13566], 50.00th=[16909], 60.00th=[21627], | 70.00th=[26608], 80.00th=[34341], 90.00th=[41681], 95.00th=[50070], | 99.00th=[65799], 99.50th=[77071], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 158, max= 1056, per=24.09%, avg=404.69, stdev=214.89, samples=29 iops : min= 9, max= 66, avg=24.83, stdev=13.64, samples=29 lat (msec) : 4=0.91%, 10=28.52%, 20=33.85%, 50=32.03%, 100=4.69% cpu : usr=0.06%, sys=14.00%, ctx=1680, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1597KiB/s (1636kB/s), 385KiB/s-420KiB/s (394kB/s-430kB/s), io=23.4MiB (24.5MB), run=14902-14994msec WRITE: bw=1681KiB/s (1721kB/s), 405KiB/s-438KiB/s (414kB/s-449kB/s), io=24.6MiB (25.8MB), run=14902-14994msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190038: Tue Apr 28 20:55:50 2026 read: IOPS=2, BW=2757KiB/s (2823kB/s)(7168KiB/2600msec) clat (msec): min=86, max=386, avg=185.69, stdev=109.09 lat (msec): min=86, max=386, avg=185.69, stdev=109.09 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 111], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 148], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 284], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1939, max= 5011, per=53.94%, avg=3564.67, stdev=1543.83, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1969KiB/s (2016kB/s)(5120KiB/2600msec); 0 zone resets clat (msec): min=131, max=485, avg=245.35, stdev=151.48 lat (msec): min=131, max=485, avg=245.42, stdev=151.49 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1670, max= 5907, per=40.95%, avg=3788.50, stdev=2996.01, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=44.48%, ctx=1221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190039: Tue Apr 28 20:55:50 2026 read: IOPS=0, BW=661KiB/s (677kB/s)(2048KiB/3099msec) clat (msec): min=197, max=314, avg=255.67, stdev=82.57 lat (msec): min=197, max=314, avg=255.67, stdev=82.57 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1673, max= 2048, per=28.16%, avg=1860.50, stdev=265.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3304KiB/s (3384kB/s)(10.0MiB/3099msec); 0 zone resets clat (msec): min=83, max=547, avg=253.30, stdev=190.58 lat (msec): min=84, max=547, avg=253.36, stdev=190.58 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 95], | 30.00th=[ 103], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 176], | 70.00th=[ 380], 80.00th=[ 397], 90.00th=[ 535], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1872, max= 6144, per=43.07%, avg=3984.67, stdev=2136.38, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=40.32%, ctx=448, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190040: Tue Apr 28 20:55:50 2026 read: IOPS=2, BW=2401KiB/s (2459kB/s)(6144KiB/2559msec) clat (usec): min=920, max=425479, avg=137127.58, stdev=169379.82 lat (usec): min=921, max=425480, avg=137128.47, stdev=169379.77 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 8979], 50.00th=[ 8979], 60.00th=[177210], | 70.00th=[208667], 80.00th=[208667], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 1872, max= 5818, per=48.72%, avg=3219.67, stdev=2250.75, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2401KiB/s (2459kB/s)(6144KiB/2559msec); 0 zone resets clat (msec): min=120, max=525, avg=277.75, stdev=160.53 lat (msec): min=120, max=525, avg=277.80, stdev=160.53 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 309], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1872, max= 3878, per=29.78%, avg=2755.50, stdev=993.13, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=41.48%, ctx=435, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190041: Tue Apr 28 20:55:50 2026 read: IOPS=1, BW=2029KiB/s (2078kB/s)(5120KiB/2523msec) clat (usec): min=949, max=223107, avg=139258.52, stdev=83727.10 lat (usec): min=950, max=223108, avg=139259.40, stdev=83727.11 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 947], 10.00th=[ 947], 20.00th=[ 947], | 30.00th=[133694], 40.00th=[133694], 50.00th=[162530], 60.00th=[162530], | 70.00th=[175113], 80.00th=[175113], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 1969, max= 5818, per=58.92%, avg=3893.50, stdev=2721.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2841KiB/s (2909kB/s)(7168KiB/2523msec); 0 zone resets clat (msec): min=118, max=629, avg=257.96, stdev=184.53 lat (msec): min=118, max=629, avg=258.03, stdev=184.53 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 123], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 157], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 342], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1651, max= 3744, per=25.14%, avg=2325.75, stdev=956.31, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.08%, sys=47.66%, ctx=302, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6609KiB/s (6767kB/s), 661KiB/s-2757KiB/s (677kB/s-2823kB/s), io=20.0MiB (20.0MB), run=2523-3099msec WRITE: bw=9252KiB/s (9474kB/s), 1969KiB/s-3304KiB/s (2016kB/s-3384kB/s), io=28.0MiB (29.4MB), run=2523-3099msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190033: Tue Apr 28 20:55:50 2026 read: IOPS=2, BW=2824KiB/s (2892kB/s)(7168KiB/2538msec) clat (msec): min=37, max=802, avg=204.98, stdev=280.36 lat (msec): min=37, max=802, avg=204.98, stdev=280.36 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 45], | 30.00th=[ 49], 40.00th=[ 49], 50.00th=[ 64], 60.00th=[ 130], | 70.00th=[ 130], 80.00th=[ 309], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1996, max= 8648, per=82.41%, avg=5322.00, stdev=4703.67, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=1, BW=2017KiB/s (2066kB/s)(5120KiB/2538msec); 0 zone resets clat (msec): min=109, max=340, avg=215.67, stdev=89.27 lat (msec): min=109, max=341, avg=215.82, stdev=89.31 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1729, max= 3813, per=26.35%, avg=2382.50, stdev=961.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=25.00%, 100=8.33%, 250=41.67%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=14.90%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190034: Tue Apr 28 20:55:50 2026 read: IOPS=0, BW=723KiB/s (740kB/s)(2048KiB/2833msec) clat (msec): min=261, max=439, avg=350.41, stdev=125.66 lat (msec): min=261, max=439, avg=350.42, stdev=125.66 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1735, max= 1992, per=28.86%, avg=1863.50, stdev=181.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3615KiB/s (3701kB/s)(10.0MiB/2833msec); 0 zone resets clat (msec): min=73, max=358, avg=207.13, stdev=93.89 lat (msec): min=73, max=358, avg=207.19, stdev=93.89 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 128], | 30.00th=[ 140], 40.00th=[ 144], 50.00th=[ 176], 60.00th=[ 186], | 70.00th=[ 264], 80.00th=[ 284], 90.00th=[ 326], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 3813, max= 5988, per=57.91%, avg=5236.00, stdev=1233.02, samples=3 iops : min= 3, max= 5, avg= 4.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=19.88%, ctx=141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190035: Tue Apr 28 20:55:50 2026 read: IOPS=1, BW=1938KiB/s (1984kB/s)(6144KiB/3171msec) clat (msec): min=27, max=429, avg=221.24, stdev=141.17 lat (msec): min=27, max=429, avg=221.24, stdev=141.17 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 259], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 3938, max= 3992, per=61.40%, avg=3965.00, stdev=38.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1938KiB/s (1984kB/s)(6144KiB/3171msec); 0 zone resets clat (msec): min=97, max=639, avg=302.39, stdev=234.15 lat (msec): min=97, max=639, avg=302.46, stdev=234.15 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 296], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1906, max= 3465, per=27.15%, avg=2454.33, stdev=876.32, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=13.97%, ctx=266, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190036: Tue Apr 28 20:55:50 2026 read: IOPS=2, BW=2218KiB/s (2272kB/s)(5120KiB/2308msec) clat (msec): min=71, max=320, avg=144.72, stdev=103.42 lat (msec): min=71, max=320, avg=144.73, stdev=103.42 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 109], 60.00th=[ 109], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1906, max= 5988, per=61.12%, avg=3947.00, stdev=2886.41, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3106KiB/s (3180kB/s)(7168KiB/2308msec); 0 zone resets clat (msec): min=63, max=780, avg=225.04, stdev=254.68 lat (msec): min=63, max=781, avg=225.10, stdev=254.68 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 144], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 239], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1906, max= 5206, per=40.94%, avg=3701.33, stdev=1669.09, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=41.67%, 250=41.67%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=18.77%, ctx=170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6459KiB/s (6614kB/s), 723KiB/s-2824KiB/s (740kB/s-2892kB/s), io=20.0MiB (20.0MB), run=2308-3171msec WRITE: bw=9042KiB/s (9259kB/s), 1938KiB/s-3615KiB/s (1984kB/s-3701kB/s), io=28.0MiB (29.4MB), run=2308-3171msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190052: Tue Apr 28 20:55:58 2026 read: IOPS=2, BW=8703KiB/s (8911kB/s)(12.0MiB/1412msec) clat (msec): min=377, max=544, avg=447.00, stdev=86.93 lat (msec): min=377, max=544, avg=447.00, stdev=86.93 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7641, max= 8192, per=92.63%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=19.06%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190053: Tue Apr 28 20:55:58 2026 read: IOPS=0, BW=2137KiB/s (2188kB/s)(4096KiB/1917msec) clat (nsec): min=514824k, max=514824k, avg=514823940.00, stdev= 0.00 lat (nsec): min=514825k, max=514825k, avg=514824747.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 5535, max= 5535, per=64.77%, avg=5535.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4273KiB/s (4376kB/s)(8192KiB/1917msec); 0 zone resets clat (msec): min=267, max=1102, avg=685.41, stdev=590.45 lat (msec): min=268, max=1103, avg=685.67, stdev=590.45 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8110, max= 8110, per=47.45%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.78%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190054: Tue Apr 28 20:55:58 2026 write: IOPS=1, BW=6880KiB/s (7045kB/s)(12.0MiB/1786msec); 0 zone resets clat (msec): min=267, max=826, avg=584.49, stdev=286.76 lat (msec): min=267, max=826, avg=584.77, stdev=286.75 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 5542, max= 8110, per=39.93%, avg=6826.00, stdev=1815.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=14.06%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190055: Tue Apr 28 20:55:58 2026 write: IOPS=2, BW=8721KiB/s (8930kB/s)(12.0MiB/1409msec); 0 zone resets clat (msec): min=180, max=760, avg=460.65, stdev=290.43 lat (msec): min=180, max=760, avg=460.95, stdev=290.42 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 5512, max= 8192, per=40.09%, avg=6852.00, stdev=1895.05, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.07%, sys=20.74%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8547KiB/s (8752kB/s), 2137KiB/s-8703KiB/s (2188kB/s-8911kB/s), io=16.0MiB (16.8MB), run=1412-1917msec WRITE: bw=16.7MiB/s (17.5MB/s), 4273KiB/s-8721KiB/s (4376kB/s-8930kB/s), io=32.0MiB (33.6MB), run=1409-1917msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190047: Tue Apr 28 20:55:58 2026 read: IOPS=2, BW=8937KiB/s (9151kB/s)(12.0MiB/1375msec) clat (msec): min=326, max=518, avg=410.96, stdev=98.23 lat (msec): min=326, max=518, avg=410.96, stdev=98.23 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 8000, max= 8175, per=95.08%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=47.09%, ctx=2729, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190048: Tue Apr 28 20:55:58 2026 read: IOPS=0, BW=2127KiB/s (2178kB/s)(4096KiB/1926msec) clat (nsec): min=315862k, max=315862k, avg=315861835.00, stdev= 0.00 lat (nsec): min=315863k, max=315863k, avg=315862685.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 8000, max= 8000, per=94.05%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4253KiB/s (4355kB/s)(8192KiB/1926msec); 0 zone resets clat (msec): min=560, max=895, avg=727.84, stdev=236.41 lat (msec): min=560, max=895, avg=728.12, stdev=236.40 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8175, max= 8175, per=50.70%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=20.05%, ctx=1003, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190050: Tue Apr 28 20:55:58 2026 write: IOPS=1, BW=6047KiB/s (6192kB/s)(12.0MiB/2032msec); 0 zone resets clat (msec): min=235, max=831, avg=629.71, stdev=341.48 lat (msec): min=235, max=831, avg=629.94, stdev=341.55 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8175, max= 8192, per=50.75%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.37%, ctx=90, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190051: Tue Apr 28 20:55:58 2026 write: IOPS=1, BW=7228KiB/s (7402kB/s)(12.0MiB/1700msec); 0 zone resets clat (msec): min=210, max=678, avg=515.82, stdev=264.49 lat (msec): min=210, max=678, avg=516.10, stdev=264.48 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=50.70%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=18.13%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8507KiB/s (8711kB/s), 2127KiB/s-8937KiB/s (2178kB/s-9151kB/s), io=16.0MiB (16.8MB), run=1375-1926msec WRITE: bw=15.7MiB/s (16.5MB/s), 4253KiB/s-7228KiB/s (4355kB/s-7402kB/s), io=32.0MiB (33.6MB), run=1700-2032msec