== sanity test 398b: DIO and buffer IO race ============== 01:00:38 (1782363638) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.7864 s, 18.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188271: Thu Jun 25 01:01:41 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(5992KiB/53798msec) clat (usec): min=30, max=76660, avg=18901.48, stdev=10276.29 lat (usec): min=31, max=76661, avg=18902.43, stdev=10276.29 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 6390], 10.00th=[ 8586], 20.00th=[10945], | 30.00th=[12649], 40.00th=[14877], 50.00th=[17433], 60.00th=[20055], | 70.00th=[22414], 80.00th=[25822], 90.00th=[31065], 95.00th=[37487], | 99.00th=[55313], 99.50th=[58459], 99.90th=[69731], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 20, max= 190, per=24.93%, avg=111.18, stdev=28.87, samples=107 iops : min= 5, max= 47, avg=27.40, stdev= 7.20, samples=107 write: IOPS=29, BW=117KiB/s (120kB/s)(6296KiB/53798msec); 0 zone resets clat (usec): min=804, max=651064, avg=16055.12, stdev=20212.70 lat (usec): min=805, max=651066, avg=16056.09, stdev=20212.78 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2245], 10.00th=[ 2868], 20.00th=[ 3884], | 30.00th=[ 7111], 40.00th=[ 10552], 50.00th=[ 13304], 60.00th=[ 15926], | 70.00th=[ 20055], 80.00th=[ 24773], 90.00th=[ 32375], 95.00th=[ 39060], | 99.00th=[ 55313], 99.50th=[ 61604], 99.90th=[ 82314], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 48, max= 246, per=25.25%, avg=117.92, stdev=34.79, samples=106 iops : min= 12, max= 61, avg=29.08, stdev= 8.72, samples=106 lat (usec) : 50=0.13%, 100=0.68%, 250=0.88%, 1000=0.16% lat (msec) : 2=1.79%, 4=8.72%, 10=14.68%, 20=38.05%, 50=33.01% lat (msec) : 100=1.86%, 750=0.03% cpu : usr=0.11%, sys=20.59%, ctx=8763, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188272: Thu Jun 25 01:01:41 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(5940KiB/53499msec) clat (usec): min=46, max=79283, avg=19062.76, stdev=9825.97 lat (usec): min=47, max=79284, avg=19064.78, stdev=9827.14 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[10945], | 30.00th=[13042], 40.00th=[15139], 50.00th=[17433], 60.00th=[19792], | 70.00th=[22676], 80.00th=[26084], 90.00th=[31065], 95.00th=[36963], | 99.00th=[53216], 99.50th=[60556], 99.90th=[73925], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 6, max= 184, per=24.83%, avg=110.75, stdev=27.83, samples=106 iops : min= 1, max= 46, avg=27.29, stdev= 6.97, samples=106 write: IOPS=29, BW=119KiB/s (122kB/s)(6348KiB/53499msec); 0 zone resets clat (usec): min=847, max=669546, avg=15729.77, stdev=20452.93 lat (usec): min=848, max=669547, avg=15730.84, stdev=20452.88 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2180], 10.00th=[ 2802], 20.00th=[ 3556], | 30.00th=[ 6390], 40.00th=[ 10159], 50.00th=[ 13173], 60.00th=[ 15926], | 70.00th=[ 19792], 80.00th=[ 24511], 90.00th=[ 32113], 95.00th=[ 38011], | 99.00th=[ 52691], 99.50th=[ 62653], 99.90th=[ 96994], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 6, max= 199, per=25.27%, avg=118.03, stdev=31.39, samples=106 iops : min= 1, max= 49, avg=29.12, stdev= 7.89, samples=106 lat (usec) : 50=0.07%, 100=0.26%, 250=0.49%, 500=0.03%, 1000=0.07% lat (msec) : 2=1.95%, 4=9.86%, 10=14.75%, 20=38.57%, 50=32.62% lat (msec) : 100=1.30%, 750=0.03% cpu : usr=0.13%, sys=20.88%, ctx=8534, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188273: Thu Jun 25 01:01:41 2026 read: IOPS=28, BW=115KiB/s (117kB/s)(6028KiB/52614msec) clat (usec): min=45, max=77210, avg=19030.58, stdev=9767.69 lat (usec): min=46, max=77211, avg=19031.54, stdev=9767.90 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 7701], 10.00th=[ 9372], 20.00th=[11207], | 30.00th=[13173], 40.00th=[15008], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22414], 80.00th=[25822], 90.00th=[31327], 95.00th=[36439], | 99.00th=[49546], 99.50th=[55313], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 40, max= 184, per=25.97%, avg=115.81, stdev=26.82, samples=103 iops : min= 10, max= 46, avg=28.56, stdev= 6.73, samples=103 write: IOPS=29, BW=119KiB/s (122kB/s)(6260KiB/52614msec); 0 zone resets clat (usec): min=865, max=702308, avg=15144.55, stdev=21070.53 lat (usec): min=866, max=702309, avg=15145.53, stdev=21070.55 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1942], 10.00th=[ 2638], 20.00th=[ 3589], | 30.00th=[ 6390], 40.00th=[ 9765], 50.00th=[ 12125], 60.00th=[ 14877], | 70.00th=[ 18220], 80.00th=[ 23462], 90.00th=[ 31065], 95.00th=[ 38536], | 99.00th=[ 53216], 99.50th=[ 58459], 99.90th=[ 88605], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 40, max= 200, per=25.69%, avg=119.99, stdev=31.22, samples=103 iops : min= 10, max= 50, avg=29.61, stdev= 7.77, samples=103 lat (usec) : 50=0.07%, 100=0.46%, 250=0.62%, 1000=0.26% lat (msec) : 2=2.47%, 4=8.72%, 10=14.84%, 20=40.30%, 50=31.09% lat (msec) : 100=1.14%, 750=0.03% cpu : usr=0.10%, sys=21.14%, ctx=8645, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188274: Thu Jun 25 01:01:41 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53648msec) clat (usec): min=44, max=81476, avg=18860.08, stdev=10089.74 lat (usec): min=45, max=81477, avg=18860.86, stdev=10089.76 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 7570], 10.00th=[ 9110], 20.00th=[11076], | 30.00th=[12911], 40.00th=[14615], 50.00th=[16909], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25822], 90.00th=[31589], 95.00th=[37487], | 99.00th=[52691], 99.50th=[57934], 99.90th=[73925], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 32, max= 175, per=25.41%, avg=113.34, stdev=27.31, samples=105 iops : min= 8, max= 43, avg=27.94, stdev= 6.83, samples=105 write: IOPS=29, BW=116KiB/s (119kB/s)(6236KiB/53648msec); 0 zone resets clat (usec): min=793, max=680709, avg=15959.91, stdev=20837.68 lat (usec): min=795, max=680711, avg=15961.04, stdev=20837.92 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2040], 10.00th=[ 2704], 20.00th=[ 3654], | 30.00th=[ 6259], 40.00th=[ 10028], 50.00th=[ 13173], 60.00th=[ 16450], | 70.00th=[ 20317], 80.00th=[ 25035], 90.00th=[ 32637], 95.00th=[ 38011], | 99.00th=[ 56886], 99.50th=[ 64226], 99.90th=[ 79168], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 39, max= 191, per=25.08%, avg=117.13, stdev=30.80, samples=105 iops : min= 9, max= 47, avg=28.90, stdev= 7.73, samples=105 lat (usec) : 50=0.10%, 100=0.55%, 250=0.75%, 500=0.03%, 1000=0.20% lat (msec) : 2=2.21%, 4=8.85%, 10=14.88%, 20=38.57%, 50=32.39% lat (msec) : 100=1.43%, 750=0.03% cpu : usr=0.14%, sys=20.77%, ctx=8671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=446KiB/s (457kB/s), 111KiB/s-115KiB/s (114kB/s-117kB/s), io=23.4MiB (24.6MB), run=52614-53798msec WRITE: bw=467KiB/s (479kB/s), 116KiB/s-119KiB/s (119kB/s-122kB/s), io=24.6MiB (25.7MB), run=52614-53798msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188276: Thu Jun 25 01:01:54 2026 read: IOPS=22, BW=90.1KiB/s (92.3kB/s)(5992KiB/66493msec) clat (msec): min=3, max=638, avg=18.51, stdev=20.88 lat (msec): min=3, max=638, avg=18.51, stdev=20.88 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 72], 99.50th=[ 81], 99.90th=[ 107], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 23, max= 256, per=25.10%, avg=90.35, stdev=44.86, samples=131 iops : min= 5, max= 64, avg=22.20, stdev=11.32, samples=131 write: IOPS=23, BW=94.7KiB/s (96.0kB/s)(6296KiB/66493msec); 0 zone resets clat (msec): min=4, max=136, avg=24.54, stdev=14.59 lat (msec): min=4, max=136, avg=24.54, stdev=14.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 84], 99.90th=[ 92], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 39, max= 224, per=25.21%, avg=95.05, stdev=42.30, samples=131 iops : min= 9, max= 56, avg=23.37, stdev=10.72, samples=131 lat (msec) : 4=0.20%, 10=17.77%, 20=41.63%, 50=35.71%, 100=4.56% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=10.34%, ctx=5844, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188277: Thu Jun 25 01:01:54 2026 read: IOPS=22, BW=89.4KiB/s (91.6kB/s)(5940KiB/66415msec) clat (msec): min=2, max=682, avg=18.76, stdev=21.76 lat (msec): min=2, max=682, avg=18.77, stdev=21.75 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 67], 99.50th=[ 77], 99.90th=[ 83], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 256, per=24.99%, avg=89.98, stdev=46.06, samples=131 iops : min= 3, max= 64, avg=22.11, stdev=11.61, samples=131 write: IOPS=23, BW=95.6KiB/s (97.9kB/s)(6348KiB/66415msec); 0 zone resets clat (msec): min=5, max=116, avg=24.19, stdev=14.37 lat (msec): min=5, max=116, avg=24.20, stdev=14.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 102], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 39, max= 216, per=25.42%, avg=95.85, stdev=42.80, samples=131 iops : min= 9, max= 54, avg=23.57, stdev=10.85, samples=131 lat (msec) : 4=0.23%, 10=17.87%, 20=41.37%, 50=35.90%, 100=4.52% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=10.34%, ctx=5775, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188278: Thu Jun 25 01:01:54 2026 read: IOPS=22, BW=91.1KiB/s (93.2kB/s)(6028KiB/66195msec) clat (usec): min=3629, max=89010, avg=18231.54, stdev=13197.89 lat (usec): min=3631, max=89011, avg=18235.07, stdev=13197.75 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5669], 10.00th=[ 6652], 20.00th=[ 8586], | 30.00th=[10290], 40.00th=[11863], 50.00th=[13698], 60.00th=[16057], | 70.00th=[19792], 80.00th=[25822], 90.00th=[36963], 95.00th=[45876], | 99.00th=[65274], 99.50th=[69731], 99.90th=[82314], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 15, max= 272, per=25.39%, avg=91.41, stdev=46.31, samples=130 iops : min= 3, max= 68, avg=22.46, stdev=11.73, samples=130 write: IOPS=23, BW=94.6KiB/s (96.8kB/s)(6260KiB/66195msec); 0 zone resets clat (msec): min=5, max=701, avg=24.65, stdev=22.76 lat (msec): min=5, max=701, avg=24.65, stdev=22.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 72], 99.50th=[ 87], 99.90th=[ 138], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 39, max= 232, per=25.13%, avg=94.74, stdev=43.83, samples=130 iops : min= 9, max= 58, avg=23.29, stdev=11.09, samples=130 lat (msec) : 4=0.20%, 10=18.59%, 20=41.86%, 50=34.08%, 100=5.11% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=10.36%, ctx=5834, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188279: Thu Jun 25 01:01:54 2026 read: IOPS=22, BW=90.9KiB/s (93.1kB/s)(6052KiB/66546msec) clat (msec): min=3, max=106, avg=18.23, stdev=13.22 lat (msec): min=3, max=106, avg=18.23, stdev=13.22 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 103], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 23, max= 248, per=25.25%, avg=90.90, stdev=43.88, samples=131 iops : min= 5, max= 62, avg=22.34, stdev=11.08, samples=131 write: IOPS=23, BW=93.7KiB/s (95.0kB/s)(6236KiB/66546msec); 0 zone resets clat (msec): min=5, max=730, avg=24.90, stdev=23.28 lat (msec): min=5, max=730, avg=24.90, stdev=23.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 140], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 31, max= 240, per=24.89%, avg=93.83, stdev=44.40, samples=131 iops : min= 7, max= 60, avg=23.07, stdev=11.22, samples=131 lat (msec) : 4=0.16%, 10=18.98%, 20=40.69%, 50=35.12%, 100=4.85% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.08%, sys=10.20%, ctx=5825, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=361KiB/s (369kB/s), 89.4KiB/s-91.1KiB/s (91.6kB/s-93.2kB/s), io=23.4MiB (24.6MB), run=66195-66546msec WRITE: bw=378KiB/s (387kB/s), 93.7KiB/s-95.6KiB/s (95.0kB/s-97.9kB/s), io=24.6MiB (25.7MB), run=66195-66546msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188318: Thu Jun 25 01:02:14 2026 read: IOPS=25, BW=411KiB/s (421kB/s)(5920KiB/14406msec) clat (usec): min=63, max=67439, avg=19976.62, stdev=9997.80 lat (usec): min=64, max=67440, avg=19977.62, stdev=9997.72 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 8455], 10.00th=[ 9896], 20.00th=[11994], | 30.00th=[14222], 40.00th=[16450], 50.00th=[19006], 60.00th=[21103], | 70.00th=[23200], 80.00th=[26608], 90.00th=[31589], 95.00th=[36439], | 99.00th=[59507], 99.50th=[62129], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 159, max= 542, per=24.75%, avg=404.96, stdev=94.96, samples=28 iops : min= 9, max= 33, avg=24.75, stdev= 6.02, samples=28 write: IOPS=27, BW=442KiB/s (453kB/s)(6368KiB/14406msec); 0 zone resets clat (usec): min=1067, max=59037, avg=17520.98, stdev=11676.15 lat (usec): min=1069, max=59039, avg=17522.39, stdev=11676.22 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 3818], 10.00th=[ 4686], 20.00th=[ 7177], | 30.00th=[ 9634], 40.00th=[12387], 50.00th=[14877], 60.00th=[17957], | 70.00th=[21627], 80.00th=[26346], 90.00th=[35914], 95.00th=[40633], | 99.00th=[52691], 99.50th=[58459], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 224, max= 669, per=25.62%, avg=441.18, stdev=106.89, samples=28 iops : min= 14, max= 41, avg=27.00, stdev= 6.69, samples=28 lat (usec) : 100=0.39%, 250=1.04%, 500=0.13% lat (msec) : 2=0.52%, 4=2.47%, 10=16.67%, 20=39.45%, 50=37.76% lat (msec) : 100=1.56% cpu : usr=0.12%, sys=25.28%, ctx=2843, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188319: Thu Jun 25 01:02:14 2026 read: IOPS=25, BW=401KiB/s (410kB/s)(5744KiB/14333msec) clat (usec): min=73, max=64066, avg=20441.87, stdev=10634.91 lat (usec): min=73, max=64067, avg=20442.80, stdev=10634.94 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 7242], 10.00th=[10028], 20.00th=[12256], | 30.00th=[14615], 40.00th=[16450], 50.00th=[18482], 60.00th=[21365], | 70.00th=[24511], 80.00th=[27657], 90.00th=[34866], 95.00th=[39060], | 99.00th=[58459], 99.50th=[60031], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 159, max= 608, per=24.42%, avg=399.50, stdev=106.40, samples=28 iops : min= 9, max= 38, avg=24.39, stdev= 6.64, samples=28 write: IOPS=28, BW=457KiB/s (468kB/s)(6544KiB/14333msec); 0 zone resets clat (usec): min=1253, max=68539, avg=16968.86, stdev=12111.90 lat (usec): min=1254, max=68541, avg=16970.60, stdev=12111.86 clat percentiles (usec): | 1.00th=[ 2540], 5.00th=[ 3785], 10.00th=[ 4686], 20.00th=[ 6521], | 30.00th=[ 9110], 40.00th=[11207], 50.00th=[13566], 60.00th=[16712], | 70.00th=[20841], 80.00th=[25297], 90.00th=[34866], 95.00th=[41157], | 99.00th=[57934], 99.50th=[60031], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 286, max= 640, per=26.44%, avg=455.25, stdev=83.77, samples=28 iops : min= 17, max= 40, avg=27.86, stdev= 5.54, samples=28 lat (usec) : 100=0.52%, 250=1.04%, 500=0.13% lat (msec) : 2=0.26%, 4=2.99%, 10=17.71%, 20=39.58%, 50=35.68% lat (msec) : 100=2.08% cpu : usr=0.18%, sys=25.49%, ctx=2698, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188320: Thu Jun 25 01:02:14 2026 read: IOPS=26, BW=428KiB/s (438kB/s)(6256KiB/14633msec) clat (usec): min=34, max=71567, avg=20209.09, stdev=11067.89 lat (usec): min=34, max=71569, avg=20210.05, stdev=11067.94 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 7963], 10.00th=[10028], 20.00th=[12256], | 30.00th=[14091], 40.00th=[15926], 50.00th=[18220], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26084], 90.00th=[32900], 95.00th=[41681], | 99.00th=[62653], 99.50th=[66323], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 223, max= 608, per=25.74%, avg=421.11, stdev=99.95, samples=28 iops : min= 13, max= 38, avg=25.75, stdev= 6.49, samples=28 write: IOPS=25, BW=412KiB/s (422kB/s)(6032KiB/14633msec); 0 zone resets clat (usec): min=1017, max=88774, avg=17725.70, stdev=12052.59 lat (usec): min=1018, max=88776, avg=17727.45, stdev=12052.61 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 4080], 10.00th=[ 4948], 20.00th=[ 7832], | 30.00th=[10159], 40.00th=[12387], 50.00th=[14877], 60.00th=[17695], | 70.00th=[21627], 80.00th=[26346], 90.00th=[34341], 95.00th=[41157], | 99.00th=[55837], 99.50th=[63177], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 191, max= 574, per=22.96%, avg=395.29, stdev=101.12, samples=28 iops : min= 11, max= 35, avg=24.14, stdev= 6.25, samples=28 lat (usec) : 50=0.13%, 100=0.39%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=0.39%, 4=1.56%, 10=15.89%, 20=42.06%, 50=36.20% lat (msec) : 100=2.08% cpu : usr=0.09%, sys=24.64%, ctx=2762, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188321: Thu Jun 25 01:02:14 2026 read: IOPS=26, BW=424KiB/s (435kB/s)(6032KiB/14215msec) clat (usec): min=71, max=69672, avg=20030.85, stdev=10231.23 lat (usec): min=72, max=69672, avg=20031.70, stdev=10231.24 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 147], 10.00th=[ 9634], 20.00th=[12387], | 30.00th=[14877], 40.00th=[16909], 50.00th=[19530], 60.00th=[21890], | 70.00th=[24249], 80.00th=[27395], 90.00th=[32637], 95.00th=[36439], | 99.00th=[52167], 99.50th=[63701], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 254, max= 512, per=25.74%, avg=421.07, stdev=67.97, samples=28 iops : min= 15, max= 32, avg=25.75, stdev= 4.36, samples=28 write: IOPS=27, BW=440KiB/s (451kB/s)(6256KiB/14215msec); 0 zone resets clat (usec): min=1482, max=64011, avg=16898.59, stdev=11675.69 lat (usec): min=1483, max=64013, avg=16900.18, stdev=11675.60 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 3982], 10.00th=[ 4752], 20.00th=[ 6783], | 30.00th=[ 9372], 40.00th=[11338], 50.00th=[13829], 60.00th=[17171], | 70.00th=[20841], 80.00th=[25822], 90.00th=[32375], 95.00th=[41157], | 99.00th=[55313], 99.50th=[62129], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 223, max= 672, per=25.53%, avg=439.64, stdev=105.68, samples=28 iops : min= 13, max= 42, avg=26.89, stdev= 6.65, samples=28 lat (usec) : 100=0.91%, 250=1.95% lat (msec) : 2=0.26%, 4=2.47%, 10=17.06%, 20=38.67%, 50=37.37% lat (msec) : 100=1.30% cpu : usr=0.12%, sys=25.38%, ctx=2613, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1637KiB/s (1676kB/s), 401KiB/s-428KiB/s (410kB/s-438kB/s), io=23.4MiB (24.5MB), run=14215-14633msec WRITE: bw=1722KiB/s (1763kB/s), 412KiB/s-457KiB/s (422kB/s-468kB/s), io=24.6MiB (25.8MB), run=14215-14633msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188323: Thu Jun 25 01:02:16 2026 read: IOPS=22, BW=361KiB/s (369kB/s)(5920KiB/16413msec) clat (usec): min=3609, max=78494, avg=18559.54, stdev=13528.09 lat (usec): min=3610, max=78495, avg=18560.30, stdev=13528.10 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 5276], 10.00th=[ 6128], 20.00th=[ 8160], | 30.00th=[ 9896], 40.00th=[11469], 50.00th=[13698], 60.00th=[16909], | 70.00th=[21103], 80.00th=[26608], 90.00th=[39584], 95.00th=[46400], | 99.00th=[62129], 99.50th=[66323], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 127, max= 960, per=23.97%, avg=349.78, stdev=178.52, samples=32 iops : min= 7, max= 60, avg=21.37, stdev=11.33, samples=32 write: IOPS=24, BW=388KiB/s (397kB/s)(6368KiB/16413msec); 0 zone resets clat (usec): min=5117, max=80401, avg=23874.93, stdev=15798.93 lat (usec): min=5119, max=80403, avg=23876.55, stdev=15798.96 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 7373], 10.00th=[ 8291], 20.00th=[ 9896], | 30.00th=[12649], 40.00th=[15139], 50.00th=[18744], 60.00th=[23987], | 70.00th=[28705], 80.00th=[35914], 90.00th=[47973], 95.00th=[55313], | 99.00th=[74974], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 127, max= 1152, per=24.96%, avg=383.16, stdev=208.56, samples=32 iops : min= 7, max= 72, avg=23.47, stdev=13.19, samples=32 lat (msec) : 4=0.78%, 10=25.00%, 20=34.77%, 50=33.46%, 100=5.99% cpu : usr=0.07%, sys=12.59%, ctx=1597, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188324: Thu Jun 25 01:02:16 2026 read: IOPS=21, BW=351KiB/s (360kB/s)(5744KiB/16354msec) clat (usec): min=4157, max=82291, avg=18717.72, stdev=13867.83 lat (usec): min=4158, max=82293, avg=18718.48, stdev=13867.84 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 5932], 10.00th=[ 6849], 20.00th=[ 8356], | 30.00th=[10028], 40.00th=[11207], 50.00th=[12911], 60.00th=[16450], | 70.00th=[19530], 80.00th=[27919], 90.00th=[40109], 95.00th=[49021], | 99.00th=[64750], 99.50th=[76022], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 127, max= 960, per=24.00%, avg=350.12, stdev=168.30, samples=32 iops : min= 7, max= 60, avg=21.41, stdev=10.76, samples=32 write: IOPS=25, BW=400KiB/s (410kB/s)(6544KiB/16354msec); 0 zone resets clat (usec): min=5839, max=81804, avg=23281.57, stdev=14763.25 lat (usec): min=5841, max=81806, avg=23283.32, stdev=14763.15 clat percentiles (usec): | 1.00th=[ 6652], 5.00th=[ 7439], 10.00th=[ 8356], 20.00th=[10552], | 30.00th=[12780], 40.00th=[14877], 50.00th=[18220], 60.00th=[23200], | 70.00th=[29230], 80.00th=[36963], 90.00th=[44827], 95.00th=[51643], | 99.00th=[64750], 99.50th=[71828], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 188, max= 1152, per=25.79%, avg=395.81, stdev=222.74, samples=32 iops : min= 11, max= 72, avg=24.25, stdev=14.09, samples=32 lat (msec) : 10=23.05%, 20=38.67%, 50=33.07%, 100=5.21% cpu : usr=0.12%, sys=12.73%, ctx=1599, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188325: Thu Jun 25 01:02:16 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(6256KiB/16342msec) clat (usec): min=3332, max=79618, avg=18430.36, stdev=13050.98 lat (usec): min=3333, max=79619, avg=18432.67, stdev=13051.61 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 5145], 10.00th=[ 6063], 20.00th=[ 7767], | 30.00th=[ 9896], 40.00th=[12125], 50.00th=[13960], 60.00th=[16712], | 70.00th=[22152], 80.00th=[28705], 90.00th=[38536], 95.00th=[44827], | 99.00th=[62653], 99.50th=[74974], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 157, max= 1440, per=26.21%, avg=382.41, stdev=244.11, samples=32 iops : min= 9, max= 90, avg=23.44, stdev=15.40, samples=32 write: IOPS=23, BW=369KiB/s (378kB/s)(6032KiB/16342msec); 0 zone resets clat (usec): min=5879, max=85476, avg=23913.38, stdev=15615.21 lat (usec): min=5881, max=85479, avg=23915.04, stdev=15615.42 clat percentiles (usec): | 1.00th=[ 6587], 5.00th=[ 7439], 10.00th=[ 8455], 20.00th=[10683], | 30.00th=[12518], 40.00th=[14746], 50.00th=[19006], 60.00th=[23462], | 70.00th=[29754], 80.00th=[37487], 90.00th=[46400], 95.00th=[54789], | 99.00th=[74974], 99.50th=[82314], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 94, max= 960, per=23.66%, avg=363.19, stdev=188.28, samples=32 iops : min= 5, max= 60, avg=22.22, stdev=11.94, samples=32 lat (msec) : 4=0.39%, 10=24.09%, 20=35.55%, 50=35.42%, 100=4.56% cpu : usr=0.07%, sys=12.61%, ctx=1603, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188326: Thu Jun 25 01:02:16 2026 read: IOPS=23, BW=370KiB/s (378kB/s)(6032KiB/16321msec) clat (usec): min=3627, max=70671, avg=18675.58, stdev=14080.85 lat (usec): min=3628, max=70672, avg=18676.42, stdev=14080.83 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5276], 10.00th=[ 6063], 20.00th=[ 8029], | 30.00th=[10028], 40.00th=[11863], 50.00th=[13698], 60.00th=[16319], | 70.00th=[19268], 80.00th=[27132], 90.00th=[42730], 95.00th=[49546], | 99.00th=[64750], 99.50th=[69731], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 95, max= 1088, per=25.20%, avg=367.72, stdev=228.80, samples=32 iops : min= 5, max= 68, avg=22.50, stdev=14.48, samples=32 write: IOPS=23, BW=383KiB/s (393kB/s)(6256KiB/16321msec); 0 zone resets clat (usec): min=5120, max=88172, avg=23457.26, stdev=14294.74 lat (usec): min=5120, max=88173, avg=23458.76, stdev=14294.82 clat percentiles (usec): | 1.00th=[ 5997], 5.00th=[ 7373], 10.00th=[ 8717], 20.00th=[11600], | 30.00th=[13566], 40.00th=[16188], 50.00th=[19792], 60.00th=[23987], | 70.00th=[28443], 80.00th=[33817], 90.00th=[43254], 95.00th=[53740], | 99.00th=[64750], 99.50th=[79168], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 209, max= 1024, per=24.98%, avg=383.44, stdev=190.70, samples=32 iops : min= 13, max= 64, avg=23.50, stdev=12.10, samples=32 lat (msec) : 4=0.13%, 10=22.79%, 20=37.76%, 50=33.85%, 100=5.47% cpu : usr=0.02%, sys=12.82%, ctx=1603, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1459KiB/s (1494kB/s), 351KiB/s-383KiB/s (360kB/s-392kB/s), io=23.4MiB (24.5MB), run=16321-16413msec WRITE: bw=1535KiB/s (1572kB/s), 369KiB/s-400KiB/s (378kB/s-410kB/s), io=24.6MiB (25.8MB), run=16321-16413msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188333: Thu Jun 25 01:02:24 2026 read: IOPS=2, BW=2555KiB/s (2616kB/s)(7168KiB/2806msec) clat (msec): min=17, max=441, avg=127.10, stdev=146.45 lat (msec): min=17, max=441, avg=127.10, stdev=146.44 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 39], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 83], 60.00th=[ 101], | 70.00th=[ 101], 80.00th=[ 159], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1943, max= 5269, per=42.29%, avg=3086.67, stdev=1890.69, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1825KiB/s (1868kB/s)(5120KiB/2806msec); 0 zone resets clat (msec): min=40, max=563, avg=376.37, stdev=204.38 lat (msec): min=40, max=563, avg=376.44, stdev=204.38 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2039, max= 2048, per=20.01%, avg=2045.00, stdev= 5.20, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (msec) : 20=8.33%, 50=25.00%, 100=8.33%, 250=16.67%, 500=25.00% lat (msec) : 750=16.67% cpu : usr=0.00%, sys=12.23%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188334: Thu Jun 25 01:02:24 2026 read: IOPS=0, BW=758KiB/s (776kB/s)(2048KiB/2702msec) clat (usec): min=49453, max=51028, avg=50240.88, stdev=1113.46 lat (usec): min=49454, max=51030, avg=50242.51, stdev=1114.52 clat percentiles (usec): | 1.00th=[49546], 5.00th=[49546], 10.00th=[49546], 20.00th=[49546], | 30.00th=[49546], 40.00th=[49546], 50.00th=[49546], 60.00th=[51119], | 70.00th=[51119], 80.00th=[51119], 90.00th=[51119], 95.00th=[51119], | 99.00th=[51119], 99.50th=[51119], 99.90th=[51119], 99.95th=[51119], | 99.99th=[51119] bw ( KiB/s): min= 1735, max= 2048, per=25.92%, avg=1891.50, stdev=221.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3790KiB/s (3881kB/s)(10.0MiB/2702msec); 0 zone resets clat (msec): min=41, max=548, avg=255.17, stdev=182.01 lat (msec): min=41, max=548, avg=255.24, stdev=182.00 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 47], | 30.00th=[ 52], 40.00th=[ 169], 50.00th=[ 236], 60.00th=[ 300], | 70.00th=[ 309], 80.00th=[ 355], 90.00th=[ 498], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1943, max= 6942, per=33.39%, avg=3412.00, stdev=2167.07, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 1.92, samples=5 lat (msec) : 50=25.00%, 100=16.67%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=20.44%, ctx=288, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188335: Thu Jun 25 01:02:24 2026 read: IOPS=2, BW=2586KiB/s (2648kB/s)(6144KiB/2376msec) clat (msec): min=55, max=299, avg=143.93, stdev=102.46 lat (msec): min=55, max=299, avg=143.93, stdev=102.46 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 105], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2048, max= 3886, per=42.96%, avg=3135.00, stdev=963.97, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=2, BW=2586KiB/s (2648kB/s)(6144KiB/2376msec); 0 zone resets clat (msec): min=55, max=498, avg=250.38, stdev=170.61 lat (msec): min=55, max=498, avg=250.43, stdev=170.60 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 264], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2048, max= 5206, per=30.35%, avg=3100.67, stdev=1823.27, samples=3 iops : min= 2, max= 5, avg= 3.00, stdev= 1.73, samples=3 lat (msec) : 100=41.67%, 250=16.67%, 500=41.67% cpu : usr=0.00%, sys=16.42%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188336: Thu Jun 25 01:02:24 2026 read: IOPS=2, BW=2115KiB/s (2166kB/s)(5120KiB/2421msec) clat (msec): min=73, max=348, avg=187.20, stdev=118.01 lat (msec): min=73, max=348, avg=187.20, stdev=118.01 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 3886, max= 4096, per=54.69%, avg=3991.00, stdev=148.49, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2961KiB/s (3032kB/s)(7168KiB/2421msec); 0 zone resets clat (msec): min=46, max=544, avg=209.00, stdev=207.57 lat (msec): min=46, max=544, avg=209.07, stdev=207.58 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 62], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 103], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 464], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2048, max= 7013, per=44.34%, avg=4530.50, stdev=3510.79, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=12.23%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7299KiB/s (7474kB/s), 758KiB/s-2586KiB/s (776kB/s-2648kB/s), io=20.0MiB (20.0MB), run=2376-2806msec WRITE: bw=9.98MiB/s (10.5MB/s), 1825KiB/s-3790KiB/s (1868kB/s-3881kB/s), io=28.0MiB (29.4MB), run=2376-2806msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188338: Thu Jun 25 01:02:24 2026 read: IOPS=3, BW=3873KiB/s (3965kB/s)(7168KiB/1851msec) clat (usec): min=474, max=195274, avg=133955.07, stdev=65942.04 lat (usec): min=475, max=195276, avg=133956.26, stdev=65942.09 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[102237], | 30.00th=[145753], 40.00th=[145753], 50.00th=[149947], 60.00th=[164627], | 70.00th=[164627], 80.00th=[181404], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 4096, max= 5862, per=62.68%, avg=4979.00, stdev=1248.75, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2766KiB/s (2832kB/s)(5120KiB/1851msec); 0 zone resets clat (msec): min=117, max=250, avg=182.30, stdev=54.30 lat (msec): min=117, max=251, avg=182.36, stdev=54.29 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 2048, max= 6144, per=36.83%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=60.54%, ctx=814, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188339: Thu Jun 25 01:02:24 2026 read: IOPS=0, BW=794KiB/s (813kB/s)(2048KiB/2578msec) clat (msec): min=119, max=382, avg=250.86, stdev=186.27 lat (msec): min=119, max=382, avg=250.87, stdev=186.27 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1943, max= 2048, per=25.12%, avg=1995.50, stdev=74.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3972KiB/s (4067kB/s)(10.0MiB/2578msec); 0 zone resets clat (msec): min=91, max=366, avg=207.38, stdev=102.11 lat (msec): min=91, max=366, avg=207.43, stdev=102.11 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 117], | 30.00th=[ 140], 40.00th=[ 142], 50.00th=[ 165], 60.00th=[ 178], | 70.00th=[ 199], 80.00th=[ 338], 90.00th=[ 342], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 4096, max= 6144, per=41.44%, avg=4608.00, stdev=1024.00, samples=4 iops : min= 4, max= 6, avg= 4.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=49.44%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188340: Thu Jun 25 01:02:24 2026 read: IOPS=2, BW=2606KiB/s (2668kB/s)(6144KiB/2358msec) clat (usec): min=348, max=121546, avg=41618.73, stdev=59363.69 lat (usec): min=349, max=121547, avg=41619.73, stdev=59363.80 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 457], | 30.00th=[ 457], 40.00th=[ 570], 50.00th=[ 570], 60.00th=[ 12387], | 70.00th=[114820], 80.00th=[114820], 90.00th=[121111], 95.00th=[121111], | 99.00th=[121111], 99.50th=[121111], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 2048, max= 4096, per=42.97%, avg=3413.33, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2606KiB/s (2668kB/s)(6144KiB/2358msec); 0 zone resets clat (msec): min=131, max=633, avg=351.14, stdev=228.33 lat (msec): min=131, max=633, avg=351.20, stdev=228.33 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 321], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2048, max= 3864, per=22.50%, avg=2502.00, stdev=908.00, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 20=8.33%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=40.60%, ctx=532, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188341: Thu Jun 25 01:02:24 2026 read: IOPS=2, BW=2057KiB/s (2106kB/s)(5120KiB/2489msec) clat (usec): min=420, max=51304, avg=10647.61, stdev=22727.67 lat (usec): min=421, max=51304, avg=10648.52, stdev=22727.36 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 537], 80.00th=[ 537], 90.00th=[51119], 95.00th=[51119], | 99.00th=[51119], 99.50th=[51119], 99.90th=[51119], 99.95th=[51119], | 99.99th=[51119] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2880KiB/s (2949kB/s)(7168KiB/2489msec); 0 zone resets clat (msec): min=98, max=670, avg=344.73, stdev=225.46 lat (msec): min=98, max=670, avg=344.79, stdev=225.46 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 122], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 405], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 514], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1943, max= 4096, per=30.38%, avg=3378.33, stdev=1243.04, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 lat (usec) : 500=16.67%, 750=16.67% lat (msec) : 100=16.67%, 250=16.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=33.00%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7944KiB/s (8135kB/s), 794KiB/s-3873KiB/s (813kB/s-3965kB/s), io=20.0MiB (20.0MB), run=1851-2578msec WRITE: bw=10.9MiB/s (11.4MB/s), 2606KiB/s-3972KiB/s (2668kB/s-4067kB/s), io=28.0MiB (29.4MB), run=1851-2578msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188348: Thu Jun 25 01:02:32 2026 read: IOPS=2, BW=8672KiB/s (8880kB/s)(12.0MiB/1417msec) clat (msec): min=381, max=502, avg=434.67, stdev=62.19 lat (msec): min=381, max=502, avg=434.68, stdev=62.19 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 5497, max= 8126, per=58.91%, avg=6811.50, stdev=1858.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=53.25%, ctx=1836, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188349: Thu Jun 25 01:02:32 2026 read: IOPS=0, BW=3279KiB/s (3358kB/s)(4096KiB/1249msec) clat (nsec): min=381755k, max=381755k, avg=381755174.00, stdev= 0.00 lat (nsec): min=381756k, max=381756k, avg=381756282.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 8047, max= 8047, per=69.60%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6559KiB/s (6716kB/s)(8192KiB/1249msec); 0 zone resets clat (msec): min=343, max=396, avg=369.90, stdev=37.19 lat (msec): min=343, max=396, avg=370.13, stdev=37.19 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 8126, max= 8126, per=43.70%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=25.48%, ctx=590, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188350: Thu Jun 25 01:02:32 2026 write: IOPS=1, BW=6974KiB/s (7141kB/s)(12.0MiB/1762msec); 0 zone resets clat (msec): min=174, max=910, avg=543.20, stdev=367.78 lat (msec): min=175, max=910, avg=543.52, stdev=367.89 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=44.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.30%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188351: Thu Jun 25 01:02:32 2026 write: IOPS=2, BW=8715KiB/s (8924kB/s)(12.0MiB/1410msec); 0 zone resets clat (msec): min=175, max=886, avg=425.48, stdev=399.97 lat (msec): min=175, max=887, avg=425.82, stdev=399.99 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7984, max= 8126, per=43.31%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=21.50%, ctx=212, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.3MiB/s (11.8MB/s), 3279KiB/s-8672KiB/s (3358kB/s-8880kB/s), io=16.0MiB (16.8MB), run=1249-1417msec WRITE: bw=18.2MiB/s (19.0MB/s), 6559KiB/s-8715KiB/s (6716kB/s-8924kB/s), io=32.0MiB (33.6MB), run=1249-1762msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188352: Thu Jun 25 01:02:32 2026 read: IOPS=1, BW=7038KiB/s (7207kB/s)(12.0MiB/1746msec) clat (msec): min=56, max=1056, avg=576.32, stdev=501.35 lat (msec): min=56, max=1056, avg=576.32, stdev=501.35 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8192, max= 8192, per=87.31%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.32%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188353: Thu Jun 25 01:02:32 2026 read: IOPS=0, BW=2478KiB/s (2537kB/s)(4096KiB/1653msec) clat (nsec): min=428192k, max=428192k, avg=428191514.00, stdev= 0.00 lat (nsec): min=428194k, max=428194k, avg=428193962.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5626, max= 5626, per=59.96%, avg=5626.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4956KiB/s (5075kB/s)(8192KiB/1653msec); 0 zone resets clat (msec): min=554, max=629, avg=591.91, stdev=52.52 lat (msec): min=555, max=629, avg=592.20, stdev=52.49 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8192, max= 8192, per=41.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=15.74%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188354: Thu Jun 25 01:02:32 2026 write: IOPS=1, BW=7923KiB/s (8113kB/s)(12.0MiB/1551msec); 0 zone resets clat (msec): min=191, max=728, avg=499.56, stdev=276.73 lat (msec): min=192, max=728, avg=499.78, stdev=276.70 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8192, max= 8192, per=41.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.77%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188355: Thu Jun 25 01:02:32 2026 write: IOPS=1, BW=8132KiB/s (8328kB/s)(12.0MiB/1511msec); 0 zone resets clat (msec): min=179, max=583, avg=428.65, stdev=218.07 lat (msec): min=179, max=583, avg=428.95, stdev=218.10 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 5649, max= 8192, per=34.91%, avg=6920.50, stdev=1798.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=30.86%, ctx=246, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9384KiB/s (9609kB/s), 2478KiB/s-7038KiB/s (2537kB/s-7207kB/s), io=16.0MiB (16.8MB), run=1653-1746msec WRITE: bw=19.4MiB/s (20.3MB/s), 4956KiB/s-8132KiB/s (5075kB/s-8328kB/s), io=32.0MiB (33.6MB), run=1511-1653msec