== sanity test 398b: DIO and buffer IO race ============== 23:53:40 (1764737620) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.98449 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181797: Tue Dec 2 23:54:44 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(5992KiB/53003msec) clat (usec): min=99, max=812049, avg=19427.22, stdev=22881.26 lat (usec): min=101, max=812049, avg=19428.36, stdev=22881.26 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 7504], 10.00th=[ 9110], 20.00th=[ 10945], | 30.00th=[ 12518], 40.00th=[ 14877], 50.00th=[ 17433], 60.00th=[ 19530], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 52167], 99.50th=[ 64750], 99.90th=[ 81265], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 13, max= 183, per=25.38%, avg=112.96, stdev=28.00, samples=105 iops : min= 3, max= 45, avg=27.90, stdev= 6.98, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6296KiB/53003msec); 0 zone resets clat (usec): min=670, max=97146, avg=15053.81, stdev=12747.19 lat (usec): min=671, max=97147, avg=15055.24, stdev=12747.18 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2089], 10.00th=[ 2606], 20.00th=[ 3392], | 30.00th=[ 4948], 40.00th=[ 9241], 50.00th=[11863], 60.00th=[14877], | 70.00th=[19268], 80.00th=[25560], 90.00th=[33162], 95.00th=[39060], | 99.00th=[55837], 99.50th=[61080], 99.90th=[77071], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 32, max= 200, per=25.75%, avg=119.99, stdev=33.42, samples=104 iops : min= 8, max= 50, avg=29.65, stdev= 8.44, samples=104 lat (usec) : 100=0.03%, 250=0.23%, 500=1.01%, 750=0.33%, 1000=0.39% lat (msec) : 2=1.92%, 4=10.68%, 10=13.70%, 20=38.54%, 50=31.64% lat (msec) : 100=1.50%, 1000=0.03% cpu : usr=0.16%, sys=23.56%, ctx=8941, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181798: Tue Dec 2 23:54:44 2025 read: IOPS=27, BW=112KiB/s (115kB/s)(5940KiB/53046msec) clat (usec): min=133, max=83986, avg=19032.70, stdev=10667.13 lat (usec): min=134, max=83987, avg=19034.09, stdev=10667.20 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 7701], 10.00th=[ 8979], 20.00th=[10683], | 30.00th=[12649], 40.00th=[14484], 50.00th=[16712], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25822], 90.00th=[32637], 95.00th=[38536], | 99.00th=[58983], 99.50th=[63701], 99.90th=[71828], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 6, max= 200, per=25.13%, avg=111.81, stdev=32.34, samples=105 iops : min= 1, max= 50, avg=27.61, stdev= 8.13, samples=105 write: IOPS=29, BW=120KiB/s (123kB/s)(6348KiB/53046msec); 0 zone resets clat (usec): min=852, max=809992, avg=15477.64, stdev=23667.17 lat (usec): min=853, max=809994, avg=15478.99, stdev=23667.19 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2180], 10.00th=[ 2638], 20.00th=[ 3458], | 30.00th=[ 5276], 40.00th=[ 9110], 50.00th=[ 11994], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 24249], 90.00th=[ 32637], 95.00th=[ 40633], | 99.00th=[ 56361], 99.50th=[ 63177], 99.90th=[ 86508], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 6, max= 199, per=25.56%, avg=119.11, stdev=33.48, samples=105 iops : min= 1, max= 49, avg=29.44, stdev= 8.42, samples=105 lat (usec) : 250=0.26%, 500=0.55%, 750=0.23%, 1000=0.26% lat (msec) : 2=1.76%, 4=10.55%, 10=15.79%, 20=38.57%, 50=30.37% lat (msec) : 100=1.63%, 1000=0.03% cpu : usr=0.17%, sys=23.48%, ctx=8859, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181799: Tue Dec 2 23:54:44 2025 read: IOPS=27, BW=112KiB/s (114kB/s)(6028KiB/53946msec) clat (usec): min=142, max=119307, avg=19209.07, stdev=11232.08 lat (usec): min=143, max=119307, avg=19210.47, stdev=11232.10 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 7177], 10.00th=[ 8979], 20.00th=[ 10814], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 17171], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 25822], 90.00th=[ 32637], 95.00th=[ 39060], | 99.00th=[ 58459], 99.50th=[ 68682], 99.90th=[ 91751], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 8, max= 215, per=25.23%, avg=112.26, stdev=31.06, samples=106 iops : min= 2, max= 53, avg=27.72, stdev= 7.73, samples=106 write: IOPS=29, BW=116KiB/s (119kB/s)(6260KiB/53946msec); 0 zone resets clat (usec): min=869, max=843345, avg=15829.27, stdev=24654.96 lat (usec): min=870, max=843346, avg=15831.47, stdev=24655.17 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2089], 10.00th=[ 2573], 20.00th=[ 3425], | 30.00th=[ 5342], 40.00th=[ 9110], 50.00th=[ 12125], 60.00th=[ 15664], | 70.00th=[ 19792], 80.00th=[ 25035], 90.00th=[ 33424], 95.00th=[ 41157], | 99.00th=[ 56886], 99.50th=[ 61604], 99.90th=[ 89654], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 24, max= 231, per=24.97%, avg=116.35, stdev=35.26, samples=106 iops : min= 6, max= 57, avg=28.74, stdev= 8.87, samples=106 lat (usec) : 250=0.10%, 500=1.04%, 750=0.29%, 1000=0.39% lat (msec) : 2=2.02%, 4=10.25%, 10=15.59%, 20=35.81%, 50=32.39% lat (msec) : 100=2.05%, 250=0.03%, 1000=0.03% cpu : usr=0.16%, sys=23.31%, ctx=9009, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181800: Tue Dec 2 23:54:44 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53586msec) clat (usec): min=131, max=102727, avg=19197.59, stdev=11155.89 lat (usec): min=132, max=102730, avg=19198.81, stdev=11155.97 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 7635], 10.00th=[ 8848], 20.00th=[ 10683], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 17171], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 25822], 90.00th=[ 32375], 95.00th=[ 38011], | 99.00th=[ 58983], 99.50th=[ 69731], 99.90th=[ 89654], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 16, max= 200, per=25.38%, avg=112.96, stdev=26.77, samples=105 iops : min= 4, max= 50, avg=27.90, stdev= 6.75, samples=105 write: IOPS=29, BW=116KiB/s (119kB/s)(6236KiB/53586msec); 0 zone resets clat (usec): min=681, max=833019, avg=15596.51, stdev=24247.83 lat (usec): min=682, max=833022, avg=15598.47, stdev=24247.62 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2114], 10.00th=[ 2573], 20.00th=[ 3326], | 30.00th=[ 5342], 40.00th=[ 9241], 50.00th=[ 11994], 60.00th=[ 15139], | 70.00th=[ 19268], 80.00th=[ 25297], 90.00th=[ 33424], 95.00th=[ 39584], | 99.00th=[ 54789], 99.50th=[ 60031], 99.90th=[ 83362], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 32, max= 207, per=25.06%, avg=116.77, stdev=33.93, samples=105 iops : min= 8, max= 51, avg=28.85, stdev= 8.50, samples=105 lat (usec) : 250=0.10%, 500=0.81%, 750=0.42%, 1000=0.29% lat (msec) : 2=1.95%, 4=10.38%, 10=15.17%, 20=37.04%, 50=31.97% lat (msec) : 100=1.79%, 250=0.03%, 1000=0.03% cpu : usr=0.20%, sys=23.34%, ctx=9108, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=445KiB/s (456kB/s), 112KiB/s-113KiB/s (114kB/s-116kB/s), io=23.4MiB (24.6MB), run=53003-53946msec WRITE: bw=466KiB/s (477kB/s), 116KiB/s-120KiB/s (119kB/s-123kB/s), io=24.6MiB (25.7MB), run=53003-53946msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181792: Tue Dec 2 23:54:55 2025 read: IOPS=22, BW=91.5KiB/s (93.7kB/s)(5992KiB/65459msec) clat (msec): min=3, max=821, avg=18.46, stdev=25.27 lat (msec): min=3, max=821, avg=18.46, stdev=25.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 66], 99.50th=[ 71], 99.90th=[ 103], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 24, max= 264, per=25.14%, avg=91.74, stdev=57.35, samples=129 iops : min= 6, max= 66, avg=22.63, stdev=14.43, samples=129 write: IOPS=24, BW=96.2KiB/s (98.5kB/s)(6296KiB/65459msec); 0 zone resets clat (msec): min=5, max=126, avg=23.86, stdev=16.13 lat (msec): min=5, max=126, avg=23.87, stdev=16.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 81], 99.50th=[ 86], 99.90th=[ 121], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 8, max= 280, per=25.23%, avg=96.40, stdev=58.00, samples=129 iops : min= 2, max= 70, avg=23.79, stdev=14.62, samples=129 lat (msec) : 4=0.03%, 10=26.76%, 20=35.29%, 50=31.90%, 100=5.86% lat (msec) : 250=0.13%, 1000=0.03% cpu : usr=0.16%, sys=10.36%, ctx=5737, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181794: Tue Dec 2 23:54:55 2025 read: IOPS=22, BW=90.6KiB/s (92.8kB/s)(5940KiB/65578msec) clat (msec): min=3, max=821, avg=18.22, stdev=25.23 lat (msec): min=3, max=821, avg=18.22, stdev=25.23 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 49], | 99.00th=[ 68], 99.50th=[ 78], 99.90th=[ 112], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8, max= 288, per=24.83%, avg=90.63, stdev=58.24, samples=129 iops : min= 2, max= 72, avg=22.35, stdev=14.65, samples=129 write: IOPS=24, BW=96.8KiB/s (99.1kB/s)(6348KiB/65578msec); 0 zone resets clat (msec): min=5, max=116, avg=24.12, stdev=16.34 lat (msec): min=5, max=116, avg=24.12, stdev=16.34 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 46], 95.00th=[ 57], | 99.00th=[ 82], 99.50th=[ 90], 99.90th=[ 105], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 16, max= 312, per=25.23%, avg=96.40, stdev=56.64, samples=129 iops : min= 4, max= 78, avg=23.79, stdev=14.26, samples=129 lat (msec) : 4=0.10%, 10=25.68%, 20=36.69%, 50=31.25%, 100=6.15% lat (msec) : 250=0.10%, 1000=0.03% cpu : usr=0.15%, sys=10.41%, ctx=5661, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181795: Tue Dec 2 23:54:55 2025 read: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6028KiB/65727msec) clat (msec): min=3, max=107, avg=18.07, stdev=15.35 lat (msec): min=3, max=107, avg=18.07, stdev=15.35 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 69], 99.50th=[ 80], 99.90th=[ 103], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 23, max= 280, per=25.07%, avg=91.52, stdev=57.62, samples=128 iops : min= 5, max= 70, avg=22.57, stdev=14.52, samples=128 write: IOPS=23, BW=95.2KiB/s (97.5kB/s)(6260KiB/65727msec); 0 zone resets clat (msec): min=4, max=827, avg=24.44, stdev=26.07 lat (msec): min=4, max=827, avg=24.44, stdev=26.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 47], 95.00th=[ 57], | 99.00th=[ 81], 99.50th=[ 96], 99.90th=[ 127], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 24, max= 280, per=24.67%, avg=94.22, stdev=57.31, samples=129 iops : min= 6, max= 70, avg=23.25, stdev=14.42, samples=129 lat (msec) : 4=0.29%, 10=26.14%, 20=36.39%, 50=30.70%, 100=6.18% lat (msec) : 250=0.26%, 1000=0.03% cpu : usr=0.17%, sys=10.22%, ctx=5704, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181796: Tue Dec 2 23:54:55 2025 read: IOPS=23, BW=92.3KiB/s (94.6kB/s)(6052KiB/65534msec) clat (usec): min=3890, max=98634, avg=17715.24, stdev=14205.06 lat (usec): min=3892, max=98635, avg=17716.59, stdev=14204.93 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5538], 10.00th=[ 6325], 20.00th=[ 7308], | 30.00th=[ 8586], 40.00th=[10028], 50.00th=[12125], 60.00th=[14615], | 70.00th=[19268], 80.00th=[26870], 90.00th=[39060], 95.00th=[47973], | 99.00th=[65799], 99.50th=[72877], 99.90th=[94897], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 8, max= 280, per=25.24%, avg=92.12, stdev=58.01, samples=129 iops : min= 2, max= 70, avg=22.72, stdev=14.59, samples=129 write: IOPS=23, BW=95.2KiB/s (97.4kB/s)(6236KiB/65534msec); 0 zone resets clat (msec): min=6, max=829, avg=24.69, stdev=26.21 lat (msec): min=6, max=829, avg=24.69, stdev=26.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 79], 99.50th=[ 87], 99.90th=[ 114], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 31, max= 264, per=24.93%, avg=95.22, stdev=57.43, samples=129 iops : min= 7, max= 66, avg=23.50, stdev=14.47, samples=129 lat (msec) : 4=0.03%, 10=26.92%, 20=35.74%, 50=30.63%, 100=6.54% lat (msec) : 250=0.10%, 1000=0.03% cpu : usr=0.16%, sys=10.50%, ctx=5769, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=365KiB/s (374kB/s), 90.6KiB/s-92.3KiB/s (92.8kB/s-94.6kB/s), io=23.4MiB (24.6MB), run=65459-65727msec WRITE: bw=382KiB/s (392kB/s), 95.2KiB/s-96.8KiB/s (97.4kB/s-99.1kB/s), io=24.6MiB (25.7MB), run=65459-65727msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181828: Tue Dec 2 23:55:17 2025 read: IOPS=23, BW=374KiB/s (383kB/s)(5920KiB/15841msec) clat (usec): min=155, max=95739, avg=21943.68, stdev=12342.84 lat (usec): min=156, max=95741, avg=21944.98, stdev=12343.09 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 8094], 10.00th=[10421], 20.00th=[13435], | 30.00th=[15139], 40.00th=[17171], 50.00th=[19792], 60.00th=[22938], | 70.00th=[25297], 80.00th=[28705], 90.00th=[35914], 95.00th=[43779], | 99.00th=[72877], 99.50th=[83362], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 223, max= 697, per=24.85%, avg=371.06, stdev=92.79, samples=31 iops : min= 13, max= 43, avg=22.55, stdev= 5.84, samples=31 write: IOPS=25, BW=402KiB/s (412kB/s)(6368KiB/15841msec); 0 zone resets clat (usec): min=1466, max=90857, avg=19281.72, stdev=14534.81 lat (usec): min=1468, max=90858, avg=19284.30, stdev=14535.01 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 3589], 10.00th=[ 4621], 20.00th=[ 6063], | 30.00th=[ 9110], 40.00th=[12518], 50.00th=[15270], 60.00th=[19530], | 70.00th=[24773], 80.00th=[30278], 90.00th=[40109], 95.00th=[48497], | 99.00th=[68682], 99.50th=[71828], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 221, max= 574, per=25.50%, avg=400.65, stdev=101.83, samples=31 iops : min= 13, max= 35, avg=24.39, stdev= 6.36, samples=31 lat (usec) : 250=0.13%, 500=1.30%, 750=0.39%, 1000=0.13% lat (msec) : 2=0.65%, 4=2.99%, 10=15.76%, 20=34.64%, 50=40.89% lat (msec) : 100=3.12% cpu : usr=0.08%, sys=25.31%, ctx=2660, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181829: Tue Dec 2 23:55:17 2025 read: IOPS=23, BW=376KiB/s (385kB/s)(5744KiB/15290msec) clat (usec): min=98, max=79560, avg=22054.01, stdev=11574.42 lat (usec): min=100, max=79560, avg=22055.20, stdev=11574.46 clat percentiles (usec): | 1.00th=[ 297], 5.00th=[ 8225], 10.00th=[10421], 20.00th=[12780], | 30.00th=[15533], 40.00th=[17957], 50.00th=[20579], 60.00th=[22938], | 70.00th=[26346], 80.00th=[30540], 90.00th=[36963], 95.00th=[44827], | 99.00th=[54264], 99.50th=[68682], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 189, max= 510, per=25.20%, avg=376.17, stdev=91.22, samples=30 iops : min= 11, max= 31, avg=22.83, stdev= 5.68, samples=30 write: IOPS=26, BW=428KiB/s (438kB/s)(6544KiB/15290msec); 0 zone resets clat (usec): min=1433, max=69630, avg=17877.83, stdev=13997.43 lat (usec): min=1436, max=69634, avg=17880.37, stdev=13997.51 clat percentiles (usec): | 1.00th=[ 2409], 5.00th=[ 3228], 10.00th=[ 4293], 20.00th=[ 5538], | 30.00th=[ 8094], 40.00th=[11731], 50.00th=[14222], 60.00th=[17957], | 70.00th=[21627], 80.00th=[26084], 90.00th=[36963], 95.00th=[49021], | 99.00th=[63177], 99.50th=[65799], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 254, max= 766, per=27.35%, avg=429.73, stdev=129.59, samples=30 iops : min= 15, max= 47, avg=26.20, stdev= 8.19, samples=30 lat (usec) : 100=0.13%, 250=0.26%, 500=1.17%, 750=0.52%, 1000=0.13% lat (msec) : 2=0.39%, 4=4.04%, 10=16.02%, 20=34.64%, 50=39.58% lat (msec) : 100=3.12% cpu : usr=0.14%, sys=25.64%, ctx=2673, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181830: Tue Dec 2 23:55:17 2025 read: IOPS=24, BW=390KiB/s (400kB/s)(6256KiB/16033msec) clat (usec): min=206, max=82655, avg=22209.62, stdev=13395.46 lat (usec): min=206, max=82657, avg=22210.90, stdev=13395.46 clat percentiles (usec): | 1.00th=[ 277], 5.00th=[ 388], 10.00th=[ 9765], 20.00th=[12780], | 30.00th=[15401], 40.00th=[17957], 50.00th=[20317], 60.00th=[23462], | 70.00th=[26084], 80.00th=[30016], 90.00th=[38011], 95.00th=[44827], | 99.00th=[77071], 99.50th=[79168], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 191, max= 606, per=26.00%, avg=388.23, stdev=115.92, samples=31 iops : min= 11, max= 37, avg=23.61, stdev= 7.30, samples=31 write: IOPS=23, BW=376KiB/s (385kB/s)(6032KiB/16033msec); 0 zone resets clat (usec): min=1309, max=91114, avg=19137.87, stdev=14172.01 lat (usec): min=1312, max=91118, avg=19140.68, stdev=14171.65 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3621], 10.00th=[ 4621], 20.00th=[ 7242], | 30.00th=[ 9896], 40.00th=[13042], 50.00th=[15664], 60.00th=[19006], | 70.00th=[23725], 80.00th=[29230], 90.00th=[38536], 95.00th=[46924], | 99.00th=[71828], 99.50th=[80217], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 191, max= 606, per=23.26%, avg=365.48, stdev=97.53, samples=31 iops : min= 11, max= 37, avg=22.19, stdev= 6.01, samples=31 lat (usec) : 250=0.26%, 500=2.99%, 750=0.13%, 1000=0.26% lat (msec) : 2=0.65%, 4=2.60%, 10=13.67%, 20=35.42%, 50=40.36% lat (msec) : 100=3.65% cpu : usr=0.17%, sys=24.77%, ctx=2654, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181831: Tue Dec 2 23:55:17 2025 read: IOPS=24, BW=396KiB/s (406kB/s)(6032KiB/15219msec) clat (usec): min=177, max=80282, avg=21757.83, stdev=12334.32 lat (usec): min=178, max=80283, avg=21759.08, stdev=12334.39 clat percentiles (usec): | 1.00th=[ 237], 5.00th=[ 449], 10.00th=[ 5997], 20.00th=[13304], | 30.00th=[16188], 40.00th=[18482], 50.00th=[20841], 60.00th=[23200], | 70.00th=[26346], 80.00th=[29754], 90.00th=[36439], 95.00th=[41157], | 99.00th=[64226], 99.50th=[65799], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 191, max= 540, per=26.46%, avg=395.03, stdev=88.01, samples=30 iops : min= 11, max= 33, avg=24.03, stdev= 5.56, samples=30 write: IOPS=25, BW=411KiB/s (421kB/s)(6256KiB/15219msec); 0 zone resets clat (usec): min=1585, max=58916, avg=17610.83, stdev=12623.91 lat (usec): min=1587, max=58918, avg=17613.37, stdev=12624.02 clat percentiles (usec): | 1.00th=[ 2040], 5.00th=[ 3490], 10.00th=[ 4080], 20.00th=[ 5604], | 30.00th=[ 8717], 40.00th=[11207], 50.00th=[14615], 60.00th=[17957], | 70.00th=[22676], 80.00th=[29230], 90.00th=[36963], 95.00th=[41681], | 99.00th=[55313], 99.50th=[55837], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 223, max= 638, per=26.22%, avg=411.93, stdev=103.47, samples=30 iops : min= 13, max= 39, avg=25.07, stdev= 6.48, samples=30 lat (usec) : 250=0.65%, 500=2.34%, 750=1.30%, 1000=0.39% lat (msec) : 2=0.39%, 4=4.56%, 10=14.06%, 20=31.25%, 50=42.58% lat (msec) : 100=2.47% cpu : usr=0.18%, sys=25.22%, ctx=2604, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1494KiB/s (1530kB/s), 374KiB/s-396KiB/s (383kB/s-406kB/s), io=23.4MiB (24.5MB), run=15219-16033msec WRITE: bw=1572KiB/s (1609kB/s), 376KiB/s-428KiB/s (385kB/s-438kB/s), io=24.6MiB (25.8MB), run=15219-16033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181824: Tue Dec 2 23:55:21 2025 read: IOPS=18, BW=298KiB/s (305kB/s)(5920KiB/19886msec) clat (msec): min=4, max=118, avg=22.18, stdev=15.04 lat (msec): min=4, max=118, avg=22.18, stdev=15.04 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 69], 99.50th=[ 114], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 96, max= 576, per=24.32%, avg=291.87, stdev=118.68, samples=39 iops : min= 6, max= 36, avg=17.77, stdev= 7.61, samples=39 write: IOPS=20, BW=320KiB/s (328kB/s)(6368KiB/19886msec); 0 zone resets clat (usec): min=8174, max=96152, avg=29016.40, stdev=16871.99 lat (usec): min=8177, max=96155, avg=29019.33, stdev=16871.86 clat percentiles (usec): | 1.00th=[ 8291], 5.00th=[10814], 10.00th=[12518], 20.00th=[14484], | 30.00th=[17433], 40.00th=[20055], 50.00th=[23725], 60.00th=[27919], | 70.00th=[34866], 80.00th=[43254], 90.00th=[53740], 95.00th=[62129], | 99.00th=[83362], 99.50th=[91751], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 64, max= 640, per=25.16%, avg=317.56, stdev=122.24, samples=39 iops : min= 4, max= 40, avg=19.38, stdev= 7.68, samples=39 lat (msec) : 10=7.42%, 20=41.28%, 50=42.19%, 100=8.85%, 250=0.26% cpu : usr=0.15%, sys=11.09%, ctx=1583, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181825: Tue Dec 2 23:55:21 2025 read: IOPS=17, BW=288KiB/s (295kB/s)(5744KiB/19953msec) clat (msec): min=4, max=115, avg=23.52, stdev=16.91 lat (msec): min=4, max=115, avg=23.52, stdev=16.91 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 77], 99.50th=[ 111], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 127, max= 542, per=23.72%, avg=284.67, stdev=103.95, samples=39 iops : min= 7, max= 33, avg=17.33, stdev= 6.56, samples=39 write: IOPS=20, BW=328KiB/s (336kB/s)(6544KiB/19953msec); 0 zone resets clat (usec): min=7051, max=99481, avg=28061.89, stdev=16530.96 lat (usec): min=7053, max=99482, avg=28064.98, stdev=16530.67 clat percentiles (usec): | 1.00th=[ 8848], 5.00th=[10552], 10.00th=[11863], 20.00th=[14353], | 30.00th=[16909], 40.00th=[19792], 50.00th=[22676], 60.00th=[26870], | 70.00th=[33162], 80.00th=[40633], 90.00th=[53216], 95.00th=[58983], | 99.00th=[79168], 99.50th=[92799], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 127, max= 800, per=25.24%, avg=318.54, stdev=128.91, samples=39 iops : min= 7, max= 50, avg=19.46, stdev= 8.21, samples=39 lat (msec) : 10=8.72%, 20=39.19%, 50=41.02%, 100=10.81%, 250=0.26% cpu : usr=0.15%, sys=10.83%, ctx=1638, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181826: Tue Dec 2 23:55:21 2025 read: IOPS=19, BW=316KiB/s (324kB/s)(6256KiB/19802msec) clat (msec): min=6, max=167, avg=22.36, stdev=16.85 lat (msec): min=6, max=167, avg=22.36, stdev=16.85 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 58], | 99.00th=[ 73], 99.50th=[ 107], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 128, max= 736, per=26.38%, avg=316.56, stdev=140.50, samples=39 iops : min= 8, max= 46, avg=19.33, stdev= 8.82, samples=39 write: IOPS=19, BW=305KiB/s (312kB/s)(6032KiB/19802msec); 0 zone resets clat (msec): min=7, max=129, avg=29.12, stdev=17.88 lat (msec): min=7, max=129, avg=29.13, stdev=17.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 94], 99.50th=[ 101], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 95, max= 640, per=23.78%, avg=300.13, stdev=120.07, samples=39 iops : min= 5, max= 40, avg=18.31, stdev= 7.67, samples=39 lat (msec) : 10=8.72%, 20=41.67%, 50=39.45%, 100=9.77%, 250=0.39% cpu : usr=0.17%, sys=11.27%, ctx=1636, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181827: Tue Dec 2 23:55:21 2025 read: IOPS=19, BW=308KiB/s (315kB/s)(6032KiB/19614msec) clat (msec): min=5, max=111, avg=21.98, stdev=15.77 lat (msec): min=5, max=111, avg=21.98, stdev=15.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 90], 99.50th=[ 105], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 128, max= 672, per=25.19%, avg=302.24, stdev=128.62, samples=38 iops : min= 8, max= 42, avg=18.42, stdev= 8.16, samples=38 write: IOPS=19, BW=319KiB/s (327kB/s)(6256KiB/19614msec); 0 zone resets clat (msec): min=8, max=128, avg=28.81, stdev=18.04 lat (msec): min=8, max=128, avg=28.81, stdev=18.04 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 62], | 99.00th=[ 94], 99.50th=[ 110], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 127, max= 606, per=24.99%, avg=315.42, stdev=114.43, samples=38 iops : min= 7, max= 37, avg=19.24, stdev= 7.18, samples=38 lat (msec) : 10=8.33%, 20=43.75%, 50=38.80%, 100=8.59%, 250=0.52% cpu : usr=0.15%, sys=11.27%, ctx=1592, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1200KiB/s (1229kB/s), 288KiB/s-316KiB/s (295kB/s-324kB/s), io=23.4MiB (24.5MB), run=19614-19953msec WRITE: bw=1263KiB/s (1293kB/s), 305KiB/s-328KiB/s (312kB/s-336kB/s), io=24.6MiB (25.8MB), run=19614-19953msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181843: Tue Dec 2 23:55:31 2025 read: IOPS=2, BW=2562KiB/s (2623kB/s)(7168KiB/2798msec) clat (usec): min=792, max=200290, avg=96119.67, stdev=71521.97 lat (usec): min=793, max=200290, avg=96120.91, stdev=71521.92 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 1745], | 30.00th=[114820], 40.00th=[114820], 50.00th=[115868], 60.00th=[120062], | 70.00th=[120062], 80.00th=[120062], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 1996, max= 5380, per=67.04%, avg=3805.00, stdev=1704.09, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1830KiB/s (1874kB/s)(5120KiB/2798msec); 0 zone resets clat (msec): min=175, max=590, avg=404.20, stdev=158.01 lat (msec): min=175, max=590, avg=404.28, stdev=158.03 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2043, max= 3992, per=33.91%, avg=2694.33, stdev=1123.82, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=45.91%, ctx=818, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181845: Tue Dec 2 23:55:31 2025 read: IOPS=0, BW=568KiB/s (581kB/s)(2048KiB/3608msec) clat (msec): min=130, max=189, avg=159.66, stdev=41.66 lat (msec): min=130, max=189, avg=159.66, stdev=41.66 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1787, max= 1996, per=33.32%, avg=1891.50, stdev=147.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2838KiB/s (2906kB/s)(10.0MiB/3608msec); 0 zone resets clat (msec): min=162, max=593, avg=310.95, stdev=144.68 lat (msec): min=162, max=593, avg=311.06, stdev=144.67 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 171], | 30.00th=[ 184], 40.00th=[ 222], 50.00th=[ 245], 60.00th=[ 309], | 70.00th=[ 342], 80.00th=[ 422], 90.00th=[ 468], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1996, max= 4096, per=38.44%, avg=3054.83, stdev=1137.33, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.51, samples=6 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=44.00%, ctx=455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181847: Tue Dec 2 23:55:31 2025 read: IOPS=2, BW=2069KiB/s (2119kB/s)(6144KiB/2969msec) clat (usec): min=807, max=365144, avg=164562.64, stdev=143670.64 lat (usec): min=808, max=365146, avg=164563.88, stdev=143670.77 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 1188], | 30.00th=[ 1188], 40.00th=[156238], 50.00th=[156238], 60.00th=[217056], | 70.00th=[246416], 80.00th=[246416], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1996, max= 4039, per=44.60%, avg=2531.50, stdev=1005.27, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=2, BW=2069KiB/s (2119kB/s)(6144KiB/2969msec); 0 zone resets clat (msec): min=148, max=766, avg=326.23, stdev=226.75 lat (msec): min=148, max=766, avg=326.36, stdev=226.74 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 284], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2019, max= 3531, per=30.33%, avg=2410.25, stdev=747.27, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=43.15%, ctx=423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181849: Tue Dec 2 23:55:31 2025 read: IOPS=1, BW=1566KiB/s (1603kB/s)(5120KiB/3270msec) clat (usec): min=880, max=112232, avg=33691.45, stdev=49132.91 lat (usec): min=882, max=112233, avg=33692.64, stdev=49132.77 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[ 1516], 40.00th=[ 1516], 50.00th=[ 1582], 60.00th=[ 1582], | 70.00th=[ 52167], 80.00th=[ 52167], 90.00th=[112722], 95.00th=[112722], | 99.00th=[112722], 99.50th=[112722], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2192KiB/s (2245kB/s)(7168KiB/3270msec); 0 zone resets clat (msec): min=80, max=1213, avg=431.03, stdev=400.87 lat (msec): min=81, max=1213, avg=431.11, stdev=400.89 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 125], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 326], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 659], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2048, max= 4071, per=42.61%, avg=3386.00, stdev=1158.85, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 100=16.67%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=33.07%, ctx=270, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5676KiB/s (5813kB/s), 568KiB/s-2562KiB/s (581kB/s-2623kB/s), io=20.0MiB (20.0MB), run=2798-3608msec WRITE: bw=7947KiB/s (8138kB/s), 1830KiB/s-2838KiB/s (1874kB/s-2906kB/s), io=28.0MiB (29.4MB), run=2798-3608msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181842: Tue Dec 2 23:55:31 2025 read: IOPS=2, BW=2780KiB/s (2847kB/s)(7168KiB/2578msec) clat (msec): min=43, max=305, avg=157.67, stdev=90.88 lat (msec): min=43, max=305, avg=157.68, stdev=90.88 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 75], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 182], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 203], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2031, max= 5278, per=57.11%, avg=3119.00, stdev=1869.77, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1986KiB/s (2034kB/s)(5120KiB/2578msec); 0 zone resets clat (msec): min=125, max=647, avg=292.37, stdev=220.17 lat (msec): min=125, max=647, avg=292.50, stdev=220.18 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2031, max= 2048, per=26.64%, avg=2036.67, stdev= 9.81, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.08%, sys=13.66%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181844: Tue Dec 2 23:55:31 2025 read: IOPS=0, BW=546KiB/s (559kB/s)(2048KiB/3750msec) clat (msec): min=115, max=463, avg=289.20, stdev=245.84 lat (msec): min=115, max=463, avg=289.20, stdev=245.84 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1996, max= 2048, per=37.03%, avg=2022.00, stdev=36.77, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2731KiB/s (2796kB/s)(10.0MiB/3750msec); 0 zone resets clat (msec): min=62, max=601, avg=298.80, stdev=188.22 lat (msec): min=62, max=601, avg=298.90, stdev=188.23 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 114], | 30.00th=[ 136], 40.00th=[ 184], 50.00th=[ 247], 60.00th=[ 321], | 70.00th=[ 351], 80.00th=[ 384], 90.00th=[ 592], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2031, max= 4039, per=35.26%, avg=2696.00, stdev=1022.21, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=16.27%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181846: Tue Dec 2 23:55:31 2025 read: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3515msec) clat (msec): min=57, max=420, avg=177.46, stdev=128.13 lat (msec): min=57, max=420, avg=177.46, stdev=128.13 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 163], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2031, max= 3992, per=46.19%, avg=2522.25, stdev=979.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3515msec); 0 zone resets clat (msec): min=304, max=553, avg=397.97, stdev=84.49 lat (msec): min=304, max=557, avg=398.70, stdev=85.91 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 384], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1996, max= 4096, per=33.22%, avg=2539.50, stdev=1037.81, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=13.63%, ctx=347, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181848: Tue Dec 2 23:55:31 2025 read: IOPS=1, BW=1385KiB/s (1419kB/s)(5120KiB/3696msec) clat (msec): min=30, max=243, avg=133.68, stdev=92.85 lat (msec): min=30, max=243, avg=133.69, stdev=92.85 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 95], 60.00th=[ 95], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1996, max= 6107, per=74.19%, avg=4051.50, stdev=2906.92, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1939KiB/s (1986kB/s)(7168KiB/3696msec); 0 zone resets clat (msec): min=154, max=1008, avg=423.24, stdev=288.41 lat (msec): min=154, max=1008, avg=423.36, stdev=288.45 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 251], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 321], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 550], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1996, max= 4096, per=39.77%, avg=3040.50, stdev=1186.19, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=21.54%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5461KiB/s (5592kB/s), 546KiB/s-2780KiB/s (559kB/s-2847kB/s), io=20.0MiB (20.0MB), run=2578-3750msec WRITE: bw=7646KiB/s (7829kB/s), 1748KiB/s-2731KiB/s (1790kB/s-2796kB/s), io=28.0MiB (29.4MB), run=2578-3750msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181856: Tue Dec 2 23:55:40 2025 read: IOPS=1, BW=7581KiB/s (7762kB/s)(12.0MiB/1621msec) clat (msec): min=435, max=608, avg=520.42, stdev=86.83 lat (msec): min=435, max=608, avg=520.42, stdev=86.83 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=51.17%, ctx=2267, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181857: Tue Dec 2 23:55:40 2025 read: IOPS=0, BW=2325KiB/s (2380kB/s)(4096KiB/1762msec) clat (nsec): min=507918k, max=507918k, avg=507918232.00, stdev= 0.00 lat (nsec): min=507922k, max=507922k, avg=507922009.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 8192, max= 8192, per=88.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4649KiB/s (4761kB/s)(8192KiB/1762msec); 0 zone resets clat (msec): min=500, max=681, avg=591.22, stdev=127.68 lat (msec): min=501, max=682, avg=591.83, stdev=127.77 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=53.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.11%, sys=21.07%, ctx=911, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181858: Tue Dec 2 23:55:40 2025 write: IOPS=1, BW=5793KiB/s (5933kB/s)(12.0MiB/2121msec); 0 zone resets clat (msec): min=141, max=1366, avg=697.22, stdev=620.59 lat (msec): min=141, max=1367, avg=698.00, stdev=620.81 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=53.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.09%, sys=17.45%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181859: Tue Dec 2 23:55:40 2025 write: IOPS=1, BW=7571KiB/s (7753kB/s)(12.0MiB/1623msec); 0 zone resets clat (msec): min=270, max=988, avg=522.97, stdev=403.26 lat (msec): min=271, max=988, avg=523.64, stdev=403.33 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min=10966, max=10966, per=70.98%, avg=10966.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=18.68%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9299KiB/s (9522kB/s), 2325KiB/s-7581KiB/s (2380kB/s-7762kB/s), io=16.0MiB (16.8MB), run=1621-1762msec WRITE: bw=15.1MiB/s (15.8MB/s), 4649KiB/s-7571KiB/s (4761kB/s-7753kB/s), io=32.0MiB (33.6MB), run=1623-2121msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181860: Tue Dec 2 23:55:40 2025 read: IOPS=1, BW=6846KiB/s (7010kB/s)(12.0MiB/1795msec) clat (msec): min=401, max=855, avg=584.81, stdev=238.85 lat (msec): min=401, max=855, avg=584.81, stdev=238.85 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7892, max= 8031, per=100.00%, avg=7961.50, stdev=98.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.44%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181861: Tue Dec 2 23:55:40 2025 read: IOPS=0, BW=1977KiB/s (2024kB/s)(4096KiB/2072msec) clat (nsec): min=1011.5M, max=1011.5M, avg=1011476222.00, stdev= 0.00 lat (nsec): min=1011.5M, max=1011.5M, avg=1011478899.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7892, max= 7892, per=99.81%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3954KiB/s (4049kB/s)(8192KiB/2072msec); 0 zone resets clat (msec): min=431, max=546, avg=488.99, stdev=80.92 lat (msec): min=432, max=547, avg=490.00, stdev=81.26 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8031, max= 8031, per=50.78%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.14%, sys=25.74%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181862: Tue Dec 2 23:55:40 2025 write: IOPS=1, BW=6341KiB/s (6493kB/s)(12.0MiB/1938msec); 0 zone resets clat (msec): min=135, max=1167, avg=613.20, stdev=520.16 lat (msec): min=135, max=1167, avg=613.82, stdev=520.06 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8031, per=50.78%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=14.56%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181863: Tue Dec 2 23:55:40 2025 write: IOPS=1, BW=7190KiB/s (7363kB/s)(12.0MiB/1709msec); 0 zone resets clat (msec): min=507, max=629, avg=564.18, stdev=61.30 lat (msec): min=508, max=629, avg=564.91, stdev=61.15 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5634, max= 7892, per=42.77%, avg=6763.00, stdev=1596.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.06%, sys=23.65%, ctx=98, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7907KiB/s (8097kB/s), 1977KiB/s-6846KiB/s (2024kB/s-7010kB/s), io=16.0MiB (16.8MB), run=1795-2072msec WRITE: bw=15.4MiB/s (16.2MB/s), 3954KiB/s-7190KiB/s (4049kB/s-7363kB/s), io=32.0MiB (33.6MB), run=1709-2072msec