== sanity test 398b: DIO and buffer IO race ============== 23:16:23 (1763352983) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.02819 s, 16.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147794: Sun Nov 16 23:18:23 2025 read: IOPS=13, BW=54.5KiB/s (55.8kB/s)(5992KiB/109912msec) clat (usec): min=102, max=745035, avg=19643.25, stdev=23605.16 lat (usec): min=103, max=745036, avg=19644.28, stdev=23605.15 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 383], 10.00th=[ 6980], 20.00th=[ 10290], | 30.00th=[ 12387], 40.00th=[ 14222], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22414], 80.00th=[ 27657], 90.00th=[ 33162], 95.00th=[ 40633], | 99.00th=[ 79168], 99.50th=[112722], 99.90th=[162530], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 8, max= 199, per=45.79%, avg=99.82, stdev=34.35, samples=119 iops : min= 2, max= 49, avg=24.41, stdev= 8.56, samples=119 write: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6296KiB/109912msec); 0 zone resets clat (usec): min=859, max=50890k, avg=50975.97, stdev=1282348.13 lat (usec): min=860, max=50890k, avg=50977.25, stdev=1282348.12 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1647], 10.00th=[ 2311], | 20.00th=[ 3523], 30.00th=[ 5735], 40.00th=[ 10683], | 50.00th=[ 15401], 60.00th=[ 19530], 70.00th=[ 23987], | 80.00th=[ 30540], 90.00th=[ 41157], 95.00th=[ 50594], | 99.00th=[ 72877], 99.50th=[ 82314], 99.90th=[ 217056], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 32, max= 239, per=46.36%, avg=105.70, stdev=33.40, samples=118 iops : min= 8, max= 59, avg=25.88, stdev= 8.35, samples=118 lat (usec) : 250=1.11%, 500=1.92%, 750=0.78%, 1000=0.49% lat (msec) : 2=3.68%, 4=7.85%, 10=13.15%, 20=33.14%, 50=34.21% lat (msec) : 100=3.22%, 250=0.39%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=9.87%, ctx=7833, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147796: Sun Nov 16 23:18:23 2025 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5940KiB/109795msec) clat (usec): min=110, max=165296, avg=19216.92, stdev=13083.51 lat (usec): min=110, max=165297, avg=19217.87, stdev=13083.67 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 363], 10.00th=[ 7635], 20.00th=[ 10290], | 30.00th=[ 12256], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19792], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 68682], 99.50th=[ 81265], 99.90th=[106431], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 7, max= 184, per=45.28%, avg=98.71, stdev=32.41, samples=118 iops : min= 1, max= 46, avg=24.14, stdev= 8.10, samples=118 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6348KiB/109795msec); 0 zone resets clat (usec): min=883, max=50921k, avg=51042.10, stdev=1277993.36 lat (usec): min=883, max=50921k, avg=51043.42, stdev=1277993.35 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1663], 10.00th=[ 2311], | 20.00th=[ 3458], 30.00th=[ 5669], 40.00th=[ 10814], | 50.00th=[ 15008], 60.00th=[ 18482], 70.00th=[ 23200], | 80.00th=[ 30540], 90.00th=[ 39584], 95.00th=[ 49021], | 99.00th=[ 87557], 99.50th=[ 137364], 99.90th=[ 675283], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 183, per=46.06%, avg=105.03, stdev=35.11, samples=118 iops : min= 1, max= 45, avg=25.71, stdev= 8.76, samples=118 lat (usec) : 250=1.37%, 500=1.60%, 750=0.39%, 1000=0.26% lat (msec) : 2=3.74%, 4=8.59%, 10=12.60%, 20=33.76%, 50=34.31% lat (msec) : 100=2.83%, 250=0.49%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=9.91%, ctx=7808, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147798: Sun Nov 16 23:18:23 2025 read: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6028KiB/108904msec) clat (usec): min=126, max=50879k, avg=52798.30, stdev=1310346.68 lat (usec): min=127, max=50879k, avg=52799.34, stdev=1310346.67 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 392], 10.00th=[ 7635], | 20.00th=[ 10290], 30.00th=[ 11994], 40.00th=[ 13960], | 50.00th=[ 16057], 60.00th=[ 18482], 70.00th=[ 21890], | 80.00th=[ 26608], 90.00th=[ 32900], 95.00th=[ 39060], | 99.00th=[ 65274], 99.50th=[ 88605], 99.90th=[ 750781], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 168, per=46.93%, avg=102.30, stdev=31.42, samples=117 iops : min= 1, max= 42, avg=25.03, stdev= 7.83, samples=117 write: IOPS=14, BW=57.5KiB/s (58.9kB/s)(6260KiB/108904msec); 0 zone resets clat (usec): min=799, max=204637, avg=18590.89, stdev=17461.72 lat (usec): min=800, max=204638, avg=18592.57, stdev=17461.44 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1532], 10.00th=[ 2147], 20.00th=[ 3294], | 30.00th=[ 5866], 40.00th=[ 11076], 50.00th=[ 15401], 60.00th=[ 19530], | 70.00th=[ 23987], 80.00th=[ 30016], 90.00th=[ 39060], 95.00th=[ 49021], | 99.00th=[ 72877], 99.50th=[104334], 99.90th=[137364], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 8, max= 183, per=46.57%, avg=106.19, stdev=31.71, samples=117 iops : min= 2, max= 45, avg=26.01, stdev= 7.91, samples=117 lat (usec) : 250=1.07%, 500=1.86%, 750=0.65%, 1000=0.33% lat (msec) : 2=4.17%, 4=7.81%, 10=12.70%, 20=34.54%, 50=33.43% lat (msec) : 100=3.06%, 250=0.33%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=9.94%, ctx=7758, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147800: Sun Nov 16 23:18:23 2025 read: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6052KiB/109823msec) clat (usec): min=90, max=119317, avg=18567.30, stdev=11588.61 lat (usec): min=91, max=119318, avg=18568.32, stdev=11588.55 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 363], 10.00th=[ 7373], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14222], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 26870], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 54789], 99.50th=[ 58983], 99.90th=[101188], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 8, max= 167, per=46.43%, avg=101.22, stdev=31.04, samples=117 iops : min= 2, max= 41, avg=24.76, stdev= 7.74, samples=117 write: IOPS=14, BW=56.8KiB/s (58.1kB/s)(6236KiB/109823msec); 0 zone resets clat (usec): min=822, max=50878k, avg=52260.88, stdev=1288299.45 lat (usec): min=822, max=50878k, avg=52262.28, stdev=1288299.45 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1532], 10.00th=[ 2212], | 20.00th=[ 3621], 30.00th=[ 6849], 40.00th=[ 12518], | 50.00th=[ 15664], 60.00th=[ 20055], 70.00th=[ 25297], | 80.00th=[ 30802], 90.00th=[ 39584], 95.00th=[ 49546], | 99.00th=[ 76022], 99.50th=[ 111674], 99.90th=[ 683672], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 8, max= 167, per=45.43%, avg=103.58, stdev=29.64, samples=118 iops : min= 2, max= 41, avg=25.36, stdev= 7.39, samples=118 lat (usec) : 100=0.03%, 250=1.50%, 500=1.63%, 750=0.65%, 1000=0.26% lat (msec) : 2=3.97%, 4=6.77%, 10=11.98%, 20=34.54%, 50=35.58% lat (msec) : 100=2.73%, 250=0.29%, 750=0.03%, >=2000=0.03% cpu : usr=0.09%, sys=9.80%, ctx=7943, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=218KiB/s (224kB/s), 54.1KiB/s-55.4KiB/s (55.4kB/s-56.7kB/s), io=23.4MiB (24.6MB), run=108904-109912msec WRITE: bw=229KiB/s (234kB/s), 56.8KiB/s-57.8KiB/s (58.1kB/s-59.2kB/s), io=24.6MiB (25.7MB), run=108904-109912msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147795: Sun Nov 16 23:19:17 2025 read: IOPS=9, BW=36.6KiB/s (37.4kB/s)(5992KiB/163898msec) clat (msec): min=3, max=756, avg=18.68, stdev=25.16 lat (msec): min=3, max=756, avg=18.69, stdev=25.16 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 84], 99.50th=[ 110], 99.90th=[ 226], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 143, per=36.13%, avg=52.75, stdev=30.78, samples=223 iops : min= 1, max= 35, avg=12.75, stdev= 7.77, samples=223 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6296KiB/163898msec); 0 zone resets clat (msec): min=15, max=50981, avg=86.19, stdev=1283.93 lat (msec): min=15, max=50981, avg=86.19, stdev=1283.93 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 42], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 62], 80.00th=[ 71], 90.00th=[ 90], 95.00th=[ 104], | 99.00th=[ 144], 99.50th=[ 186], 99.90th=[ 241], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 112, per=36.07%, avg=55.19, stdev=23.64, samples=224 iops : min= 1, max= 28, avg=13.36, stdev= 6.01, samples=224 lat (msec) : 4=0.03%, 10=17.45%, 20=16.50%, 50=42.22%, 100=20.28% lat (msec) : 250=3.45%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.25%, ctx=5992, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147797: Sun Nov 16 23:19:17 2025 read: IOPS=9, BW=36.3KiB/s (37.1kB/s)(5940KiB/163804msec) clat (msec): min=3, max=699, avg=18.08, stdev=23.69 lat (msec): min=3, max=699, avg=18.08, stdev=23.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 73], 99.50th=[ 107], 99.90th=[ 224], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 152, per=36.18%, avg=52.82, stdev=32.11, samples=222 iops : min= 1, max= 38, avg=12.77, stdev= 8.11, samples=222 write: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6348KiB/163804msec); 0 zone resets clat (msec): min=19, max=50960, avg=86.14, stdev=1278.13 lat (msec): min=19, max=50960, avg=86.15, stdev=1278.13 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 62], 80.00th=[ 74], 90.00th=[ 92], 95.00th=[ 106], | 99.00th=[ 150], 99.50th=[ 174], 99.90th=[ 228], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 119, per=36.28%, avg=55.52, stdev=23.70, samples=225 iops : min= 1, max= 29, avg=13.44, stdev= 6.00, samples=225 lat (msec) : 4=0.03%, 10=17.68%, 20=16.73%, 50=41.60%, 100=20.31% lat (msec) : 250=3.58%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.28%, ctx=5977, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147799: Sun Nov 16 23:19:17 2025 read: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6028KiB/163063msec) clat (msec): min=3, max=178, avg=18.05, stdev=15.60 lat (msec): min=3, max=178, avg=18.06, stdev=15.60 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 75], 99.50th=[ 107], 99.90th=[ 150], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 160, per=36.79%, avg=53.71, stdev=29.49, samples=222 iops : min= 1, max= 40, avg=12.99, stdev= 7.42, samples=222 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6260KiB/163063msec); 0 zone resets clat (msec): min=20, max=50961, avg=86.64, stdev=1287.22 lat (msec): min=20, max=50961, avg=86.65, stdev=1287.22 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 60], 80.00th=[ 72], 90.00th=[ 89], 95.00th=[ 106], | 99.00th=[ 153], 99.50th=[ 188], 99.90th=[ 726], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 112, per=36.12%, avg=55.27, stdev=24.85, samples=224 iops : min= 1, max= 28, avg=13.38, stdev= 6.33, samples=224 lat (msec) : 4=0.03%, 10=18.23%, 20=15.95%, 50=42.45%, 100=19.86% lat (msec) : 250=3.42%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.22%, ctx=5878, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147801: Sun Nov 16 23:19:17 2025 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6052KiB/163231msec) clat (msec): min=4, max=225, avg=17.84, stdev=16.10 lat (msec): min=4, max=225, avg=17.84, stdev=16.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 33], 95.00th=[ 47], | 99.00th=[ 78], 99.50th=[ 105], 99.90th=[ 171], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 7, max= 152, per=37.18%, avg=54.29, stdev=30.55, samples=220 iops : min= 1, max= 38, avg=13.14, stdev= 7.71, samples=220 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6236KiB/163231msec); 0 zone resets clat (msec): min=20, max=50960, avg=87.24, stdev=1289.63 lat (msec): min=20, max=50960, avg=87.24, stdev=1289.63 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 62], 80.00th=[ 73], 90.00th=[ 88], 95.00th=[ 102], | 99.00th=[ 138], 99.50th=[ 165], 99.90th=[ 735], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 111, per=35.87%, avg=54.87, stdev=22.75, samples=224 iops : min= 1, max= 27, avg=13.28, stdev= 5.78, samples=224 lat (msec) : 10=18.75%, 20=15.69%, 50=41.15%, 100=21.61%, 250=2.73% lat (msec) : 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.22%, ctx=6027, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-37.1KiB/s (37.1kB/s-37.0kB/s), io=23.4MiB (24.6MB), run=163063-163898msec WRITE: bw=153KiB/s (157kB/s), 38.2KiB/s-38.8KiB/s (39.1kB/s-39.7kB/s), io=24.6MiB (25.7MB), run=163063-163898msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147843: Sun Nov 16 23:19:36 2025 read: IOPS=28, BW=461KiB/s (472kB/s)(5920KiB/12852msec) clat (usec): min=126, max=132999, avg=16754.34, stdev=13419.06 lat (usec): min=126, max=133000, avg=16755.16, stdev=13419.02 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 318], 10.00th=[ 363], 20.00th=[ 8586], | 30.00th=[ 11076], 40.00th=[ 13304], 50.00th=[ 15139], 60.00th=[ 18220], | 70.00th=[ 21627], 80.00th=[ 24773], 90.00th=[ 29492], 95.00th=[ 34866], | 99.00th=[ 52167], 99.50th=[115868], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 344, max= 734, per=24.72%, avg=454.16, stdev=111.36, samples=25 iops : min= 21, max= 45, avg=27.88, stdev= 6.97, samples=25 write: IOPS=30, BW=495KiB/s (507kB/s)(6368KiB/12852msec); 0 zone resets clat (usec): min=1610, max=122432, avg=16485.20, stdev=13480.27 lat (usec): min=1611, max=122433, avg=16486.88, stdev=13480.27 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3261], 10.00th=[ 3818], 20.00th=[ 4948], | 30.00th=[ 6456], 40.00th=[ 10421], 50.00th=[ 13435], 60.00th=[ 16450], | 70.00th=[ 20317], 80.00th=[ 25560], 90.00th=[ 33162], 95.00th=[ 41681], | 99.00th=[ 62129], 99.50th=[ 66323], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 223, max= 766, per=25.63%, avg=495.44, stdev=137.37, samples=25 iops : min= 13, max= 47, avg=30.44, stdev= 8.69, samples=25 lat (usec) : 250=1.43%, 500=5.60%, 750=0.91%, 1000=0.26% lat (msec) : 2=1.17%, 4=5.34%, 10=16.93%, 20=35.29%, 50=31.25% lat (msec) : 100=1.43%, 250=0.39% cpu : usr=0.15%, sys=28.50%, ctx=2309, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147844: Sun Nov 16 23:19:36 2025 read: IOPS=27, BW=441KiB/s (451kB/s)(5744KiB/13033msec) clat (usec): min=100, max=136792, avg=17815.34, stdev=12498.01 lat (usec): min=100, max=136793, avg=17816.19, stdev=12498.11 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 383], 10.00th=[ 603], 20.00th=[ 9896], | 30.00th=[ 11994], 40.00th=[ 14353], 50.00th=[ 16057], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 31065], 95.00th=[ 36963], | 99.00th=[ 59507], 99.50th=[ 62653], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 224, max= 576, per=23.83%, avg=437.68, stdev=92.43, samples=25 iops : min= 14, max= 36, avg=26.84, stdev= 5.68, samples=25 write: IOPS=31, BW=502KiB/s (514kB/s)(6544KiB/13033msec); 0 zone resets clat (usec): min=1184, max=84948, avg=16151.81, stdev=13558.49 lat (usec): min=1185, max=84950, avg=16153.61, stdev=13558.81 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2442], 10.00th=[ 3556], 20.00th=[ 4555], | 30.00th=[ 6325], 40.00th=[10290], 50.00th=[12780], 60.00th=[15926], | 70.00th=[20317], 80.00th=[25822], 90.00th=[32900], 95.00th=[42206], | 99.00th=[62129], 99.50th=[78119], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 287, max= 670, per=25.40%, avg=491.00, stdev=116.63, samples=25 iops : min= 17, max= 41, avg=30.20, stdev= 7.41, samples=25 lat (usec) : 250=0.78%, 500=3.39%, 750=1.04%, 1000=0.26% lat (msec) : 2=1.95%, 4=5.86%, 10=17.06%, 20=37.37%, 50=30.47% lat (msec) : 100=1.69%, 250=0.13% cpu : usr=0.12%, sys=28.15%, ctx=2380, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147845: Sun Nov 16 23:19:36 2025 read: IOPS=30, BW=482KiB/s (494kB/s)(6256KiB/12966msec) clat (usec): min=158, max=94566, avg=17539.65, stdev=11711.68 lat (usec): min=159, max=94567, avg=17540.46, stdev=11711.70 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 400], 10.00th=[ 652], 20.00th=[10159], | 30.00th=[11600], 40.00th=[13960], 50.00th=[16319], 60.00th=[19006], | 70.00th=[21365], 80.00th=[24511], 90.00th=[29492], 95.00th=[35914], | 99.00th=[56886], 99.50th=[72877], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 256, max= 734, per=26.39%, avg=484.80, stdev=111.35, samples=25 iops : min= 16, max= 45, avg=29.80, stdev= 6.87, samples=25 write: IOPS=29, BW=465KiB/s (476kB/s)(6032KiB/12966msec); 0 zone resets clat (usec): min=1398, max=67065, avg=16003.02, stdev=12414.70 lat (usec): min=1400, max=67067, avg=16004.72, stdev=12414.75 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2999], 10.00th=[ 3818], 20.00th=[ 5145], | 30.00th=[ 7046], 40.00th=[10159], 50.00th=[13042], 60.00th=[16188], | 70.00th=[20055], 80.00th=[25035], 90.00th=[33817], 95.00th=[41157], | 99.00th=[60556], 99.50th=[63177], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 285, max= 672, per=23.79%, avg=459.84, stdev=114.22, samples=25 iops : min= 17, max= 42, avg=28.24, stdev= 7.18, samples=25 lat (usec) : 250=0.26%, 500=3.91%, 750=1.17%, 1000=0.13% lat (msec) : 2=0.91%, 4=5.86%, 10=16.80%, 20=38.41%, 50=30.08% lat (msec) : 100=2.47% cpu : usr=0.13%, sys=27.84%, ctx=2388, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147846: Sun Nov 16 23:19:36 2025 read: IOPS=30, BW=481KiB/s (493kB/s)(6032KiB/12535msec) clat (usec): min=88, max=59464, avg=16473.02, stdev=11189.80 lat (usec): min=88, max=59466, avg=16473.84, stdev=11189.86 clat percentiles (usec): | 1.00th=[ 235], 5.00th=[ 330], 10.00th=[ 400], 20.00th=[ 8356], | 30.00th=[11469], 40.00th=[13698], 50.00th=[15926], 60.00th=[18220], | 70.00th=[21103], 80.00th=[25035], 90.00th=[28967], 95.00th=[33424], | 99.00th=[52691], 99.50th=[53216], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 185, max= 864, per=25.98%, avg=477.33, stdev=137.79, samples=24 iops : min= 11, max= 54, avg=29.33, stdev= 8.70, samples=24 write: IOPS=31, BW=499KiB/s (511kB/s)(6256KiB/12535msec); 0 zone resets clat (usec): min=1108, max=102864, avg=15882.79, stdev=14111.32 lat (usec): min=1110, max=102865, avg=15884.27, stdev=14111.37 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2835], 10.00th=[ 3851], 20.00th=[ 4621], | 30.00th=[ 5997], 40.00th=[ 8586], 50.00th=[ 11600], 60.00th=[ 14484], | 70.00th=[ 18482], 80.00th=[ 26870], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 76022], 99.50th=[ 85459], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 264, max= 736, per=25.82%, avg=499.17, stdev=123.12, samples=24 iops : min= 16, max= 46, avg=30.71, stdev= 7.73, samples=24 lat (usec) : 100=0.13%, 250=0.52%, 500=5.60%, 750=1.43%, 1000=0.39% lat (msec) : 2=1.69%, 4=4.95%, 10=20.31%, 20=34.24%, 50=28.65% lat (msec) : 100=1.95%, 250=0.13% cpu : usr=0.18%, sys=28.39%, ctx=2292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1838KiB/s (1882kB/s), 441KiB/s-482KiB/s (451kB/s-494kB/s), io=23.4MiB (24.5MB), run=12535-13033msec WRITE: bw=1934KiB/s (1980kB/s), 465KiB/s-502KiB/s (476kB/s-514kB/s), io=24.6MiB (25.8MB), run=12535-13033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147839: Sun Nov 16 23:19:49 2025 read: IOPS=14, BW=226KiB/s (231kB/s)(5920KiB/26200msec) clat (msec): min=4, max=141, avg=16.94, stdev=16.60 lat (msec): min=4, max=141, avg=16.94, stdev=16.60 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 56], | 99.00th=[ 87], 99.50th=[ 93], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 64, max= 544, per=24.69%, avg=225.67, stdev=110.35, samples=52 iops : min= 4, max= 34, avg=13.48, stdev= 6.92, samples=52 write: IOPS=15, BW=243KiB/s (249kB/s)(6368KiB/26200msec); 0 zone resets clat (msec): min=23, max=167, avg=49.89, stdev=18.67 lat (msec): min=23, max=167, avg=49.90, stdev=18.67 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 41], 40.00th=[ 43], 50.00th=[ 46], 60.00th=[ 50], | 70.00th=[ 53], 80.00th=[ 61], 90.00th=[ 71], 95.00th=[ 92], | 99.00th=[ 120], 99.50th=[ 131], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 63, max= 415, per=25.24%, avg=242.56, stdev=79.93, samples=52 iops : min= 3, max= 25, avg=14.56, stdev= 5.01, samples=52 lat (msec) : 10=22.53%, 20=14.71%, 50=40.36%, 100=20.70%, 250=1.69% cpu : usr=0.10%, sys=6.06%, ctx=1493, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147840: Sun Nov 16 23:19:49 2025 read: IOPS=13, BW=219KiB/s (224kB/s)(5744KiB/26204msec) clat (msec): min=4, max=108, avg=16.28, stdev=15.50 lat (msec): min=4, max=108, avg=16.28, stdev=15.50 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 50], | 99.00th=[ 86], 99.50th=[ 106], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 63, max= 477, per=24.04%, avg=219.73, stdev=101.29, samples=52 iops : min= 3, max= 29, avg=13.12, stdev= 6.29, samples=52 write: IOPS=15, BW=250KiB/s (256kB/s)(6544KiB/26204msec); 0 zone resets clat (msec): min=23, max=141, avg=49.65, stdev=16.74 lat (msec): min=23, max=141, avg=49.65, stdev=16.74 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 46], 60.00th=[ 50], | 70.00th=[ 54], 80.00th=[ 61], 90.00th=[ 72], 95.00th=[ 83], | 99.00th=[ 107], 99.50th=[ 114], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 127, max= 384, per=25.92%, avg=249.06, stdev=66.18, samples=52 iops : min= 7, max= 24, avg=14.96, stdev= 4.21, samples=52 lat (msec) : 10=22.92%, 20=13.15%, 50=41.15%, 100=21.48%, 250=1.30% cpu : usr=0.09%, sys=6.15%, ctx=1549, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147841: Sun Nov 16 23:19:49 2025 read: IOPS=15, BW=249KiB/s (255kB/s)(6256KiB/25159msec) clat (msec): min=4, max=105, avg=16.06, stdev=14.54 lat (msec): min=4, max=105, avg=16.06, stdev=14.54 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 48], | 99.00th=[ 82], 99.50th=[ 106], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 95, max= 608, per=27.54%, avg=251.71, stdev=127.56, samples=49 iops : min= 5, max= 38, avg=15.12, stdev= 8.03, samples=49 write: IOPS=14, BW=240KiB/s (246kB/s)(6032KiB/25159msec); 0 zone resets clat (msec): min=24, max=167, avg=49.93, stdev=18.61 lat (msec): min=24, max=167, avg=49.93, stdev=18.61 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 46], 60.00th=[ 50], | 70.00th=[ 55], 80.00th=[ 62], 90.00th=[ 73], 95.00th=[ 88], | 99.00th=[ 105], 99.50th=[ 144], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 64, max= 352, per=24.73%, avg=237.67, stdev=76.98, samples=49 iops : min= 4, max= 22, avg=14.24, stdev= 4.75, samples=49 lat (msec) : 10=24.09%, 20=14.32%, 50=40.10%, 100=20.05%, 250=1.43% cpu : usr=0.09%, sys=6.25%, ctx=1539, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147842: Sun Nov 16 23:19:49 2025 read: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/25961msec) clat (msec): min=4, max=110, avg=16.42, stdev=15.01 lat (msec): min=4, max=110, avg=16.42, stdev=15.01 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 54], | 99.00th=[ 79], 99.50th=[ 79], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 64, max= 447, per=25.16%, avg=229.96, stdev=96.88, samples=51 iops : min= 4, max= 27, avg=13.75, stdev= 6.06, samples=51 write: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25961msec); 0 zone resets clat (msec): min=24, max=138, avg=50.48, stdev=18.16 lat (msec): min=24, max=138, avg=50.48, stdev=18.16 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 47], 60.00th=[ 51], | 70.00th=[ 55], 80.00th=[ 63], 90.00th=[ 72], 95.00th=[ 91], | 99.00th=[ 110], 99.50th=[ 121], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 415, per=24.93%, avg=239.53, stdev=73.59, samples=51 iops : min= 5, max= 25, avg=14.35, stdev= 4.58, samples=51 lat (msec) : 10=22.53%, 20=15.76%, 50=37.89%, 100=22.53%, 250=1.30% cpu : usr=0.06%, sys=6.26%, ctx=1566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=914KiB/s (936kB/s), 219KiB/s-249KiB/s (224kB/s-255kB/s), io=23.4MiB (24.5MB), run=25159-26204msec WRITE: bw=962KiB/s (985kB/s), 240KiB/s-250KiB/s (246kB/s-256kB/s), io=24.6MiB (25.8MB), run=25159-26204msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147856: Sun Nov 16 23:19:58 2025 read: IOPS=2, BW=2879KiB/s (2948kB/s)(7168KiB/2490msec) clat (usec): min=888, max=294261, avg=124349.40, stdev=101884.72 lat (usec): min=888, max=294262, avg=124350.95, stdev=101884.65 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 889], 10.00th=[ 889], 20.00th=[ 1483], | 30.00th=[125305], 40.00th=[125305], 50.00th=[132645], 60.00th=[137364], | 70.00th=[137364], 80.00th=[177210], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2003, max= 5233, per=46.13%, avg=3094.67, stdev=1851.99, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2056KiB/s (2106kB/s)(5120KiB/2490msec); 0 zone resets clat (msec): min=200, max=379, avg=316.76, stdev=74.13 lat (msec): min=200, max=379, avg=316.84, stdev=74.12 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2003, max= 2048, per=21.65%, avg=2033.00, stdev=25.98, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=43.55%, ctx=778, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147857: Sun Nov 16 23:19:58 2025 read: IOPS=0, BW=671KiB/s (687kB/s)(2048KiB/3053msec) clat (msec): min=2, max=201, avg=101.83, stdev=141.04 lat (msec): min=2, max=201, avg=101.83, stdev=141.04 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1756, max= 2048, per=28.35%, avg=1902.00, stdev=206.48, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3354KiB/s (3435kB/s)(10.0MiB/3053msec); 0 zone resets clat (msec): min=143, max=606, avg=280.92, stdev=164.92 lat (msec): min=143, max=606, avg=281.01, stdev=164.92 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 150], 60.00th=[ 264], | 70.00th=[ 372], 80.00th=[ 418], 90.00th=[ 426], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2031, max= 6011, per=32.31%, avg=3034.50, stdev=1984.35, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 lat (msec) : 4=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=41.81%, ctx=221, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147858: Sun Nov 16 23:19:58 2025 read: IOPS=2, BW=2326KiB/s (2382kB/s)(6144KiB/2641msec) clat (usec): min=826, max=296661, avg=110112.86, stdev=119812.76 lat (usec): min=827, max=296663, avg=110113.93, stdev=119812.82 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 33424], 50.00th=[ 33424], 60.00th=[139461], | 70.00th=[189793], 80.00th=[189793], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2031, max= 8192, per=76.20%, avg=5111.50, stdev=4356.48, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=2, BW=2326KiB/s (2382kB/s)(6144KiB/2641msec); 0 zone resets clat (msec): min=145, max=667, avg=321.02, stdev=188.17 lat (msec): min=145, max=667, avg=321.09, stdev=188.19 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 268], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2003, max= 3488, per=24.74%, avg=2323.60, stdev=651.18, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=41.48%, ctx=427, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147859: Sun Nov 16 23:19:58 2025 read: IOPS=2, BW=2405KiB/s (2463kB/s)(5120KiB/2129msec) clat (usec): min=1047, max=182590, avg=85267.87, stdev=89591.61 lat (usec): min=1048, max=182591, avg=85268.97, stdev=89591.58 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1745], 40.00th=[ 1745], 50.00th=[ 65274], 60.00th=[ 65274], | 70.00th=[175113], 80.00th=[175113], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3367KiB/s (3448kB/s)(7168KiB/2129msec); 0 zone resets clat (msec): min=141, max=476, avg=241.12, stdev=121.46 lat (msec): min=142, max=476, avg=241.21, stdev=121.45 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 146], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 186], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 309], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1753, max= 6011, per=42.10%, avg=3953.33, stdev=2132.58, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 2=16.67%, 100=8.33%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=50.56%, ctx=240, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6708KiB/s (6869kB/s), 671KiB/s-2879KiB/s (687kB/s-2948kB/s), io=20.0MiB (20.0MB), run=2129-3053msec WRITE: bw=9391KiB/s (9617kB/s), 2056KiB/s-3367KiB/s (2106kB/s-3448kB/s), io=28.0MiB (29.4MB), run=2129-3053msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147861: Sun Nov 16 23:19:58 2025 read: IOPS=2, BW=2591KiB/s (2654kB/s)(7168KiB/2766msec) clat (msec): min=52, max=552, avg=209.97, stdev=179.46 lat (msec): min=52, max=552, avg=209.97, stdev=179.46 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 54], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 163], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 338], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1858, max= 4000, per=36.81%, avg=2388.00, stdev=904.26, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1851KiB/s (1895kB/s)(5120KiB/2766msec); 0 zone resets clat (msec): min=110, max=569, avg=240.76, stdev=187.12 lat (msec): min=110, max=569, avg=240.85, stdev=187.12 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2000, max= 6144, per=44.84%, avg=4072.00, stdev=2930.25, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=17.61%, ctx=294, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147862: Sun Nov 16 23:19:58 2025 read: IOPS=0, BW=663KiB/s (679kB/s)(2048KiB/3087msec) clat (msec): min=63, max=187, avg=125.71, stdev=88.07 lat (msec): min=63, max=187, avg=125.71, stdev=88.07 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 64], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1796, max= 2048, per=29.63%, avg=1922.00, stdev=178.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3317KiB/s (3397kB/s)(10.0MiB/3087msec); 0 zone resets clat (msec): min=51, max=777, avg=272.58, stdev=216.87 lat (msec): min=51, max=777, avg=272.67, stdev=216.87 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 142], | 30.00th=[ 144], 40.00th=[ 157], 50.00th=[ 167], 60.00th=[ 171], | 70.00th=[ 288], 80.00th=[ 347], 90.00th=[ 485], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2000, max= 4096, per=33.40%, avg=3033.50, stdev=1176.11, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.06%, sys=16.53%, ctx=354, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147863: Sun Nov 16 23:19:58 2025 read: IOPS=2, BW=2139KiB/s (2190kB/s)(6144KiB/2873msec) clat (msec): min=66, max=243, avg=134.19, stdev=68.96 lat (msec): min=66, max=243, avg=134.19, stdev=68.96 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 125], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2000, max= 4096, per=51.91%, avg=3367.67, stdev=1185.27, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2139KiB/s (2190kB/s)(6144KiB/2873msec); 0 zone resets clat (msec): min=140, max=585, avg=341.13, stdev=176.73 lat (msec): min=140, max=585, avg=341.22, stdev=176.73 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 393], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1790, max= 2048, per=21.74%, avg=1974.40, stdev=105.00, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=15.42%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147864: Sun Nov 16 23:19:58 2025 read: IOPS=1, BW=1622KiB/s (1661kB/s)(5120KiB/3157msec) clat (msec): min=27, max=220, avg=90.70, stdev=75.86 lat (msec): min=27, max=220, avg=90.70, stdev=75.86 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 28], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 61], | 70.00th=[ 89], 80.00th=[ 89], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 4096, max= 4096, per=63.14%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2271KiB/s (2325kB/s)(7168KiB/3157msec); 0 zone resets clat (msec): min=69, max=932, avg=371.30, stdev=306.84 lat (msec): min=69, max=933, avg=371.39, stdev=306.83 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 609], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1809, max= 4096, per=26.33%, avg=2391.20, stdev=957.45, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 50=8.33%, 100=41.67%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.06%, sys=12.01%, ctx=110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6487KiB/s (6643kB/s), 663KiB/s-2591KiB/s (679kB/s-2654kB/s), io=20.0MiB (20.0MB), run=2766-3157msec WRITE: bw=9082KiB/s (9300kB/s), 1851KiB/s-3317KiB/s (1895kB/s-3397kB/s), io=28.0MiB (29.4MB), run=2766-3157msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147869: Sun Nov 16 23:20:07 2025 read: IOPS=1, BW=4524KiB/s (4633kB/s)(12.0MiB/2716msec) clat (msec): min=458, max=1520, avg=867.92, stdev=571.23 lat (msec): min=458, max=1520, avg=867.92, stdev=571.23 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=28.25%, ctx=2480, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147870: Sun Nov 16 23:20:07 2025 read: IOPS=0, BW=1574KiB/s (1611kB/s)(4096KiB/2603msec) clat (nsec): min=1572.1M, max=1572.1M, avg=1572080144.00, stdev= 0.00 lat (nsec): min=1572.1M, max=1572.1M, avg=1572083164.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1569], 5.00th=[ 1569], 10.00th=[ 1569], 20.00th=[ 1569], | 30.00th=[ 1569], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3147KiB/s (3223kB/s)(8192KiB/2603msec); 0 zone resets clat (msec): min=369, max=597, avg=483.39, stdev=161.11 lat (msec): min=369, max=597, avg=483.78, stdev=161.10 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=74.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=16.83%, ctx=1064, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147871: Sun Nov 16 23:20:07 2025 write: IOPS=1, BW=4133KiB/s (4232kB/s)(12.0MiB/2973msec); 0 zone resets clat (msec): min=560, max=1648, avg=961.41, stdev=597.82 lat (msec): min=560, max=1648, avg=961.70, stdev=597.93 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8192, max= 8192, per=74.33%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=18.67%, ctx=256, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147872: Sun Nov 16 23:20:07 2025 write: IOPS=1, BW=4704KiB/s (4817kB/s)(12.0MiB/2612msec); 0 zone resets clat (msec): min=138, max=2283, avg=862.21, stdev=1231.20 lat (msec): min=139, max=2284, avg=862.70, stdev=1231.08 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min=14787, max=14787, per=100.00%, avg=14787.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=9.46%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6032KiB/s (6177kB/s), 1574KiB/s-4524KiB/s (1611kB/s-4633kB/s), io=16.0MiB (16.8MB), run=2603-2716msec WRITE: bw=10.8MiB/s (11.3MB/s), 3147KiB/s-4704KiB/s (3223kB/s-4817kB/s), io=32.0MiB (33.6MB), run=2603-2973msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147874: Sun Nov 16 23:20:07 2025 read: IOPS=0, BW=3913KiB/s (4007kB/s)(12.0MiB/3140msec) clat (msec): min=177, max=1937, avg=1014.73, stdev=883.32 lat (msec): min=177, max=1937, avg=1014.73, stdev=883.32 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.23%, ctx=181, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147875: Sun Nov 16 23:20:07 2025 read: IOPS=0, BW=1316KiB/s (1347kB/s)(4096KiB/3113msec) clat (nsec): min=2093.2M, max=2093.2M, avg=2093190305.00, stdev= 0.00 lat (nsec): min=2093.2M, max=2093.2M, avg=2093191312.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 2089], 20.00th=[ 2089], | 30.00th=[ 2089], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2632KiB/s (2695kB/s)(8192KiB/3113msec); 0 zone resets clat (msec): min=363, max=556, avg=459.88, stdev=135.96 lat (msec): min=364, max=556, avg=460.20, stdev=135.95 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8192, max= 8192, per=77.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.48%, ctx=186, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147876: Sun Nov 16 23:20:07 2025 write: IOPS=0, BW=4049KiB/s (4146kB/s)(12.0MiB/3035msec); 0 zone resets clat (msec): min=256, max=1852, avg=991.17, stdev=805.21 lat (msec): min=257, max=1852, avg=991.51, stdev=805.34 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8062, max= 8192, per=77.21%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.93%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147877: Sun Nov 16 23:20:07 2025 write: IOPS=1, BW=4506KiB/s (4614kB/s)(12.0MiB/2727msec); 0 zone resets clat (msec): min=90, max=2360, avg=898.37, stdev=1268.42 lat (msec): min=90, max=2360, avg=898.86, stdev=1268.54 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min=14976, max=14976, per=100.00%, avg=14976.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.11%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5218KiB/s (5343kB/s), 1316KiB/s-3913KiB/s (1347kB/s-4007kB/s), io=16.0MiB (16.8MB), run=3113-3140msec WRITE: bw=10.3MiB/s (10.8MB/s), 2632KiB/s-4506KiB/s (2695kB/s-4614kB/s), io=32.0MiB (33.6MB), run=2727-3113msec