== sanity test 398b: DIO and buffer IO race ============== 06:17:07 (1779704227) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.29861 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179406: Mon May 25 06:19:41 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5992KiB/130815msec) clat (usec): min=33, max=321106, avg=48127.65, stdev=31747.77 lat (usec): min=33, max=321107, avg=48129.18, stdev=31747.82 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 12125], 10.00th=[ 17433], 20.00th=[ 23725], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[160433], 99.50th=[189793], 99.90th=[267387], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 15, max= 111, per=24.95%, avg=45.42, stdev=17.73, samples=257 iops : min= 3, max= 27, avg=10.70, stdev= 4.47, samples=257 write: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6296KiB/130815msec); 0 zone resets clat (usec): min=1008, max=766176, avg=37076.61, stdev=42691.94 lat (usec): min=1010, max=766178, avg=37085.89, stdev=42690.46 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1450], 20.00th=[ 3392], | 30.00th=[ 7308], 40.00th=[ 16450], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[168821], 99.50th=[202376], 99.90th=[235930], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 144, per=25.07%, avg=47.88, stdev=21.18, samples=256 iops : min= 1, max= 36, avg=11.32, stdev= 5.35, samples=256 lat (usec) : 50=0.33%, 100=1.24%, 250=0.10% lat (msec) : 2=7.06%, 4=4.10%, 10=6.67%, 20=9.77%, 50=37.47% lat (msec) : 100=26.60%, 250=6.58%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.45%, ctx=6203, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Mon May 25 06:19:41 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5940KiB/131142msec) clat (usec): min=35, max=866467, avg=50167.72, stdev=38217.64 lat (usec): min=35, max=866470, avg=50169.24, stdev=38217.92 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 14353], 10.00th=[ 19006], 20.00th=[ 25822], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[160433], 99.50th=[196084], 99.90th=[320865], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 103, per=24.77%, avg=45.07, stdev=17.84, samples=255 iops : min= 1, max= 25, avg=10.61, stdev= 4.47, samples=255 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6348KiB/131142msec); 0 zone resets clat (usec): min=718, max=305306, avg=35430.44, stdev=38144.86 lat (usec): min=718, max=305308, avg=35433.02, stdev=38144.65 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1385], 20.00th=[ 3425], | 30.00th=[ 7177], 40.00th=[ 14877], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[162530], 99.50th=[193987], 99.90th=[295699], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 135, per=25.06%, avg=47.87, stdev=22.44, samples=256 iops : min= 1, max= 33, avg=11.32, stdev= 5.64, samples=256 lat (usec) : 50=0.23%, 100=0.88%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.75%, 4=3.58%, 10=6.61%, 20=9.41%, 50=37.96% lat (msec) : 100=26.24%, 250=7.00%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.40%, ctx=6134, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Mon May 25 06:19:41 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6028KiB/130596msec) clat (usec): min=34, max=344170, avg=48682.94, stdev=34579.29 lat (usec): min=35, max=344171, avg=48684.39, stdev=34579.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11600], 10.00th=[ 17171], 20.00th=[ 24511], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[177210], 99.50th=[204473], 99.90th=[283116], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=45.86, stdev=19.92, samples=255 iops : min= 1, max= 27, avg=10.81, stdev= 5.01, samples=255 write: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6260KiB/130596msec); 0 zone resets clat (usec): min=1017, max=852254, avg=36316.35, stdev=43320.79 lat (usec): min=1018, max=852257, avg=36318.20, stdev=43320.81 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1418], 20.00th=[ 3556], | 30.00th=[ 7111], 40.00th=[ 14877], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[164627], 99.50th=[173016], 99.90th=[274727], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=47.73, stdev=20.92, samples=254 iops : min= 1, max= 27, avg=11.28, stdev= 5.28, samples=254 lat (usec) : 50=0.23%, 100=1.69%, 250=0.13%, 500=0.10% lat (msec) : 2=7.29%, 4=3.81%, 10=6.97%, 20=8.76%, 50=38.74% lat (msec) : 100=25.26%, 250=6.80%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=4.55%, ctx=6236, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Mon May 25 06:19:41 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6052KiB/131325msec) clat (usec): min=35, max=849477, avg=49678.40, stdev=39583.63 lat (usec): min=36, max=849478, avg=49680.68, stdev=39583.74 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11207], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[183501], 99.50th=[202376], 99.90th=[295699], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=45.71, stdev=19.54, samples=258 iops : min= 1, max= 33, avg=10.77, stdev= 4.94, samples=258 write: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6236KiB/131325msec); 0 zone resets clat (usec): min=825, max=267421, avg=35781.49, stdev=38455.04 lat (usec): min=827, max=267422, avg=35787.22, stdev=38460.40 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1401], 20.00th=[ 3326], | 30.00th=[ 7635], 40.00th=[ 15926], 50.00th=[ 23987], 60.00th=[ 33162], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[168821], 99.50th=[198181], 99.90th=[252707], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 134, per=25.02%, avg=47.79, stdev=22.12, samples=254 iops : min= 1, max= 33, avg=11.30, stdev= 5.58, samples=254 lat (usec) : 50=0.36%, 100=1.53%, 250=0.03%, 1000=0.07% lat (msec) : 2=7.55%, 4=3.42%, 10=6.22%, 20=10.97%, 50=37.43% lat (msec) : 100=25.20%, 250=7.10%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=4.36%, ctx=6215, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (187kB/s), 45.3KiB/s-46.2KiB/s (46.4kB/s-47.3kB/s), io=23.4MiB (24.6MB), run=130596-131325msec WRITE: bw=191KiB/s (196kB/s), 47.5KiB/s-48.4KiB/s (48.6kB/s-49.6kB/s), io=24.6MiB (25.7MB), run=130596-131325msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Mon May 25 06:20:38 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5992KiB/186320msec) clat (msec): min=5, max=805, avg=49.53, stdev=45.53 lat (msec): min=5, max=805, avg=49.53, stdev=45.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 213], 99.50th=[ 241], 99.90th=[ 334], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 111, per=25.57%, avg=32.47, stdev=20.43, samples=357 iops : min= 1, max= 27, avg= 7.43, stdev= 5.15, samples=357 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6296KiB/186320msec); 0 zone resets clat (msec): min=9, max=316, avg=70.97, stdev=43.70 lat (msec): min=9, max=316, avg=70.97, stdev=43.70 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 131], 95.00th=[ 157], | 99.00th=[ 222], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 104, per=25.27%, avg=33.61, stdev=18.54, samples=362 iops : min= 1, max= 26, avg= 7.72, stdev= 4.69, samples=362 lat (msec) : 10=0.78%, 20=9.57%, 50=42.58%, 100=31.15%, 250=15.43% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4986, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Mon May 25 06:20:38 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(5940KiB/187976msec) clat (msec): min=5, max=860, avg=49.45, stdev=47.47 lat (msec): min=5, max=860, avg=49.45, stdev=47.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 372], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 103, per=25.02%, avg=31.78, stdev=20.16, samples=361 iops : min= 1, max= 25, avg= 7.27, stdev= 5.10, samples=361 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6348KiB/187976msec); 0 zone resets clat (msec): min=11, max=385, avg=71.96, stdev=48.24 lat (msec): min=11, max=385, avg=71.96, stdev=48.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 239], 99.50th=[ 284], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 110, per=25.02%, avg=33.28, stdev=19.44, samples=368 iops : min= 1, max= 27, avg= 7.64, stdev= 4.92, samples=368 lat (msec) : 10=1.20%, 20=10.45%, 50=42.45%, 100=29.85%, 250=15.40% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=4947, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179407: Mon May 25 06:20:38 2026 read: IOPS=8, BW=32.2KiB/s (32.0kB/s)(6028KiB/187319msec) clat (msec): min=5, max=287, avg=50.06, stdev=39.76 lat (msec): min=5, max=287, avg=50.07, stdev=39.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 109], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 199], 99.90th=[ 284], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 111, per=25.57%, avg=32.47, stdev=19.24, samples=359 iops : min= 1, max= 27, avg= 7.44, stdev= 4.87, samples=359 write: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6260KiB/187319msec); 0 zone resets clat (msec): min=11, max=873, avg=71.27, stdev=51.99 lat (msec): min=11, max=873, avg=71.27, stdev=51.99 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 101], 90.00th=[ 132], 95.00th=[ 161], | 99.00th=[ 264], 99.50th=[ 292], 99.90th=[ 418], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 126, per=24.96%, avg=33.19, stdev=19.74, samples=365 iops : min= 1, max= 31, avg= 7.61, stdev= 4.99, samples=365 lat (msec) : 10=0.94%, 20=9.11%, 50=44.14%, 100=29.85%, 250=15.30% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.04%, sys=1.76%, ctx=4983, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Mon May 25 06:20:38 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6052KiB/186040msec) clat (msec): min=6, max=319, avg=47.21, stdev=40.53 lat (msec): min=6, max=319, avg=47.22, stdev=40.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 94], 95.00th=[ 128], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 309], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 126, per=26.34%, avg=33.45, stdev=21.64, samples=351 iops : min= 1, max= 31, avg= 7.68, stdev= 5.47, samples=351 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6236KiB/186040msec); 0 zone resets clat (msec): min=11, max=854, avg=73.29, stdev=53.92 lat (msec): min=11, max=854, avg=73.29, stdev=53.93 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 134], 95.00th=[ 174], | 99.00th=[ 264], 99.50th=[ 305], 99.90th=[ 418], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 94, per=24.91%, avg=33.13, stdev=18.27, samples=365 iops : min= 1, max= 23, avg= 7.60, stdev= 4.62, samples=365 lat (msec) : 10=0.88%, 20=10.84%, 50=43.59%, 100=29.49%, 250=14.42% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4931, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.6KiB/s-32.5KiB/s (32.4kB/s-33.3kB/s), io=23.4MiB (24.6MB), run=186040-187976msec WRITE: bw=134KiB/s (137kB/s), 33.4KiB/s-33.8KiB/s (34.2kB/s-34.6kB/s), io=24.6MiB (25.7MB), run=186040-187976msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179455: Mon May 25 06:21:25 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5920KiB/34953msec) clat (usec): min=42, max=151885, avg=48500.07, stdev=29769.97 lat (usec): min=42, max=151886, avg=48502.66, stdev=29769.15 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 97], 20.00th=[ 25035], | 30.00th=[ 34341], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 61080], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[103285], | 99.00th=[135267], 99.50th=[143655], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 30, max= 317, per=24.42%, avg=167.26, stdev=59.58, samples=68 iops : min= 1, max= 19, avg= 9.65, stdev= 3.79, samples=68 write: IOPS=11, BW=182KiB/s (187kB/s)(6368KiB/34953msec); 0 zone resets clat (usec): min=1538, max=199548, avg=42089.06, stdev=41494.98 lat (usec): min=1539, max=199550, avg=42094.07, stdev=41496.99 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1909], 10.00th=[ 2737], 20.00th=[ 6521], | 30.00th=[ 10290], 40.00th=[ 20055], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 53216], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[129500], | 99.00th=[181404], 99.50th=[183501], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 440, per=25.18%, avg=181.28, stdev=80.65, samples=68 iops : min= 1, max= 27, avg=10.53, stdev= 5.08, samples=68 lat (usec) : 50=0.52%, 100=4.30%, 250=0.39%, 500=0.13% lat (msec) : 2=3.91%, 4=3.12%, 10=8.20%, 20=7.42%, 50=34.51% lat (msec) : 100=28.78%, 250=8.72% cpu : usr=0.05%, sys=4.77%, ctx=1589, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179456: Mon May 25 06:21:25 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34480msec) clat (usec): min=45, max=217136, avg=53283.56, stdev=35467.59 lat (usec): min=46, max=217137, avg=53284.81, stdev=35467.62 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 21365], 20.00th=[ 29492], | 30.00th=[ 34866], 40.00th=[ 40633], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[198181], 99.50th=[210764], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 348, per=24.23%, avg=165.97, stdev=73.85, samples=67 iops : min= 1, max= 21, avg= 9.57, stdev= 4.70, samples=67 write: IOPS=11, BW=190KiB/s (194kB/s)(6544KiB/34480msec); 0 zone resets clat (usec): min=1551, max=192092, avg=36902.68, stdev=35876.90 lat (usec): min=1552, max=192095, avg=36904.99, stdev=35876.82 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1876], 10.00th=[ 2540], 20.00th=[ 5669], | 30.00th=[ 9110], 40.00th=[ 16319], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[147850], 99.50th=[152044], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 377, per=26.28%, avg=189.21, stdev=80.00, samples=67 iops : min= 1, max= 23, avg=11.04, stdev= 5.07, samples=67 lat (usec) : 50=0.39%, 100=2.34% lat (msec) : 2=4.04%, 4=4.17%, 10=9.11%, 20=7.68%, 50=35.81% lat (msec) : 100=29.04%, 250=7.42% cpu : usr=0.04%, sys=4.66%, ctx=1557, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179457: Mon May 25 06:21:25 2026 read: IOPS=11, BW=179KiB/s (184kB/s)(6256KiB/34890msec) clat (usec): min=40, max=268971, avg=50958.86, stdev=33595.32 lat (usec): min=40, max=268973, avg=50960.23, stdev=33595.35 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 15926], 20.00th=[ 27657], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 46400], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[158335], 99.50th=[231736], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 479, per=26.16%, avg=179.19, stdev=68.27, samples=68 iops : min= 3, max= 29, avg=10.40, stdev= 4.29, samples=68 write: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34890msec); 0 zone resets clat (usec): min=1182, max=186820, avg=38988.18, stdev=36562.53 lat (usec): min=1184, max=186821, avg=38990.40, stdev=36562.48 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1893], 10.00th=[ 2835], 20.00th=[ 6259], | 30.00th=[ 10683], 40.00th=[ 17957], 50.00th=[ 29754], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[152044], 99.50th=[179307], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 412, per=23.54%, avg=169.51, stdev=78.84, samples=68 iops : min= 1, max= 25, avg= 9.79, stdev= 5.01, samples=68 lat (usec) : 50=0.52%, 100=3.65%, 1000=0.13% lat (msec) : 2=3.65%, 4=3.52%, 10=6.77%, 20=8.07%, 50=35.55% lat (msec) : 100=31.12%, 250=6.90%, 500=0.13% cpu : usr=0.05%, sys=4.52%, ctx=1655, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179458: Mon May 25 06:21:25 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33684msec) clat (usec): min=37, max=211146, avg=51875.63, stdev=35635.06 lat (usec): min=38, max=211147, avg=51877.00, stdev=35635.14 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 1483], 20.00th=[ 25560], | 30.00th=[ 33424], 40.00th=[ 37487], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 64226], 80.00th=[ 78119], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[162530], 99.50th=[208667], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 349, per=26.01%, avg=178.20, stdev=69.30, samples=66 iops : min= 1, max= 21, avg=10.35, stdev= 4.40, samples=66 write: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33684msec); 0 zone resets clat (usec): min=1294, max=286980, avg=35972.11, stdev=37679.75 lat (usec): min=1296, max=286982, avg=35974.34, stdev=37679.73 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1909], 10.00th=[ 3261], 20.00th=[ 5604], | 30.00th=[ 9110], 40.00th=[ 14877], 50.00th=[ 23200], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[181404], 99.50th=[189793], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 30, max= 475, per=25.73%, avg=185.26, stdev=82.40, samples=66 iops : min= 1, max= 29, avg=10.77, stdev= 5.21, samples=66 lat (usec) : 50=0.26%, 100=4.04%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=3.78%, 10=9.38%, 20=8.59%, 50=34.90% lat (msec) : 100=28.52%, 250=6.64%, 500=0.13% cpu : usr=0.07%, sys=4.60%, ctx=1525, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=685KiB/s (702kB/s), 167KiB/s-179KiB/s (171kB/s-184kB/s), io=23.4MiB (24.5MB), run=33684-34953msec WRITE: bw=721KiB/s (738kB/s), 173KiB/s-190KiB/s (177kB/s-194kB/s), io=24.6MiB (25.8MB), run=33684-34953msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179460: Mon May 25 06:21:41 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49186msec) clat (msec): min=7, max=241, avg=50.47, stdev=38.32 lat (msec): min=7, max=241, avg=50.47, stdev=38.32 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 182], 99.50th=[ 228], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 345, per=25.46%, avg=122.70, stdev=66.67, samples=93 iops : min= 1, max= 21, avg= 6.86, stdev= 4.23, samples=93 write: IOPS=8, BW=129KiB/s (133kB/s)(6368KiB/49186msec); 0 zone resets clat (msec): min=13, max=296, avg=76.34, stdev=45.80 lat (msec): min=14, max=296, avg=76.37, stdev=45.78 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 316, per=25.66%, avg=130.09, stdev=61.36, samples=95 iops : min= 1, max= 19, avg= 7.32, stdev= 3.88, samples=95 lat (msec) : 10=0.13%, 20=6.51%, 50=43.75%, 100=32.03%, 250=17.19% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.67%, ctx=1156, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179461: Mon May 25 06:21:41 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(5744KiB/49611msec) clat (msec): min=9, max=261, avg=51.11, stdev=41.23 lat (msec): min=9, max=261, avg=51.14, stdev=41.21 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 215], 99.50th=[ 257], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 22, max= 287, per=25.12%, avg=121.10, stdev=70.74, samples=92 iops : min= 1, max= 17, avg= 6.75, stdev= 4.45, samples=92 write: IOPS=8, BW=132KiB/s (135kB/s)(6544KiB/49611msec); 0 zone resets clat (msec): min=20, max=308, avg=76.17, stdev=48.53 lat (msec): min=20, max=308, avg=76.18, stdev=48.53 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 41], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 163], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 318, per=26.03%, avg=131.96, stdev=67.64, samples=96 iops : min= 1, max= 19, avg= 7.43, stdev= 4.30, samples=96 lat (msec) : 10=0.26%, 20=6.77%, 50=43.49%, 100=31.90%, 250=16.80% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.61%, ctx=1141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179462: Mon May 25 06:21:41 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(6256KiB/49001msec) clat (msec): min=9, max=300, avg=52.65, stdev=41.85 lat (msec): min=9, max=300, avg=52.65, stdev=41.85 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 79], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 224], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 383, per=26.59%, avg=128.17, stdev=79.61, samples=96 iops : min= 1, max= 23, avg= 7.20, stdev= 5.04, samples=96 write: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/49001msec); 0 zone resets clat (msec): min=14, max=329, avg=75.05, stdev=45.33 lat (msec): min=14, max=329, avg=75.06, stdev=45.33 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 49], 40.00th=[ 54], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 88], 80.00th=[ 105], 90.00th=[ 142], 95.00th=[ 163], | 99.00th=[ 220], 99.50th=[ 292], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 318, per=24.81%, avg=125.81, stdev=57.99, samples=93 iops : min= 1, max= 19, avg= 7.04, stdev= 3.67, samples=93 lat (msec) : 10=0.13%, 20=7.81%, 50=41.41%, 100=32.55%, 250=17.71% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.61%, ctx=1121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179463: Mon May 25 06:21:41 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49489msec) clat (msec): min=7, max=304, avg=54.41, stdev=47.72 lat (msec): min=7, max=304, avg=54.41, stdev=47.72 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 78], 90.00th=[ 118], 95.00th=[ 159], | 99.00th=[ 239], 99.50th=[ 253], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 24, max= 347, per=26.09%, avg=125.75, stdev=74.94, samples=93 iops : min= 1, max= 21, avg= 7.05, stdev= 4.75, samples=93 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49489msec); 0 zone resets clat (msec): min=12, max=293, avg=73.89, stdev=46.01 lat (msec): min=12, max=293, avg=73.89, stdev=46.01 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 178], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 350, per=25.08%, avg=127.14, stdev=69.32, samples=96 iops : min= 1, max= 21, avg= 7.13, stdev= 4.40, samples=96 lat (msec) : 10=0.26%, 20=7.03%, 50=45.05%, 100=29.56%, 250=17.45% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.71%, ctx=1129, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=483KiB/s (494kB/s), 116KiB/s-128KiB/s (119kB/s-131kB/s), io=23.4MiB (24.5MB), run=49001-49611msec WRITE: bw=508KiB/s (520kB/s), 123KiB/s-132KiB/s (126kB/s-135kB/s), io=24.6MiB (25.8MB), run=49001-49611msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179478: Mon May 25 06:21:59 2026 read: IOPS=1, BW=1149KiB/s (1176kB/s)(7168KiB/6239msec) clat (msec): min=6, max=3192, avg=672.44, stdev=1120.90 lat (msec): min=6, max=3192, avg=672.45, stdev=1120.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 192], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 245], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 481], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1899, max= 3984, per=81.33%, avg=2378.20, stdev=899.50, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=821KiB/s (840kB/s)(5120KiB/6239msec); 0 zone resets clat (msec): min=91, max=456, avg=265.77, stdev=157.48 lat (msec): min=91, max=462, avg=267.11, stdev=159.25 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2043, max= 4096, per=66.67%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 10=8.33%, 100=8.33%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.98%, ctx=484, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179479: Mon May 25 06:21:59 2026 read: IOPS=0, BW=299KiB/s (306kB/s)(2048KiB/6854msec) clat (msec): min=240, max=292, avg=266.78, stdev=36.63 lat (msec): min=240, max=292, avg=266.78, stdev=36.63 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1735, max= 2048, per=64.69%, avg=1891.50, stdev=221.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1494KiB/s (1530kB/s)(10.0MiB/6854msec); 0 zone resets clat (msec): min=112, max=2695, avg=625.21, stdev=759.47 lat (msec): min=113, max=2695, avg=625.30, stdev=759.47 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 279], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 542], 80.00th=[ 584], 90.00th=[ 877], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1988, max= 6131, per=73.28%, avg=2999.50, stdev=1691.84, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.62%, ctx=144, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179480: Mon May 25 06:21:59 2026 read: IOPS=0, BW=877KiB/s (898kB/s)(6144KiB/7004msec) clat (usec): min=497, max=616083, avg=231567.80, stdev=233605.88 lat (usec): min=498, max=616084, avg=231569.21, stdev=233605.80 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[162530], 50.00th=[162530], 60.00th=[267387], | 70.00th=[341836], 80.00th=[341836], 90.00th=[616563], 95.00th=[616563], | 99.00th=[616563], 99.50th=[616563], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 1899, max= 2048, per=67.78%, avg=1981.75, stdev=61.59, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=877KiB/s (898kB/s)(6144KiB/7004msec); 0 zone resets clat (msec): min=184, max=3331, avg=905.29, stdev=1202.00 lat (msec): min=184, max=3331, avg=905.37, stdev=1202.00 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 592], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1992, max= 4039, per=65.80%, avg=2693.00, stdev=1166.01, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=5.05%, ctx=175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179481: Mon May 25 06:21:59 2026 read: IOPS=0, BW=758KiB/s (776kB/s)(5120KiB/6752msec) clat (usec): min=399, max=447708, avg=89945.15, stdev=199995.80 lat (usec): min=400, max=447708, avg=89946.17, stdev=199995.45 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 537], 60.00th=[ 537], | 70.00th=[ 562], 80.00th=[ 562], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1062KiB/s (1087kB/s)(7168KiB/6752msec); 0 zone resets clat (msec): min=291, max=3466, avg=870.49, stdev=1147.72 lat (msec): min=292, max=3466, avg=871.46, stdev=1147.35 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 372], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 489], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 523], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1899, max= 2048, per=48.84%, avg=1999.00, stdev=55.45, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (usec) : 500=8.33%, 750=25.00% lat (msec) : 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=6.62%, ctx=137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2924KiB/s (2994kB/s), 299KiB/s-1149KiB/s (306kB/s-1176kB/s), io=20.0MiB (20.0MB), run=6239-7004msec WRITE: bw=4094KiB/s (4192kB/s), 821KiB/s-1494KiB/s (840kB/s-1530kB/s), io=28.0MiB (29.4MB), run=6239-7004msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179483: Mon May 25 06:22:01 2026 read: IOPS=1, BW=1055KiB/s (1081kB/s)(7168KiB/6793msec) clat (msec): min=123, max=2501, avg=706.07, stdev=889.99 lat (msec): min=123, max=2501, avg=706.07, stdev=889.99 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 131], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 305], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 1301], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2031, max= 4047, per=98.95%, avg=2982.25, stdev=1102.31, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=754KiB/s (772kB/s)(5120KiB/6793msec); 0 zone resets clat (msec): min=145, max=870, avg=351.68, stdev=305.03 lat (msec): min=145, max=870, avg=351.78, stdev=305.02 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2007, max= 6095, per=80.13%, avg=3381.67, stdev=2349.88, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.69%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179484: Mon May 25 06:22:01 2026 read: IOPS=0, BW=333KiB/s (341kB/s)(2048KiB/6156msec) clat (msec): min=107, max=505, avg=306.73, stdev=281.32 lat (msec): min=107, max=505, avg=306.73, stdev=281.32 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1973, max= 2043, per=66.62%, avg=2008.00, stdev=49.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1663KiB/s (1703kB/s)(10.0MiB/6156msec); 0 zone resets clat (msec): min=136, max=1921, avg=535.12, stdev=519.25 lat (msec): min=137, max=1922, avg=535.29, stdev=519.47 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 190], | 30.00th=[ 275], 40.00th=[ 321], 50.00th=[ 334], 60.00th=[ 376], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 751], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1910, max= 4047, per=55.21%, avg=2329.83, stdev=842.29, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=2.96%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179485: Mon May 25 06:22:01 2026 read: IOPS=0, BW=938KiB/s (960kB/s)(6144KiB/6551msec) clat (msec): min=111, max=613, avg=280.59, stdev=181.77 lat (msec): min=111, max=613, avg=280.59, stdev=181.77 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 247], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1910, max= 2043, per=65.80%, avg=1983.25, stdev=56.58, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=938KiB/s (960kB/s)(6144KiB/6551msec); 0 zone resets clat (msec): min=146, max=2812, avg=797.69, stdev=1006.68 lat (msec): min=146, max=2812, avg=797.78, stdev=1006.67 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 609], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1910, max= 4087, per=59.52%, avg=2511.75, stdev=1051.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.38%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179486: Mon May 25 06:22:01 2026 read: IOPS=0, BW=755KiB/s (773kB/s)(5120KiB/6782msec) clat (msec): min=63, max=490, avg=219.71, stdev=161.63 lat (msec): min=63, max=490, avg=219.71, stdev=161.63 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2007, max= 4087, per=89.77%, avg=2705.67, stdev=1196.30, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1057KiB/s (1082kB/s)(7168KiB/6782msec); 0 zone resets clat (msec): min=218, max=2866, avg=796.93, stdev=947.10 lat (msec): min=219, max=2867, avg=797.03, stdev=947.11 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 330], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 401], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 1003], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1973, max= 4063, per=57.37%, avg=2421.00, stdev=918.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.02%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3015KiB/s (3087kB/s), 333KiB/s-1055KiB/s (341kB/s-1081kB/s), io=20.0MiB (20.0MB), run=6156-6793msec WRITE: bw=4221KiB/s (4322kB/s), 754KiB/s-1663KiB/s (772kB/s-1703kB/s), io=28.0MiB (29.4MB), run=6156-6793msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179493: Mon May 25 06:22:17 2026 read: IOPS=0, BW=4054KiB/s (4151kB/s)(12.0MiB/3031msec) clat (msec): min=848, max=1053, avg=947.21, stdev=102.51 lat (msec): min=848, max=1053, avg=947.21, stdev=102.51 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.59%, ctx=243, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179494: Mon May 25 06:22:17 2026 read: IOPS=0, BW=1869KiB/s (1914kB/s)(4096KiB/2191msec) clat (nsec): min=861665k, max=861665k, avg=861665297.00, stdev= 0.00 lat (nsec): min=861668k, max=861668k, avg=861668192.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3739KiB/s (3829kB/s)(8192KiB/2191msec); 0 zone resets clat (msec): min=309, max=989, avg=649.33, stdev=480.87 lat (msec): min=309, max=989, avg=649.77, stdev=480.91 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8110, max= 8110, per=89.05%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=9.82%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179495: Mon May 25 06:22:17 2026 write: IOPS=0, BW=3415KiB/s (3497kB/s)(12.0MiB/3598msec); 0 zone resets clat (msec): min=371, max=1889, avg=1180.72, stdev=764.08 lat (msec): min=371, max=1891, avg=1181.46, stdev=764.64 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8143, max= 8143, per=89.41%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.09%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179496: Mon May 25 06:22:17 2026 write: IOPS=1, BW=6711KiB/s (6872kB/s)(12.0MiB/1831msec); 0 zone resets clat (msec): min=268, max=757, avg=566.02, stdev=261.40 lat (msec): min=268, max=759, avg=566.99, stdev=262.08 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min=16189, max=16189, per=100.00%, avg=16189.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.27%, sys=6.39%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5405KiB/s (5535kB/s), 1869KiB/s-4054KiB/s (1914kB/s-4151kB/s), io=16.0MiB (16.8MB), run=2191-3031msec WRITE: bw=9107KiB/s (9326kB/s), 3415KiB/s-6711KiB/s (3497kB/s-6872kB/s), io=32.0MiB (33.6MB), run=1831-3598msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179498: Mon May 25 06:22:18 2026 read: IOPS=1, BW=4521KiB/s (4629kB/s)(12.0MiB/2718msec) clat (msec): min=275, max=1710, avg=904.79, stdev=733.82 lat (msec): min=275, max=1710, avg=904.79, stdev=733.82 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.43%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179499: Mon May 25 06:22:18 2026 read: IOPS=0, BW=1336KiB/s (1368kB/s)(4096KiB/3065msec) clat (nsec): min=1085.9M, max=1085.9M, avg=1085908848.00, stdev= 0.00 lat (nsec): min=1085.9M, max=1085.9M, avg=1085910959.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2673KiB/s (2737kB/s)(8192KiB/3065msec); 0 zone resets clat (msec): min=638, max=1273, avg=956.18, stdev=449.30 lat (msec): min=641, max=1274, avg=958.00, stdev=448.04 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7953, max= 7953, per=74.39%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.96%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179500: Mon May 25 06:22:18 2026 write: IOPS=1, BW=4178KiB/s (4278kB/s)(12.0MiB/2941msec); 0 zone resets clat (msec): min=323, max=1641, avg=978.27, stdev=658.96 lat (msec): min=324, max=1641, avg=978.65, stdev=658.92 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7953, max= 7953, per=74.39%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179501: Mon May 25 06:22:18 2026 write: IOPS=1, BW=5364KiB/s (5492kB/s)(12.0MiB/2291msec); 0 zone resets clat (msec): min=221, max=1754, avg=741.15, stdev=878.06 lat (msec): min=221, max=1756, avg=741.73, stdev=878.54 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 6649, max= 7953, per=68.29%, avg=7301.00, stdev=922.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.72%, ctx=28, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5346KiB/s (5474kB/s), 1336KiB/s-4521KiB/s (1368kB/s-4629kB/s), io=16.0MiB (16.8MB), run=2718-3065msec WRITE: bw=10.4MiB/s (10.9MB/s), 2673KiB/s-5364KiB/s (2737kB/s-5492kB/s), io=32.0MiB (33.6MB), run=2291-3065msec