== sanity test 398b: DIO and buffer IO race ============== 02:36:02 (1788935762) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.20479 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179613: Wed Sep 9 02:38:16 2026 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(5992KiB/112972msec) clat (usec): min=28, max=1101.9k, avg=42179.99, stdev=39210.14 lat (usec): min=28, max=1101.9k, avg=42182.49, stdev=39209.84 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9503], 10.00th=[ 14484], | 20.00th=[ 20317], 30.00th=[ 25560], 40.00th=[ 30540], | 50.00th=[ 35390], 60.00th=[ 41681], 70.00th=[ 49546], | 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[ 154141], 99.50th=[ 177210], 99.90th=[ 202376], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 120, per=25.63%, avg=53.06, stdev=19.71, samples=221 iops : min= 1, max= 30, avg=12.64, stdev= 4.98, samples=221 write: IOPS=13, BW=55.7KiB/s (57.1kB/s)(6296KiB/112972msec); 0 zone resets clat (usec): min=958, max=307529, avg=31322.56, stdev=33048.75 lat (usec): min=959, max=307530, avg=31324.07, stdev=33048.78 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 1811], 20.00th=[ 3556], | 30.00th=[ 6783], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 29492], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[162530], 99.90th=[185598], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 174, per=25.67%, avg=55.70, stdev=24.43, samples=221 iops : min= 1, max= 43, avg=13.31, stdev= 6.14, samples=221 lat (usec) : 50=0.42%, 100=1.40%, 250=0.13%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.86%, 4=5.37%, 10=7.26%, 20=12.92%, 50=40.33% lat (msec) : 100=22.07%, 250=4.00%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.86%, ctx=6554, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179615: Wed Sep 9 02:38:16 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(5940KiB/115449msec) clat (usec): min=36, max=1227.4k, avg=42477.34, stdev=42169.42 lat (usec): min=36, max=1227.4k, avg=42479.81, stdev=42169.22 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9896], 10.00th=[ 15270], | 20.00th=[ 20841], 30.00th=[ 26084], 40.00th=[ 30540], | 50.00th=[ 35390], 60.00th=[ 41681], 70.00th=[ 49546], | 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[ 160433], 99.50th=[ 210764], 99.90th=[ 274727], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 8, max= 112, per=25.05%, avg=51.86, stdev=18.59, samples=224 iops : min= 2, max= 28, avg=12.34, stdev= 4.70, samples=224 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6348KiB/115449msec); 0 zone resets clat (usec): min=971, max=213675, avg=32685.25, stdev=34167.42 lat (usec): min=971, max=213676, avg=32687.50, stdev=34166.95 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1582], 20.00th=[ 3490], | 30.00th=[ 6718], 40.00th=[ 14353], 50.00th=[ 22938], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[145753], 99.50th=[181404], 99.90th=[208667], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 127, per=25.36%, avg=55.02, stdev=24.26, samples=225 iops : min= 1, max= 31, avg=13.15, stdev= 6.14, samples=225 lat (usec) : 50=0.20%, 100=1.24%, 250=0.20%, 750=0.03%, 1000=0.10% lat (msec) : 2=6.35%, 4=5.05%, 10=7.36%, 20=11.91%, 50=41.21% lat (msec) : 100=21.97%, 250=4.30%, 500=0.07%, 2000=0.03% cpu : usr=0.06%, sys=5.63%, ctx=6558, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179616: Wed Sep 9 02:38:16 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6028KiB/113469msec) clat (usec): min=31, max=180718, avg=40428.28, stdev=25736.83 lat (usec): min=32, max=180719, avg=40432.08, stdev=25737.38 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 6652], 10.00th=[ 13960], 20.00th=[ 20579], | 30.00th=[ 25035], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 57410], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[143655], 99.90th=[175113], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 15, max= 111, per=25.84%, avg=53.48, stdev=20.13, samples=221 iops : min= 3, max= 27, avg=12.75, stdev= 5.07, samples=221 write: IOPS=13, BW=55.2KiB/s (56.5kB/s)(6260KiB/113469msec); 0 zone resets clat (usec): min=849, max=1219.1k, avg=33286.96, stdev=45091.69 lat (usec): min=849, max=1219.1k, avg=33288.84, stdev=45091.55 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1631], | 20.00th=[ 3359], 30.00th=[ 6980], 40.00th=[ 15401], | 50.00th=[ 23987], 60.00th=[ 32375], 70.00th=[ 42206], | 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 99091], | 99.00th=[ 147850], 99.50th=[ 160433], 99.90th=[ 299893], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 135, per=25.57%, avg=55.49, stdev=22.44, samples=221 iops : min= 1, max= 33, avg=13.26, stdev= 5.66, samples=221 lat (usec) : 50=0.59%, 100=1.46%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.67%, 4=4.36%, 10=6.28%, 20=12.50%, 50=41.73% lat (msec) : 100=22.14%, 250=3.71%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.73%, ctx=6559, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179618: Wed Sep 9 02:38:16 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6052KiB/115267msec) clat (usec): min=35, max=1201.4k, avg=40941.01, stdev=39278.99 lat (usec): min=36, max=1201.4k, avg=40945.80, stdev=39278.75 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6849], 10.00th=[ 14615], | 20.00th=[ 20055], 30.00th=[ 25297], 40.00th=[ 30540], | 50.00th=[ 35914], 60.00th=[ 41681], 70.00th=[ 48497], | 80.00th=[ 57934], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[ 122160], 99.50th=[ 143655], 99.90th=[ 240124], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 104, per=25.46%, avg=52.70, stdev=19.92, samples=224 iops : min= 1, max= 26, avg=12.55, stdev= 5.02, samples=224 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6236KiB/115267msec); 0 zone resets clat (usec): min=894, max=237749, avg=33903.28, stdev=33906.05 lat (usec): min=895, max=237749, avg=33911.62, stdev=33907.98 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1942], 20.00th=[ 4146], | 30.00th=[ 7898], 40.00th=[ 17171], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[145753], 99.50th=[170918], 99.90th=[225444], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=53.96, stdev=19.44, samples=225 iops : min= 1, max= 31, avg=12.88, stdev= 4.90, samples=225 lat (usec) : 50=0.23%, 100=1.73%, 250=0.29%, 750=0.07%, 1000=0.16% lat (msec) : 2=5.14%, 4=4.65%, 10=7.26%, 20=12.08%, 50=41.05% lat (msec) : 100=23.34%, 250=3.97%, 2000=0.03% cpu : usr=0.07%, sys=5.47%, ctx=6607, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 51.5KiB/s-53.1KiB/s (52.7kB/s-54.4kB/s), io=23.4MiB (24.6MB), run=112972-115449msec WRITE: bw=218KiB/s (223kB/s), 54.1KiB/s-55.7KiB/s (55.4kB/s-57.1kB/s), io=24.6MiB (25.7MB), run=112972-115449msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179611: Wed Sep 9 02:38:55 2026 read: IOPS=9, BW=38.9KiB/s (39.9kB/s)(5992KiB/153867msec) clat (msec): min=5, max=1120, avg=40.76, stdev=46.05 lat (msec): min=5, max=1120, avg=40.77, stdev=46.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 117], | 99.00th=[ 182], 99.50th=[ 215], 99.90th=[ 347], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 151, per=25.41%, avg=39.38, stdev=25.65, samples=297 iops : min= 1, max= 37, avg= 9.20, stdev= 6.47, samples=297 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6296KiB/153867msec); 0 zone resets clat (msec): min=9, max=378, avg=58.68, stdev=40.33 lat (msec): min=9, max=378, avg=58.68, stdev=40.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 228], 99.90th=[ 342], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 127, per=25.20%, avg=40.82, stdev=24.86, samples=301 iops : min= 1, max= 31, avg= 9.55, stdev= 6.25, samples=301 lat (msec) : 10=2.99%, 20=15.95%, 50=45.67%, 100=24.64%, 250=10.48% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.89%, ctx=4791, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179612: Wed Sep 9 02:38:55 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5940KiB/154574msec) clat (msec): min=4, max=1196, avg=39.75, stdev=44.81 lat (msec): min=4, max=1196, avg=39.75, stdev=44.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 108], | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 247], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 143, per=25.37%, avg=39.32, stdev=25.60, samples=295 iops : min= 1, max= 35, avg= 9.19, stdev= 6.44, samples=295 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6348KiB/154574msec); 0 zone resets clat (msec): min=10, max=345, avg=59.91, stdev=42.71 lat (msec): min=10, max=345, avg=59.91, stdev=42.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 146], | 99.00th=[ 211], 99.50th=[ 234], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 125, per=25.34%, avg=41.04, stdev=23.79, samples=302 iops : min= 1, max= 31, avg= 9.62, stdev= 6.00, samples=302 lat (msec) : 10=2.51%, 20=16.18%, 50=47.01%, 100=23.44%, 250=10.61% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.88%, ctx=4813, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179614: Wed Sep 9 02:38:55 2026 read: IOPS=9, BW=39.0KiB/s (39.0kB/s)(6028KiB/154378msec) clat (msec): min=4, max=278, avg=39.98, stdev=36.47 lat (msec): min=4, max=278, avg=39.98, stdev=36.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 178], 99.50th=[ 211], 99.90th=[ 275], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 136, per=25.62%, avg=39.72, stdev=24.80, samples=296 iops : min= 1, max= 34, avg= 9.29, stdev= 6.26, samples=296 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6260KiB/154378msec); 0 zone resets clat (msec): min=9, max=1218, avg=59.87, stdev=50.70 lat (msec): min=9, max=1218, avg=59.87, stdev=50.70 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 127, per=25.13%, avg=40.72, stdev=24.40, samples=300 iops : min= 1, max= 31, avg= 9.53, stdev= 6.15, samples=300 lat (msec) : 10=3.12%, 20=16.41%, 50=45.31%, 100=24.48%, 250=10.25% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4750, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179617: Wed Sep 9 02:38:55 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6052KiB/153984msec) clat (msec): min=4, max=282, avg=39.06, stdev=34.34 lat (msec): min=4, max=282, avg=39.06, stdev=34.34 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 107], | 99.00th=[ 182], 99.50th=[ 199], 99.90th=[ 279], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 127, per=25.98%, avg=40.27, stdev=26.20, samples=293 iops : min= 1, max= 31, avg= 9.42, stdev= 6.58, samples=293 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6236KiB/153984msec); 0 zone resets clat (msec): min=10, max=1240, avg=60.58, stdev=51.05 lat (msec): min=10, max=1240, avg=60.59, stdev=51.05 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 86], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 363], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 112, per=25.00%, avg=40.49, stdev=23.57, samples=300 iops : min= 1, max= 28, avg= 9.48, stdev= 5.95, samples=300 lat (msec) : 10=2.90%, 20=15.66%, 50=46.52%, 100=24.74%, 250=9.86% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.79%, ctx=4757, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.4KiB/s-39.3KiB/s (39.3kB/s-40.2kB/s), io=23.4MiB (24.6MB), run=153867-154574msec WRITE: bw=163KiB/s (167kB/s), 40.5KiB/s-41.1KiB/s (41.5kB/s-42.1kB/s), io=24.6MiB (25.7MB), run=153867-154574msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179655: Wed Sep 9 02:39:34 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27010msec) clat (usec): min=33, max=165003, avg=40018.76, stdev=27322.73 lat (usec): min=34, max=165004, avg=40020.71, stdev=27323.84 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 219], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[154141], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 442, per=25.17%, avg=218.49, stdev=85.90, samples=53 iops : min= 1, max= 27, avg=12.92, stdev= 5.46, samples=53 write: IOPS=14, BW=236KiB/s (241kB/s)(6368KiB/27010msec); 0 zone resets clat (usec): min=1440, max=255669, avg=30254.54, stdev=31299.40 lat (usec): min=1440, max=255671, avg=30257.02, stdev=31300.00 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2245], 10.00th=[ 3523], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 13960], 50.00th=[ 21365], 60.00th=[ 29754], | 70.00th=[ 38536], 80.00th=[ 49546], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[124257], 99.50th=[248513], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 382, per=25.74%, avg=235.02, stdev=72.65, samples=53 iops : min= 1, max= 23, avg=13.98, stdev= 4.53, samples=53 lat (usec) : 50=0.52%, 100=3.65%, 250=0.91%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.30%, 10=11.59%, 20=11.72%, 50=39.84% lat (msec) : 100=22.79%, 250=2.47%, 500=0.13% cpu : usr=0.07%, sys=6.60%, ctx=1710, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179656: Wed Sep 9 02:39:34 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5744KiB/27469msec) clat (usec): min=44, max=239595, avg=41229.62, stdev=27344.50 lat (usec): min=45, max=239596, avg=41231.05, stdev=27344.79 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 14091], 20.00th=[ 21103], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[133694], 99.50th=[181404], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 62, max= 381, per=23.95%, avg=207.93, stdev=80.86, samples=54 iops : min= 3, max= 23, avg=12.28, stdev= 5.14, samples=54 write: IOPS=14, BW=238KiB/s (244kB/s)(6544KiB/27469msec); 0 zone resets clat (usec): min=1425, max=168567, avg=30775.83, stdev=29541.65 lat (usec): min=1427, max=168568, avg=30780.53, stdev=29542.61 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1975], 10.00th=[ 2933], 20.00th=[ 5080], | 30.00th=[ 8979], 40.00th=[ 17171], 50.00th=[ 23200], 60.00th=[ 29754], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[128451], 99.50th=[135267], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 95, max= 535, per=26.00%, avg=237.35, stdev=100.34, samples=54 iops : min= 5, max= 33, avg=14.13, stdev= 6.32, samples=54 lat (usec) : 50=0.13%, 100=2.73%, 250=0.52%, 500=0.26% lat (msec) : 2=2.86%, 4=5.60%, 10=8.85%, 20=11.85%, 50=41.41% lat (msec) : 100=23.18%, 250=2.60% cpu : usr=0.09%, sys=6.56%, ctx=1713, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179657: Wed Sep 9 02:39:34 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(6256KiB/27574msec) clat (usec): min=38, max=207206, avg=40702.99, stdev=28213.73 lat (usec): min=38, max=207208, avg=40712.30, stdev=28218.43 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 660], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[189793], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 427, per=26.17%, avg=227.17, stdev=75.67, samples=54 iops : min= 3, max= 26, avg=13.48, stdev= 4.78, samples=54 write: IOPS=13, BW=219KiB/s (224kB/s)(6032KiB/27574msec); 0 zone resets clat (usec): min=1506, max=164274, avg=30487.73, stdev=30734.04 lat (usec): min=1508, max=164275, avg=30491.12, stdev=30734.97 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 2933], 20.00th=[ 4621], | 30.00th=[ 7898], 40.00th=[ 13173], 50.00th=[ 19530], 60.00th=[ 27395], | 70.00th=[ 39060], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[158335], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 597, per=23.49%, avg=214.48, stdev=98.66, samples=54 iops : min= 3, max= 37, avg=12.67, stdev= 6.27, samples=54 lat (usec) : 50=0.78%, 100=3.78%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=2.86%, 4=5.34%, 10=8.72%, 20=12.37%, 50=37.89% lat (msec) : 100=24.09%, 250=3.52% cpu : usr=0.06%, sys=6.55%, ctx=1703, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179658: Wed Sep 9 02:39:34 2026 read: IOPS=14, BW=228KiB/s (234kB/s)(6032KiB/26409msec) clat (usec): min=49, max=146423, avg=36680.14, stdev=26020.23 lat (usec): min=49, max=146424, avg=36682.22, stdev=26020.16 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 58], 10.00th=[ 74], 20.00th=[ 17171], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 56361], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[116917], 99.50th=[143655], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 31, max= 458, per=26.04%, avg=226.06, stdev=81.82, samples=52 iops : min= 1, max= 28, avg=13.42, stdev= 5.12, samples=52 write: IOPS=14, BW=237KiB/s (243kB/s)(6256KiB/26409msec); 0 zone resets clat (usec): min=1458, max=341121, avg=31771.56, stdev=33753.75 lat (usec): min=1459, max=341123, avg=31773.69, stdev=33753.53 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 5342], | 30.00th=[ 8717], 40.00th=[ 13304], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 42730], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[133694], 99.50th=[143655], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 90, max= 573, per=25.88%, avg=236.33, stdev=88.41, samples=52 iops : min= 5, max= 35, avg=14.06, stdev= 5.57, samples=52 lat (usec) : 50=0.13%, 100=5.60%, 250=0.26%, 500=0.13% lat (msec) : 2=2.21%, 4=5.34%, 10=10.55%, 20=11.72%, 50=39.84% lat (msec) : 100=20.83%, 250=3.26%, 500=0.13% cpu : usr=0.04%, sys=6.74%, ctx=1670, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=869KiB/s (889kB/s), 209KiB/s-228KiB/s (214kB/s-234kB/s), io=23.4MiB (24.5MB), run=26409-27574msec WRITE: bw=914KiB/s (936kB/s), 219KiB/s-238KiB/s (224kB/s-244kB/s), io=24.6MiB (25.8MB), run=26409-27574msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179660: Wed Sep 9 02:39:45 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37865msec) clat (msec): min=6, max=176, avg=39.31, stdev=34.19 lat (msec): min=6, max=176, avg=39.32, stdev=34.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 120], | 99.00th=[ 159], 99.50th=[ 169], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 444, per=24.66%, avg=155.84, stdev=100.92, samples=73 iops : min= 1, max= 27, avg= 8.96, stdev= 6.29, samples=73 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37865msec); 0 zone resets clat (msec): min=14, max=445, avg=58.45, stdev=45.35 lat (msec): min=14, max=445, avg=58.45, stdev=45.35 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 111], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 292], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 415, per=25.48%, avg=169.44, stdev=103.25, samples=73 iops : min= 1, max= 25, avg= 9.81, stdev= 6.46, samples=73 lat (msec) : 10=2.08%, 20=17.06%, 50=47.66%, 100=22.01%, 250=10.94% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.92%, ctx=1258, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179661: Wed Sep 9 02:39:45 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(5744KiB/37618msec) clat (msec): min=7, max=181, avg=38.53, stdev=31.35 lat (msec): min=7, max=181, avg=38.53, stdev=31.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 159], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 30, max= 415, per=25.31%, avg=159.93, stdev=96.63, samples=71 iops : min= 1, max= 25, avg= 9.21, stdev= 6.03, samples=71 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37618msec); 0 zone resets clat (msec): min=11, max=419, avg=57.95, stdev=40.85 lat (msec): min=11, max=419, avg=57.96, stdev=40.85 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 174], 99.50th=[ 215], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 62, max= 440, per=26.11%, avg=173.65, stdev=95.22, samples=74 iops : min= 3, max= 27, avg=10.08, stdev= 5.95, samples=74 lat (msec) : 10=1.43%, 20=14.19%, 50=51.30%, 100=22.40%, 250=10.55% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.05%, ctx=1215, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179662: Wed Sep 9 02:39:45 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37805msec) clat (msec): min=7, max=312, avg=39.33, stdev=37.18 lat (msec): min=7, max=312, avg=39.33, stdev=37.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 88], 95.00th=[ 122], | 99.00th=[ 176], 99.50th=[ 262], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 479, per=26.39%, avg=166.78, stdev=113.72, samples=74 iops : min= 1, max= 29, avg= 9.64, stdev= 7.09, samples=74 write: IOPS=9, BW=160KiB/s (163kB/s)(6032KiB/37805msec); 0 zone resets clat (msec): min=15, max=289, avg=59.25, stdev=39.23 lat (msec): min=15, max=289, avg=59.25, stdev=39.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 93], 90.00th=[ 117], 95.00th=[ 140], | 99.00th=[ 194], 99.50th=[ 201], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 350, per=23.78%, avg=158.11, stdev=87.16, samples=74 iops : min= 1, max= 21, avg= 9.11, stdev= 5.45, samples=74 lat (msec) : 10=1.30%, 20=16.28%, 50=50.39%, 100=20.18%, 250=11.46% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.92%, ctx=1217, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179663: Wed Sep 9 02:39:45 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37696msec) clat (msec): min=7, max=309, avg=42.33, stdev=41.88 lat (msec): min=7, max=309, avg=42.33, stdev=41.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 124], | 99.00th=[ 236], 99.50th=[ 296], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 441, per=25.81%, avg=163.10, stdev=93.10, samples=72 iops : min= 1, max= 27, avg= 9.42, stdev= 5.82, samples=72 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37696msec); 0 zone resets clat (msec): min=17, max=208, avg=55.47, stdev=35.22 lat (msec): min=17, max=208, avg=55.47, stdev=35.22 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 77], 90.00th=[ 106], 95.00th=[ 136], | 99.00th=[ 182], 99.50th=[ 188], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 447, per=24.96%, avg=166.00, stdev=97.40, samples=74 iops : min= 1, max= 27, avg= 9.59, stdev= 6.08, samples=74 lat (msec) : 10=1.43%, 20=15.89%, 50=50.00%, 100=22.79%, 250=9.51% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.06%, ctx=1177, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=633KiB/s (648kB/s), 153KiB/s-165KiB/s (156kB/s-169kB/s), io=23.4MiB (24.5MB), run=37618-37865msec WRITE: bw=666KiB/s (681kB/s), 160KiB/s-174KiB/s (163kB/s-178kB/s), io=24.6MiB (25.8MB), run=37618-37865msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179674: Wed Sep 9 02:39:59 2026 read: IOPS=2, BW=2055KiB/s (2104kB/s)(7168KiB/3488msec) clat (msec): min=134, max=410, avg=211.77, stdev=95.48 lat (msec): min=134, max=410, avg=211.77, stdev=95.48 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 157], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 176], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 251], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1928, max= 4179, per=54.19%, avg=2528.50, stdev=1101.14, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1468KiB/s (1503kB/s)(5120KiB/3488msec); 0 zone resets clat (msec): min=156, max=824, avg=394.12, stdev=268.98 lat (msec): min=156, max=824, avg=394.20, stdev=268.97 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1393, max= 2031, per=28.43%, avg=1856.75, stdev=310.18, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=17.92%, ctx=324, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179675: Wed Sep 9 02:39:59 2026 read: IOPS=0, BW=467KiB/s (478kB/s)(2048KiB/4389msec) clat (msec): min=137, max=151, avg=144.38, stdev= 9.86 lat (msec): min=137, max=151, avg=144.38, stdev= 9.86 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1448, max= 2048, per=37.46%, avg=1748.00, stdev=424.26, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2333KiB/s (2389kB/s)(10.0MiB/4389msec); 0 zone resets clat (msec): min=79, max=970, avg=401.97, stdev=281.00 lat (msec): min=79, max=970, avg=402.08, stdev=280.98 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 197], | 30.00th=[ 203], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 305], | 70.00th=[ 550], 80.00th=[ 617], 90.00th=[ 651], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1928, max= 6144, per=46.44%, avg=3033.67, stdev=1741.41, samples=6 iops : min= 1, max= 6, avg= 2.33, stdev= 2.16, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=19.28%, ctx=263, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179676: Wed Sep 9 02:39:59 2026 read: IOPS=1, BW=1809KiB/s (1853kB/s)(6144KiB/3396msec) clat (usec): min=1288, max=250916, avg=159314.49, stdev=107419.68 lat (usec): min=1289, max=250917, avg=159315.86, stdev=107419.83 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1287], 10.00th=[ 1287], 20.00th=[ 44303], | 30.00th=[ 44303], 40.00th=[214959], 50.00th=[214959], 60.00th=[217056], | 70.00th=[227541], 80.00th=[227541], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 1976, max= 4063, per=54.10%, avg=2524.25, stdev=1026.14, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1809KiB/s (1853kB/s)(6144KiB/3396msec); 0 zone resets clat (msec): min=177, max=769, avg=389.72, stdev=206.85 lat (msec): min=177, max=769, avg=389.89, stdev=206.88 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 351], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1454, max= 3953, per=34.90%, avg=2279.40, stdev=965.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 50=8.33%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=18.91%, ctx=220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179677: Wed Sep 9 02:39:59 2026 read: IOPS=1, BW=1565KiB/s (1602kB/s)(5120KiB/3272msec) clat (usec): min=482, max=240788, avg=87214.40, stdev=119667.70 lat (usec): min=483, max=240789, avg=87215.37, stdev=119667.79 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 494], 40.00th=[ 494], 50.00th=[ 1090], 60.00th=[ 1090], | 70.00th=[193987], 80.00th=[193987], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2191KiB/s (2243kB/s)(7168KiB/3272msec); 0 zone resets clat (msec): min=210, max=645, avg=389.79, stdev=180.86 lat (msec): min=215, max=645, avg=390.57, stdev=180.07 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 234], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 330], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 609], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1452, max= 2031, per=29.20%, avg=1907.50, stdev=226.88, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=17.46%, ctx=192, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4666KiB/s (4778kB/s), 467KiB/s-2055KiB/s (478kB/s-2104kB/s), io=20.0MiB (20.0MB), run=3272-4389msec WRITE: bw=6533KiB/s (6689kB/s), 1468KiB/s-2333KiB/s (1503kB/s-2389kB/s), io=28.0MiB (29.4MB), run=3272-4389msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179679: Wed Sep 9 02:40:00 2026 read: IOPS=1, BW=1751KiB/s (1793kB/s)(7168KiB/4093msec) clat (msec): min=95, max=681, avg=300.50, stdev=222.12 lat (msec): min=95, max=681, avg=300.50, stdev=222.12 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 122], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 228], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 527], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1815, max= 4055, per=51.59%, avg=2469.50, stdev=1061.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1251KiB/s (1281kB/s)(5120KiB/4093msec); 0 zone resets clat (msec): min=244, max=700, avg=360.64, stdev=190.91 lat (msec): min=244, max=700, avg=360.72, stdev=190.90 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2027, max= 4071, per=40.49%, avg=2713.67, stdev=1175.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=8.70%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179680: Wed Sep 9 02:40:00 2026 read: IOPS=0, BW=496KiB/s (508kB/s)(2048KiB/4129msec) clat (msec): min=179, max=406, avg=292.99, stdev=161.18 lat (msec): min=179, max=406, avg=292.99, stdev=161.18 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2007, max= 2035, per=42.22%, avg=2021.00, stdev=19.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2480KiB/s (2540kB/s)(10.0MiB/4129msec); 0 zone resets clat (msec): min=94, max=765, avg=348.94, stdev=229.77 lat (msec): min=94, max=767, avg=349.32, stdev=230.24 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 102], | 30.00th=[ 167], 40.00th=[ 201], 50.00th=[ 292], 60.00th=[ 296], | 70.00th=[ 409], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1965, max= 6131, per=45.49%, avg=3048.67, stdev=1722.08, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=6.42%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179681: Wed Sep 9 02:40:00 2026 read: IOPS=1, BW=1572KiB/s (1609kB/s)(6144KiB/3909msec) clat (msec): min=138, max=667, avg=324.13, stdev=219.18 lat (msec): min=138, max=667, avg=324.13, stdev=219.18 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 351], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2027, max= 4087, per=53.23%, avg=2548.00, stdev=1026.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1572KiB/s (1609kB/s)(6144KiB/3909msec); 0 zone resets clat (msec): min=187, max=436, avg=317.56, stdev=89.56 lat (msec): min=187, max=436, avg=317.77, stdev=89.45 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 347], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1965, max= 2035, per=29.91%, avg=2004.60, stdev=36.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=5.66%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179682: Wed Sep 9 02:40:00 2026 read: IOPS=1, BW=1197KiB/s (1226kB/s)(5120KiB/4278msec) clat (msec): min=67, max=596, avg=319.03, stdev=236.57 lat (msec): min=67, max=596, avg=319.03, stdev=236.57 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1965, max= 4071, per=56.26%, avg=2693.00, stdev=1194.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1676KiB/s (1716kB/s)(7168KiB/4278msec); 0 zone resets clat (msec): min=127, max=722, avg=363.10, stdev=189.67 lat (msec): min=127, max=722, avg=363.18, stdev=189.67 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 264], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 309], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 451], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2027, max= 4087, per=38.00%, avg=2547.00, stdev=1026.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=5.78%, ctx=134, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4787KiB/s (4902kB/s), 496KiB/s-1751KiB/s (508kB/s-1793kB/s), io=20.0MiB (20.0MB), run=3909-4278msec WRITE: bw=6702KiB/s (6863kB/s), 1251KiB/s-2480KiB/s (1281kB/s-2540kB/s), io=28.0MiB (29.4MB), run=3909-4278msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179690: Wed Sep 9 02:40:13 2026 read: IOPS=2, BW=11.5MiB/s (12.1MB/s)(12.0MiB/1042msec) clat (msec): min=190, max=544, avg=329.20, stdev=188.69 lat (msec): min=190, max=544, avg=329.20, stdev=188.69 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min=13342, max=13342, per=100.00%, avg=13342.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=10.85%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Wed Sep 9 02:40:13 2026 read: IOPS=0, BW=2463KiB/s (2522kB/s)(4096KiB/1663msec) clat (nsec): min=381328k, max=381328k, avg=381327597.00, stdev= 0.00 lat (nsec): min=381329k, max=381329k, avg=381329354.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 6826, max= 6826, per=69.29%, avg=6826.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4926KiB/s (5044kB/s)(8192KiB/1663msec); 0 zone resets clat (msec): min=348, max=843, avg=595.87, stdev=350.48 lat (msec): min=348, max=844, avg=596.42, stdev=350.73 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8143, max= 8143, per=78.28%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.78%, ctx=50, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Wed Sep 9 02:40:13 2026 write: IOPS=0, BW=3901KiB/s (3995kB/s)(12.0MiB/3150msec); 0 zone resets clat (msec): min=448, max=1842, avg=1014.20, stdev=733.32 lat (msec): min=448, max=1843, avg=1014.74, stdev=733.77 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8110, max= 8143, per=78.12%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.70%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Wed Sep 9 02:40:13 2026 write: IOPS=1, BW=5141KiB/s (5265kB/s)(12.0MiB/2390msec); 0 zone resets clat (msec): min=304, max=1462, avg=757.55, stdev=619.00 lat (msec): min=304, max=1463, avg=757.86, stdev=619.11 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 6501, max= 8143, per=70.39%, avg=7322.00, stdev=1161.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.90%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9852KiB/s (10.1MB/s), 2463KiB/s-11.5MiB/s (2522kB/s-12.1MB/s), io=16.0MiB (16.8MB), run=1042-1663msec WRITE: bw=10.2MiB/s (10.7MB/s), 3901KiB/s-5141KiB/s (3995kB/s-5265kB/s), io=32.0MiB (33.6MB), run=1663-3150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Wed Sep 9 02:40:14 2026 read: IOPS=1, BW=6279KiB/s (6430kB/s)(12.0MiB/1957msec) clat (msec): min=527, max=725, avg=651.99, stdev=108.25 lat (msec): min=527, max=725, avg=651.99, stdev=108.25 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7968, max= 8159, per=100.00%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=15.18%, ctx=400, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Wed Sep 9 02:40:14 2026 read: IOPS=0, BW=1862KiB/s (1907kB/s)(4096KiB/2200msec) clat (nsec): min=801935k, max=801935k, avg=801935217.00, stdev= 0.00 lat (nsec): min=801938k, max=801938k, avg=801937612.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3724KiB/s (3813kB/s)(8192KiB/2200msec); 0 zone resets clat (msec): min=546, max=846, avg=696.12, stdev=212.11 lat (msec): min=548, max=846, avg=697.31, stdev=210.86 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7953, max= 7953, per=66.19%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.28%, ctx=146, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Wed Sep 9 02:40:14 2026 write: IOPS=1, BW=4506KiB/s (4614kB/s)(12.0MiB/2727msec); 0 zone resets clat (msec): min=176, max=1845, avg=907.76, stdev=853.27 lat (msec): min=177, max=1845, avg=907.99, stdev=853.38 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8078, max= 8159, per=67.56%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.99%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Wed Sep 9 02:40:14 2026 write: IOPS=1, BW=4660KiB/s (4772kB/s)(12.0MiB/2637msec); 0 zone resets clat (msec): min=372, max=1325, avg=874.88, stdev=478.43 lat (msec): min=372, max=1325, avg=875.12, stdev=478.44 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8143, max= 8159, per=67.83%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.55%, ctx=42, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7447KiB/s (7626kB/s), 1862KiB/s-6279KiB/s (1907kB/s-6430kB/s), io=16.0MiB (16.8MB), run=1957-2200msec WRITE: bw=11.7MiB/s (12.3MB/s), 3724KiB/s-4660KiB/s (3813kB/s-4772kB/s), io=32.0MiB (33.6MB), run=2200-2727msec