== sanity test 398b: DIO and buffer IO race ============== 19:38:36 (1787787516) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.21092 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Wed Aug 26 19:41:02 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5992KiB/124837msec) clat (usec): min=45, max=536931, avg=46744.04, stdev=32422.24 lat (usec): min=46, max=536933, avg=46746.33, stdev=32422.11 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12911], 10.00th=[ 18482], 20.00th=[ 24249], | 30.00th=[ 29230], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[156238], 99.50th=[198181], 99.90th=[258999], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 103, per=25.48%, avg=47.65, stdev=18.13, samples=245 iops : min= 1, max= 25, avg=11.26, stdev= 4.57, samples=245 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124837msec); 0 zone resets clat (usec): min=934, max=328166, avg=34495.21, stdev=37031.00 lat (usec): min=935, max=328167, avg=34499.28, stdev=37031.16 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1450], 20.00th=[ 3359], | 30.00th=[ 7046], 40.00th=[ 14877], 50.00th=[ 23725], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[166724], 99.50th=[193987], 99.90th=[231736], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 134, per=25.65%, avg=50.28, stdev=22.40, samples=244 iops : min= 1, max= 33, avg=11.93, stdev= 5.64, samples=244 lat (usec) : 50=0.33%, 100=1.11%, 250=0.07%, 500=0.10%, 1000=0.20% lat (msec) : 2=7.39%, 4=3.61%, 10=6.87%, 20=9.28%, 50=40.79% lat (msec) : 100=25.03%, 250=5.14%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=5.22%, ctx=6437, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Wed Aug 26 19:41:02 2026 read: IOPS=11, BW=47.3KiB/s (48.5kB/s)(5940KiB/125519msec) clat (usec): min=46, max=276424, avg=47121.63, stdev=31726.53 lat (usec): min=46, max=276425, avg=47129.11, stdev=31732.14 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12256], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[164627], 99.50th=[212861], 99.90th=[248513], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 5, max= 104, per=25.02%, avg=46.78, stdev=18.27, samples=247 iops : min= 1, max= 26, avg=11.04, stdev= 4.60, samples=247 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6348KiB/125519msec); 0 zone resets clat (usec): min=958, max=517702, avg=34723.85, stdev=38443.47 lat (usec): min=958, max=517703, avg=34731.50, stdev=38438.87 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 2966], | 30.00th=[ 5800], 40.00th=[ 12125], 50.00th=[ 24249], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[160433], 99.50th=[183501], 99.90th=[242222], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 119, per=25.61%, avg=50.19, stdev=21.68, samples=246 iops : min= 1, max= 29, avg=11.89, stdev= 5.42, samples=246 lat (usec) : 50=0.16%, 100=1.33%, 250=0.20%, 1000=0.13% lat (msec) : 2=7.58%, 4=4.59%, 10=7.26%, 20=9.44%, 50=37.70% lat (msec) : 100=25.39%, 250=6.15%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.12%, ctx=6431, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Wed Aug 26 19:41:02 2026 read: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6028KiB/127765msec) clat (usec): min=33, max=282772, avg=46359.66, stdev=31121.72 lat (usec): min=33, max=282773, avg=46364.53, stdev=31120.56 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 13042], 10.00th=[ 17695], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[204473], 99.90th=[261096], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 103, per=25.05%, avg=46.85, stdev=18.39, samples=251 iops : min= 1, max= 25, avg=11.06, stdev= 4.62, samples=251 write: IOPS=12, BW=48.0KiB/s (50.2kB/s)(6260KiB/127765msec); 0 zone resets clat (usec): min=922, max=681780, avg=36730.74, stdev=40675.42 lat (usec): min=923, max=681783, avg=36740.22, stdev=40678.89 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3949], | 30.00th=[ 7963], 40.00th=[ 17695], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 60556], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[168821], 99.50th=[191890], 99.90th=[229639], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 104, per=24.84%, avg=48.69, stdev=20.14, samples=251 iops : min= 1, max= 26, avg=11.52, stdev= 5.06, samples=251 lat (usec) : 50=0.20%, 100=1.27%, 250=0.03%, 1000=0.26% lat (msec) : 2=6.18%, 4=4.17%, 10=6.12%, 20=10.77%, 50=39.10% lat (msec) : 100=26.11%, 250=5.70%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.08%, ctx=6507, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Wed Aug 26 19:41:02 2026 read: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6052KiB/128255msec) clat (usec): min=34, max=247035, avg=46727.62, stdev=31299.80 lat (usec): min=34, max=247035, avg=46728.99, stdev=31299.81 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11207], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[158335], 99.50th=[202376], 99.90th=[231736], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 87, per=25.06%, avg=46.86, stdev=17.17, samples=252 iops : min= 1, max= 21, avg=11.06, stdev= 4.31, samples=252 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6236KiB/128255msec); 0 zone resets clat (usec): min=923, max=682006, avg=36632.66, stdev=40770.02 lat (usec): min=926, max=682008, avg=36634.71, stdev=40770.25 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1532], 20.00th=[ 3687], | 30.00th=[ 7570], 40.00th=[ 17433], 50.00th=[ 27132], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[160433], 99.50th=[183501], 99.90th=[270533], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 127, per=24.70%, avg=48.40, stdev=20.40, samples=251 iops : min= 1, max= 31, avg=11.45, stdev= 5.14, samples=251 lat (usec) : 50=0.46%, 100=1.30%, 250=0.20%, 500=0.03%, 1000=0.16% lat (msec) : 2=6.15%, 4=4.52%, 10=6.15%, 20=9.41%, 50=39.68% lat (msec) : 100=25.78%, 250=6.09%, 500=0.03%, 750=0.03% cpu : usr=0.06%, sys=4.90%, ctx=6403, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=187KiB/s (192kB/s), 47.2KiB/s-47.0KiB/s (48.3kB/s-49.1kB/s), io=23.4MiB (24.6MB), run=124837-128255msec WRITE: bw=196KiB/s (201kB/s), 48.6KiB/s-50.6KiB/s (49.8kB/s-51.8kB/s), io=24.6MiB (25.7MB), run=124837-128255msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Wed Aug 26 19:41:44 2026 read: IOPS=8, BW=35.5KiB/s (36.4kB/s)(5992KiB/168735msec) clat (msec): min=5, max=537, avg=43.56, stdev=43.15 lat (msec): min=5, max=537, avg=43.56, stdev=43.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 131], | 99.00th=[ 205], 99.50th=[ 230], 99.90th=[ 347], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 119, per=25.68%, avg=36.21, stdev=24.69, samples=321 iops : min= 1, max= 29, avg= 8.40, stdev= 6.23, samples=321 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6296KiB/168735msec); 0 zone resets clat (msec): min=11, max=357, avg=65.51, stdev=45.17 lat (msec): min=11, max=357, avg=65.51, stdev=45.17 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 96], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 253], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 112, per=25.34%, avg=37.25, stdev=23.12, samples=328 iops : min= 1, max= 28, avg= 8.66, stdev= 5.84, samples=328 lat (msec) : 10=1.82%, 20=14.23%, 50=45.08%, 100=24.93%, 250=13.41% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4675, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Wed Aug 26 19:41:44 2026 read: IOPS=8, BW=34.9KiB/s (35.8kB/s)(5940KiB/170035msec) clat (msec): min=5, max=670, avg=44.23, stdev=46.14 lat (msec): min=5, max=670, avg=44.23, stdev=46.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 96], 95.00th=[ 133], | 99.00th=[ 213], 99.50th=[ 275], 99.90th=[ 351], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 127, per=25.38%, avg=35.79, stdev=24.51, samples=323 iops : min= 1, max= 31, avg= 8.29, stdev= 6.18, samples=323 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6348KiB/170035msec); 0 zone resets clat (msec): min=10, max=351, avg=65.52, stdev=45.71 lat (msec): min=10, max=351, avg=65.52, stdev=45.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 131], 95.00th=[ 155], | 99.00th=[ 228], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 127, per=25.41%, avg=37.36, stdev=24.08, samples=331 iops : min= 1, max= 31, avg= 8.69, stdev= 6.08, samples=331 lat (msec) : 10=2.15%, 20=14.36%, 50=44.82%, 100=24.28%, 250=13.90% lat (msec) : 500=0.46%, 750=0.03% cpu : usr=0.06%, sys=1.68%, ctx=4799, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Wed Aug 26 19:41:44 2026 read: IOPS=8, BW=35.6KiB/s (36.4kB/s)(6028KiB/169360msec) clat (msec): min=5, max=343, avg=42.21, stdev=39.40 lat (msec): min=5, max=343, avg=42.22, stdev=39.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 296], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 143, per=25.22%, avg=35.56, stdev=25.16, samples=329 iops : min= 1, max= 35, avg= 8.23, stdev= 6.34, samples=329 write: IOPS=9, BW=36.0KiB/s (37.8kB/s)(6260KiB/169360msec); 0 zone resets clat (msec): min=9, max=691, avg=67.33, stdev=50.31 lat (msec): min=9, max=691, avg=67.33, stdev=50.31 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 97], 90.00th=[ 133], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 264], 99.90th=[ 372], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 111, per=24.92%, avg=36.63, stdev=23.57, samples=331 iops : min= 1, max= 27, avg= 8.50, stdev= 5.95, samples=331 lat (msec) : 10=2.08%, 20=14.26%, 50=45.44%, 100=24.12%, 250=13.48% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.07%, sys=1.76%, ctx=4794, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Wed Aug 26 19:41:44 2026 read: IOPS=9, BW=36.0KiB/s (36.9kB/s)(6052KiB/168080msec) clat (msec): min=6, max=332, avg=41.34, stdev=38.02 lat (msec): min=6, max=332, avg=41.34, stdev=38.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 93], 95.00th=[ 125], | 99.00th=[ 171], 99.50th=[ 207], 99.90th=[ 288], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 135, per=26.25%, avg=37.01, stdev=25.35, samples=318 iops : min= 1, max= 33, avg= 8.60, stdev= 6.39, samples=318 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6236KiB/168080msec); 0 zone resets clat (msec): min=11, max=686, avg=67.47, stdev=51.07 lat (msec): min=11, max=686, avg=67.47, stdev=51.07 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 100], 90.00th=[ 132], 95.00th=[ 163], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 363], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 118, per=25.06%, avg=36.84, stdev=23.41, samples=329 iops : min= 1, max= 29, avg= 8.55, stdev= 5.91, samples=329 lat (msec) : 10=1.95%, 20=15.56%, 50=45.48%, 100=22.46%, 250=13.93% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4579, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (145kB/s), 34.9KiB/s-36.0KiB/s (35.8kB/s-36.9kB/s), io=23.4MiB (24.6MB), run=168080-170035msec WRITE: bw=148KiB/s (151kB/s), 36.0KiB/s-37.3KiB/s (37.8kB/s-38.2kB/s), io=24.6MiB (25.7MB), run=168080-170035msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179745: Wed Aug 26 19:42:32 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(5920KiB/36932msec) clat (usec): min=42, max=201944, avg=49623.79, stdev=33343.87 lat (usec): min=43, max=201946, avg=49625.12, stdev=33343.67 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 63], 10.00th=[ 16909], 20.00th=[ 26084], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[179307], 99.50th=[198181], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 319, per=24.88%, avg=160.24, stdev=67.06, samples=71 iops : min= 1, max= 19, avg= 9.24, stdev= 4.22, samples=71 write: IOPS=10, BW=172KiB/s (177kB/s)(6368KiB/36932msec); 0 zone resets clat (usec): min=1400, max=253560, avg=46509.30, stdev=43292.39 lat (usec): min=1400, max=253563, avg=46550.03, stdev=43286.24 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1893], 10.00th=[ 3752], 20.00th=[ 7963], | 30.00th=[ 15926], 40.00th=[ 23462], 50.00th=[ 34866], 60.00th=[ 46400], | 70.00th=[ 61080], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[135267], | 99.00th=[189793], 99.50th=[200279], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 369, per=25.25%, avg=171.19, stdev=67.61, samples=72 iops : min= 1, max= 23, avg= 9.93, stdev= 4.31, samples=72 lat (usec) : 50=0.13%, 100=3.91%, 250=0.13% lat (msec) : 2=2.99%, 4=2.60%, 10=6.38%, 20=8.85%, 50=35.42% lat (msec) : 100=30.47%, 250=8.98%, 500=0.13% cpu : usr=0.08%, sys=5.29%, ctx=1715, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179746: Wed Aug 26 19:42:32 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36167msec) clat (usec): min=52, max=276626, avg=54305.07, stdev=36184.32 lat (usec): min=53, max=276627, avg=54308.46, stdev=36183.35 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 20055], 20.00th=[ 27657], | 30.00th=[ 36439], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 55837], | 70.00th=[ 65799], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[113771], | 99.00th=[204473], 99.50th=[242222], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 319, per=24.50%, avg=157.80, stdev=62.02, samples=71 iops : min= 1, max= 19, avg= 9.07, stdev= 3.91, samples=71 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36167msec); 0 zone resets clat (usec): min=1389, max=203747, avg=40599.27, stdev=38542.11 lat (usec): min=1392, max=203749, avg=40601.50, stdev=38542.09 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2573], 10.00th=[ 3720], 20.00th=[ 7046], | 30.00th=[ 13173], 40.00th=[ 21103], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[162530], 99.50th=[175113], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 348, per=26.66%, avg=180.77, stdev=78.78, samples=71 iops : min= 1, max= 21, avg=10.54, stdev= 4.94, samples=71 lat (usec) : 100=2.86%, 250=0.26%, 500=0.39% lat (msec) : 2=1.95%, 4=4.04%, 10=8.20%, 20=7.94%, 50=35.42% lat (msec) : 100=30.73%, 250=8.07%, 500=0.13% cpu : usr=0.05%, sys=5.31%, ctx=1695, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179747: Wed Aug 26 19:42:32 2026 read: IOPS=10, BW=168KiB/s (173kB/s)(6256KiB/37137msec) clat (usec): min=49, max=205584, avg=53632.89, stdev=34137.35 lat (usec): min=50, max=205585, avg=53634.26, stdev=34137.40 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 82], 10.00th=[ 18220], 20.00th=[ 29230], | 30.00th=[ 35390], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 55313], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[166724], 99.50th=[179307], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 319, per=26.17%, avg=168.51, stdev=56.51, samples=73 iops : min= 3, max= 19, avg= 9.75, stdev= 3.60, samples=73 write: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37137msec); 0 zone resets clat (usec): min=1475, max=311527, avg=42716.34, stdev=41774.32 lat (usec): min=1479, max=311530, avg=42721.71, stdev=41771.91 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2737], 10.00th=[ 4752], 20.00th=[ 8848], | 30.00th=[ 14877], 40.00th=[ 22938], 50.00th=[ 30540], 60.00th=[ 39584], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[128451], | 99.00th=[183501], 99.50th=[270533], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 319, per=23.58%, avg=159.90, stdev=63.17, samples=73 iops : min= 1, max= 19, avg= 9.21, stdev= 3.99, samples=73 lat (usec) : 50=0.13%, 100=2.99%, 250=0.52%, 750=0.13% lat (msec) : 2=1.82%, 4=2.08%, 10=7.68%, 20=7.94%, 50=35.68% lat (msec) : 100=31.77%, 250=8.98%, 500=0.26% cpu : usr=0.08%, sys=5.68%, ctx=1810, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179748: Wed Aug 26 19:42:32 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35668msec) clat (usec): min=52, max=272953, avg=52040.83, stdev=36735.48 lat (usec): min=53, max=272955, avg=52048.14, stdev=36734.62 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 67], 10.00th=[ 437], 20.00th=[ 26084], | 30.00th=[ 33162], 40.00th=[ 39060], 50.00th=[ 46924], 60.00th=[ 53740], | 70.00th=[ 61604], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[168821], 99.50th=[240124], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 318, per=26.50%, avg=170.64, stdev=61.31, samples=69 iops : min= 1, max= 19, avg= 9.87, stdev= 3.86, samples=69 write: IOPS=10, BW=175KiB/s (180kB/s)(6256KiB/35668msec); 0 zone resets clat (usec): min=1393, max=231267, avg=40908.95, stdev=38872.67 lat (usec): min=1396, max=231269, avg=40912.34, stdev=38872.96 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1975], 10.00th=[ 4146], 20.00th=[ 8225], | 30.00th=[ 12911], 40.00th=[ 21890], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[189793], 99.50th=[206570], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 315, per=25.91%, avg=175.70, stdev=67.35, samples=70 iops : min= 1, max= 19, avg=10.21, stdev= 4.27, samples=70 lat (usec) : 100=3.52%, 250=0.91%, 500=0.52% lat (msec) : 2=2.60%, 4=2.47%, 10=7.55%, 20=8.59%, 50=36.46% lat (msec) : 100=28.78%, 250=8.46%, 500=0.13% cpu : usr=0.04%, sys=5.31%, ctx=1712, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=645KiB/s (660kB/s), 159KiB/s-169KiB/s (163kB/s-173kB/s), io=23.4MiB (24.5MB), run=35668-37137msec WRITE: bw=679KiB/s (695kB/s), 162KiB/s-181KiB/s (166kB/s-185kB/s), io=24.6MiB (25.8MB), run=35668-37137msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Wed Aug 26 19:42:43 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5920KiB/48434msec) clat (msec): min=6, max=362, avg=50.67, stdev=46.63 lat (msec): min=6, max=362, avg=50.67, stdev=46.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 108], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 268], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 381, per=25.10%, avg=122.99, stdev=81.23, samples=93 iops : min= 1, max= 23, avg= 6.88, stdev= 5.13, samples=93 write: IOPS=8, BW=131KiB/s (135kB/s)(6368KiB/48434msec); 0 zone resets clat (msec): min=11, max=223, avg=74.05, stdev=44.66 lat (msec): min=11, max=223, avg=74.05, stdev=44.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 163], | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 349, per=25.86%, avg=133.19, stdev=73.48, samples=93 iops : min= 1, max= 21, avg= 7.54, stdev= 4.65, samples=93 lat (msec) : 10=0.39%, 20=10.94%, 50=41.67%, 100=29.04%, 250=17.71% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.65%, ctx=1165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Wed Aug 26 19:42:43 2026 read: IOPS=7, BW=118KiB/s (120kB/s)(5744KiB/48848msec) clat (msec): min=7, max=490, avg=50.92, stdev=50.32 lat (msec): min=7, max=491, avg=50.92, stdev=50.32 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 73], 90.00th=[ 108], 95.00th=[ 153], | 99.00th=[ 236], 99.50th=[ 334], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 31, max= 366, per=24.32%, avg=119.17, stdev=77.61, samples=93 iops : min= 1, max= 22, avg= 6.65, stdev= 4.90, samples=93 write: IOPS=8, BW=134KiB/s (137kB/s)(6544KiB/48848msec); 0 zone resets clat (msec): min=13, max=297, avg=74.23, stdev=51.50 lat (msec): min=13, max=297, avg=74.23, stdev=51.50 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 113], 90.00th=[ 144], 95.00th=[ 182], | 99.00th=[ 239], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 444, per=25.61%, avg=131.89, stdev=83.85, samples=96 iops : min= 1, max= 27, avg= 7.45, stdev= 5.29, samples=96 lat (msec) : 10=0.65%, 20=9.38%, 50=44.79%, 100=27.34%, 250=16.93% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=1.67%, ctx=1193, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Wed Aug 26 19:42:43 2026 read: IOPS=8, BW=128KiB/s (132kB/s)(6256KiB/48685msec) clat (msec): min=6, max=331, avg=48.39, stdev=44.55 lat (msec): min=6, max=331, avg=48.39, stdev=44.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 412, per=26.47%, avg=129.68, stdev=92.59, samples=95 iops : min= 1, max= 25, avg= 7.32, stdev= 5.81, samples=95 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48685msec); 0 zone resets clat (msec): min=13, max=360, avg=78.80, stdev=53.63 lat (msec): min=13, max=360, avg=78.81, stdev=53.64 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 79], | 70.00th=[ 94], 80.00th=[ 121], 90.00th=[ 153], 95.00th=[ 180], | 99.00th=[ 259], 99.50th=[ 288], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 412, per=24.01%, avg=123.63, stdev=76.90, samples=95 iops : min= 1, max= 25, avg= 6.93, stdev= 4.86, samples=95 lat (msec) : 10=1.04%, 20=13.28%, 50=39.58%, 100=27.60%, 250=17.71% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.61%, ctx=1173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Wed Aug 26 19:42:43 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48501msec) clat (msec): min=6, max=243, avg=50.56, stdev=44.57 lat (msec): min=6, max=243, avg=50.56, stdev=44.57 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 73], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 230], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 444, per=25.80%, avg=126.42, stdev=88.14, samples=92 iops : min= 1, max= 27, avg= 7.11, stdev= 5.57, samples=92 write: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48501msec); 0 zone resets clat (msec): min=14, max=315, avg=74.82, stdev=47.95 lat (msec): min=14, max=315, avg=74.83, stdev=47.95 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 114], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 232], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 319, per=24.91%, avg=128.31, stdev=71.54, samples=94 iops : min= 1, max= 19, avg= 7.23, stdev= 4.51, samples=94 lat (msec) : 10=0.26%, 20=11.59%, 50=42.58%, 100=25.91%, 250=19.27% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.69%, ctx=1190, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=490KiB/s (502kB/s), 118KiB/s-128KiB/s (120kB/s-132kB/s), io=23.4MiB (24.5MB), run=48434-48848msec WRITE: bw=516KiB/s (528kB/s), 124KiB/s-134KiB/s (127kB/s-137kB/s), io=24.6MiB (25.8MB), run=48434-48848msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179762: Wed Aug 26 19:42:58 2026 read: IOPS=2, BW=2063KiB/s (2113kB/s)(7168KiB/3474msec) clat (msec): min=129, max=323, avg=220.68, stdev=69.41 lat (msec): min=129, max=323, avg=220.68, stdev=69.41 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 142], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 224], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 279], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1924, max= 4439, per=83.73%, avg=3480.67, stdev=1360.08, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1474KiB/s (1509kB/s)(5120KiB/3474msec); 0 zone resets clat (msec): min=240, max=548, avg=361.45, stdev=133.59 lat (msec): min=240, max=548, avg=361.51, stdev=133.58 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1924, max= 4071, per=42.47%, avg=2472.00, stdev=1066.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=17.19%, ctx=169, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179763: Wed Aug 26 19:42:58 2026 read: IOPS=0, BW=416KiB/s (426kB/s)(2048KiB/4926msec) clat (usec): min=485, max=199457, avg=99971.77, stdev=140694.77 lat (usec): min=486, max=199460, avg=99973.47, stdev=140695.67 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 486], 60.00th=[200279], | 70.00th=[200279], 80.00th=[200279], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 1494, max= 1924, per=41.11%, avg=1709.00, stdev=304.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2079KiB/s (2129kB/s)(10.0MiB/4926msec); 0 zone resets clat (msec): min=203, max=1074, avg=468.57, stdev=279.90 lat (msec): min=203, max=1074, avg=468.82, stdev=279.74 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 220], | 30.00th=[ 247], 40.00th=[ 266], 50.00th=[ 313], 60.00th=[ 443], | 70.00th=[ 617], 80.00th=[ 642], 90.00th=[ 667], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1924, max= 4063, per=44.05%, avg=2563.86, stdev=973.37, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.04%, sys=14.72%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179764: Wed Aug 26 19:42:58 2026 read: IOPS=1, BW=1600KiB/s (1638kB/s)(6144KiB/3841msec) clat (usec): min=471, max=312223, avg=154127.09, stdev=142701.21 lat (usec): min=471, max=312224, avg=154128.14, stdev=142701.03 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 9372], | 30.00th=[ 9372], 40.00th=[ 74974], 50.00th=[ 74974], 60.00th=[233833], | 70.00th=[295699], 80.00th=[295699], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 1924, max= 4079, per=80.78%, avg=3358.00, stdev=1241.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1600KiB/s (1638kB/s)(6144KiB/3841msec); 0 zone resets clat (msec): min=200, max=966, avg=464.05, stdev=273.85 lat (msec): min=200, max=966, avg=464.18, stdev=273.81 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 414], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1494, max= 2039, per=32.84%, avg=1911.50, stdev=209.86, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=16.67%, 500=41.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=14.48%, ctx=281, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179765: Wed Aug 26 19:42:58 2026 read: IOPS=1, BW=1515KiB/s (1552kB/s)(5120KiB/3379msec) clat (usec): min=322, max=165859, avg=33757.49, stdev=73849.40 lat (usec): min=323, max=165860, avg=33758.53, stdev=73849.66 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 322], 10.00th=[ 322], 20.00th=[ 322], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 553], 60.00th=[ 553], | 70.00th=[ 1713], 80.00th=[ 1713], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 7699, max= 7699, per=100.00%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2121KiB/s (2172kB/s)(7168KiB/3379msec); 0 zone resets clat (msec): min=273, max=617, avg=440.15, stdev=142.65 lat (msec): min=273, max=617, avg=440.24, stdev=142.67 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 284], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 456], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 584], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1473, max= 4071, per=48.87%, avg=2844.00, stdev=1322.43, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=14.42%, ctx=137, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4158KiB/s (4257kB/s), 416KiB/s-2063KiB/s (426kB/s-2113kB/s), io=20.0MiB (20.0MB), run=3379-4926msec WRITE: bw=5821KiB/s (5960kB/s), 1474KiB/s-2121KiB/s (1509kB/s-2172kB/s), io=28.0MiB (29.4MB), run=3379-4926msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179767: Wed Aug 26 19:42:59 2026 read: IOPS=1, BW=1601KiB/s (1639kB/s)(7168KiB/4478msec) clat (msec): min=61, max=788, avg=257.97, stdev=274.37 lat (msec): min=61, max=788, avg=257.97, stdev=274.37 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 79], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 481], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1681, max= 4079, per=76.53%, avg=3248.00, stdev=1357.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1143KiB/s (1171kB/s)(5120KiB/4478msec); 0 zone resets clat (msec): min=85, max=974, avg=445.06, stdev=342.58 lat (msec): min=85, max=974, avg=445.14, stdev=342.57 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1809, max= 2043, per=32.81%, avg=1949.33, stdev=123.78, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=6.10%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179768: Wed Aug 26 19:42:59 2026 read: IOPS=0, BW=424KiB/s (435kB/s)(2048KiB/4825msec) clat (msec): min=102, max=646, avg=374.60, stdev=385.15 lat (msec): min=102, max=646, avg=374.61, stdev=385.15 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1988, max= 1996, per=46.94%, avg=1992.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2122KiB/s (2173kB/s)(10.0MiB/4825msec); 0 zone resets clat (msec): min=102, max=558, avg=357.12, stdev=163.94 lat (msec): min=102, max=558, avg=357.63, stdev=163.65 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 199], | 30.00th=[ 209], 40.00th=[ 257], 50.00th=[ 313], 60.00th=[ 388], | 70.00th=[ 485], 80.00th=[ 527], 90.00th=[ 535], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1809, max= 4096, per=43.26%, avg=2570.57, stdev=1010.19, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.02%, sys=5.20%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179769: Wed Aug 26 19:42:59 2026 read: IOPS=1, BW=1411KiB/s (1445kB/s)(6144KiB/4354msec) clat (msec): min=69, max=504, avg=196.66, stdev=156.10 lat (msec): min=69, max=504, avg=196.66, stdev=156.10 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 165], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1809, max= 3992, per=58.10%, avg=2465.75, stdev=1022.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1411KiB/s (1445kB/s)(6144KiB/4354msec); 0 zone resets clat (msec): min=309, max=831, avg=481.33, stdev=212.54 lat (msec): min=309, max=831, avg=481.41, stdev=212.56 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 456], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1809, max= 2043, per=33.24%, avg=1975.17, stdev=84.12, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=3.95%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179770: Wed Aug 26 19:42:59 2026 read: IOPS=1, BW=1319KiB/s (1351kB/s)(5120KiB/3882msec) clat (msec): min=113, max=272, avg=184.37, stdev=74.49 lat (msec): min=113, max=272, avg=184.37, stdev=74.49 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1996, max= 6071, per=95.04%, avg=4033.50, stdev=2881.46, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1846KiB/s (1891kB/s)(7168KiB/3882msec); 0 zone resets clat (msec): min=165, max=689, avg=339.10, stdev=202.37 lat (msec): min=165, max=690, avg=339.24, stdev=202.45 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 186], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 211], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 485], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1809, max= 3992, per=49.75%, avg=2956.00, stdev=1195.35, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=5.49%, ctx=155, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4245KiB/s (4346kB/s), 424KiB/s-1601KiB/s (435kB/s-1639kB/s), io=20.0MiB (20.0MB), run=3882-4825msec WRITE: bw=5942KiB/s (6085kB/s), 1143KiB/s-2122KiB/s (1171kB/s-2173kB/s), io=28.0MiB (29.4MB), run=3882-4825msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179778: Wed Aug 26 19:43:14 2026 read: IOPS=1, BW=4279KiB/s (4381kB/s)(12.0MiB/2872msec) clat (msec): min=528, max=1399, avg=936.40, stdev=437.97 lat (msec): min=528, max=1399, avg=936.40, stdev=437.97 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.13%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179779: Wed Aug 26 19:43:14 2026 read: IOPS=0, BW=1478KiB/s (1513kB/s)(4096KiB/2772msec) clat (nsec): min=226128k, max=226128k, avg=226127599.00, stdev= 0.00 lat (nsec): min=226130k, max=226130k, avg=226130404.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 6574, max= 6574, per=100.00%, avg=6574.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2955KiB/s (3026kB/s)(8192KiB/2772msec); 0 zone resets clat (msec): min=909, max=1539, avg=1224.61, stdev=445.18 lat (msec): min=910, max=1539, avg=1224.94, stdev=445.16 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7968, max= 7968, per=68.43%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.39%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179780: Wed Aug 26 19:43:14 2026 write: IOPS=1, BW=4367KiB/s (4472kB/s)(12.0MiB/2814msec); 0 zone resets clat (msec): min=542, max=1629, avg=912.22, stdev=621.24 lat (msec): min=544, max=1629, avg=913.00, stdev=620.89 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7968, max= 8143, per=69.18%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.63%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179782: Wed Aug 26 19:43:14 2026 write: IOPS=1, BW=5040KiB/s (5161kB/s)(12.0MiB/2438msec); 0 zone resets clat (msec): min=286, max=1730, avg=781.20, stdev=822.09 lat (msec): min=288, max=1730, avg=782.27, stdev=821.39 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 6606, max= 8143, per=63.33%, avg=7374.50, stdev=1086.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.08%, sys=4.68%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5705KiB/s (5842kB/s), 1478KiB/s-4279KiB/s (1513kB/s-4381kB/s), io=16.0MiB (16.8MB), run=2772-2872msec WRITE: bw=11.4MiB/s (11.9MB/s), 2955KiB/s-5040KiB/s (3026kB/s-5161kB/s), io=32.0MiB (33.6MB), run=2438-2814msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179781: Wed Aug 26 19:43:14 2026 read: IOPS=1, BW=5498KiB/s (5630kB/s)(12.0MiB/2235msec) clat (msec): min=597, max=797, avg=717.27, stdev=105.53 lat (msec): min=597, max=797, avg=717.27, stdev=105.53 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7892, max= 8047, per=100.00%, avg=7969.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=15.67%, ctx=316, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179783: Wed Aug 26 19:43:14 2026 read: IOPS=0, BW=1491KiB/s (1527kB/s)(4096KiB/2747msec) clat (nsec): min=662238k, max=662238k, avg=662238233.00, stdev= 0.00 lat (nsec): min=662241k, max=662241k, avg=662240694.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2982KiB/s (3054kB/s)(8192KiB/2747msec); 0 zone resets clat (msec): min=895, max=1086, avg=990.85, stdev=135.20 lat (msec): min=895, max=1086, avg=991.20, stdev=135.19 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=77.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.73%, ctx=168, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179784: Wed Aug 26 19:43:14 2026 write: IOPS=0, BW=3966KiB/s (4062kB/s)(12.0MiB/3098msec); 0 zone resets clat (msec): min=192, max=1565, avg=1002.30, stdev=719.14 lat (msec): min=192, max=1565, avg=1002.62, stdev=719.25 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=77.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.20%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179785: Wed Aug 26 19:43:14 2026 write: IOPS=1, BW=4969KiB/s (5088kB/s)(12.0MiB/2473msec); 0 zone resets clat (msec): min=426, max=1272, avg=794.74, stdev=433.70 lat (msec): min=427, max=1273, avg=795.07, stdev=433.66 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 5970, max= 8192, per=66.95%, avg=7081.00, stdev=1571.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.12%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5964KiB/s (6107kB/s), 1491KiB/s-5498KiB/s (1527kB/s-5630kB/s), io=16.0MiB (16.8MB), run=2235-2747msec WRITE: bw=10.3MiB/s (10.8MB/s), 2982KiB/s-4969KiB/s (3054kB/s-5088kB/s), io=32.0MiB (33.6MB), run=2473-3098msec