== sanity test 398b: DIO and buffer IO race ============== 23:49:06 (1786420146) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.21102 s, 9.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143539: Mon Aug 10 23:52:23 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(5992KiB/175847msec) clat (usec): min=31, max=801292, avg=58350.74, stdev=49140.61 lat (usec): min=31, max=801292, avg=58360.54, stdev=49137.36 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 12387], 20.00th=[ 26608], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 69731], 80.00th=[ 85459], 90.00th=[110625], 95.00th=[135267], | 99.00th=[223347], 99.50th=[278922], 99.90th=[624952], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 5, max= 103, per=25.88%, avg=34.42, stdev=15.39, samples=336 iops : min= 1, max= 25, avg= 7.94, stdev= 3.88, samples=336 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6296KiB/175847msec); 0 zone resets clat (usec): min=1208, max=666102, avg=55756.00, stdev=54416.48 lat (usec): min=1209, max=666104, avg=55764.23, stdev=54421.21 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2180], 10.00th=[ 4047], 20.00th=[ 8225], | 30.00th=[ 15533], 40.00th=[ 28967], 50.00th=[ 41681], 60.00th=[ 56361], | 70.00th=[ 71828], 80.00th=[ 95945], 90.00th=[131597], 95.00th=[160433], | 99.00th=[221250], 99.50th=[256902], 99.90th=[299893], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 94, per=25.78%, avg=35.84, stdev=17.96, samples=339 iops : min= 1, max= 23, avg= 8.28, stdev= 4.53, samples=339 lat (usec) : 50=0.23%, 100=3.78%, 250=0.20%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=2.28%, 4=3.03%, 10=6.84%, 20=6.87%, 50=30.21% lat (msec) : 100=30.44%, 250=15.30%, 500=0.52%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=3.84%, ctx=6906, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143540: Mon Aug 10 23:52:23 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(5940KiB/178014msec) clat (usec): min=34, max=647640, avg=58339.33, stdev=46594.47 lat (usec): min=35, max=647641, avg=58343.50, stdev=46595.35 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 1450], 20.00th=[ 26346], | 30.00th=[ 34341], 40.00th=[ 42206], 50.00th=[ 50594], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 88605], 90.00th=[109577], 95.00th=[129500], | 99.00th=[191890], 99.50th=[244319], 99.90th=[467665], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 5, max= 87, per=25.17%, avg=33.48, stdev=16.35, samples=343 iops : min= 1, max= 21, avg= 7.69, stdev= 4.11, samples=343 write: IOPS=8, BW=35.7KiB/s (36.5kB/s)(6348KiB/178014msec); 0 zone resets clat (usec): min=1196, max=765574, avg=57260.89, stdev=58619.89 lat (usec): min=1198, max=765575, avg=57280.24, stdev=58631.57 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2540], 10.00th=[ 4424], 20.00th=[ 8356], | 30.00th=[ 14746], 40.00th=[ 28967], 50.00th=[ 43779], 60.00th=[ 57410], | 70.00th=[ 72877], 80.00th=[ 95945], 90.00th=[132645], 95.00th=[162530], | 99.00th=[240124], 99.50th=[287310], 99.90th=[455082], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 88, per=25.60%, avg=35.59, stdev=16.80, samples=345 iops : min= 1, max= 22, avg= 8.22, stdev= 4.23, samples=345 lat (usec) : 50=0.46%, 100=3.68%, 250=0.23%, 500=0.13%, 750=0.16% lat (usec) : 1000=0.10% lat (msec) : 2=2.25%, 4=2.41%, 10=7.91%, 20=6.77%, 50=27.60% lat (msec) : 100=32.42%, 250=15.27%, 500=0.55%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=3.96%, ctx=6929, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143542: Mon Aug 10 23:52:23 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6028KiB/178294msec) clat (usec): min=29, max=287693, avg=55963.27, stdev=39957.11 lat (usec): min=29, max=287694, avg=55972.68, stdev=39953.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 63], 10.00th=[ 9503], 20.00th=[ 26608], | 30.00th=[ 33817], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 57934], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[107480], 95.00th=[125305], | 99.00th=[189793], 99.50th=[229639], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 103, per=25.70%, avg=34.18, stdev=17.08, samples=341 iops : min= 1, max= 25, avg= 7.87, stdev= 4.30, samples=341 write: IOPS=8, BW=35.1KiB/s (35.0kB/s)(6260KiB/178294msec); 0 zone resets clat (usec): min=1161, max=899987, avg=59710.96, stdev=62452.29 lat (usec): min=1163, max=899989, avg=59714.91, stdev=62451.78 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2245], 10.00th=[ 4080], 20.00th=[ 8717], | 30.00th=[ 15270], 40.00th=[ 29754], 50.00th=[ 44303], 60.00th=[ 59507], | 70.00th=[ 77071], 80.00th=[ 99091], 90.00th=[133694], 95.00th=[173016], | 99.00th=[278922], 99.50th=[304088], 99.90th=[392168], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 87, per=25.15%, avg=34.95, stdev=16.21, samples=346 iops : min= 1, max= 21, avg= 8.07, stdev= 4.11, samples=346 lat (usec) : 50=0.26%, 100=3.39%, 250=0.52%, 500=0.20%, 750=0.16% lat (msec) : 2=2.18%, 4=2.99%, 10=6.74%, 20=7.58%, 50=28.71% lat (msec) : 100=31.22%, 250=15.17%, 500=0.85%, 1000=0.03% cpu : usr=0.05%, sys=3.80%, ctx=7020, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143544: Mon Aug 10 23:52:23 2026 read: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6052KiB/180115msec) clat (usec): min=34, max=334866, avg=57353.81, stdev=41370.96 lat (usec): min=34, max=334868, avg=57357.86, stdev=41369.29 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 1795], 20.00th=[ 27657], | 30.00th=[ 34866], 40.00th=[ 41681], 50.00th=[ 49546], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 85459], 90.00th=[107480], 95.00th=[128451], | 99.00th=[191890], 99.50th=[238027], 99.90th=[287310], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 79, per=25.75%, avg=34.25, stdev=16.26, samples=342 iops : min= 1, max= 19, avg= 7.89, stdev= 4.10, samples=342 write: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6236KiB/180115msec); 0 zone resets clat (usec): min=1156, max=1058.7k, avg=59521.97, stdev=62817.43 lat (usec): min=1157, max=1058.7k, avg=59523.72, stdev=62817.38 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2180], 10.00th=[ 4228], | 20.00th=[ 8717], 30.00th=[ 15270], 40.00th=[ 29492], | 50.00th=[ 45876], 60.00th=[ 60031], 70.00th=[ 77071], | 80.00th=[ 101188], 90.00th=[ 133694], 95.00th=[ 168821], | 99.00th=[ 258999], 99.50th=[ 287310], 99.90th=[ 429917], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 108, per=24.85%, avg=34.54, stdev=16.36, samples=349 iops : min= 1, max= 27, avg= 7.97, stdev= 4.14, samples=349 lat (usec) : 50=0.39%, 100=3.91%, 250=0.33%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=2.28%, 4=2.70%, 10=6.97%, 20=6.77%, 50=27.90% lat (msec) : 100=32.06%, 250=15.72%, 500=0.72%, 2000=0.03% cpu : usr=0.05%, sys=3.86%, ctx=6962, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=133KiB/s (137kB/s), 33.4KiB/s-34.1KiB/s (34.2kB/s-34.9kB/s), io=23.4MiB (24.6MB), run=175847-180115msec WRITE: bw=140KiB/s (143kB/s), 34.6KiB/s-35.8KiB/s (35.5kB/s-36.7kB/s), io=24.6MiB (25.7MB), run=175847-180115msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143541: Mon Aug 10 23:55:13 2026 read: IOPS=4, BW=17.1KiB/s (17.5kB/s)(5992KiB/350545msec) clat (msec): min=6, max=796, avg=44.63, stdev=53.59 lat (msec): min=6, max=796, avg=44.64, stdev=53.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 97], 95.00th=[ 146], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 592], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 87, per=31.14%, avg=21.17, stdev=14.78, samples=544 iops : min= 1, max= 21, avg= 4.67, stdev= 3.76, samples=544 write: IOPS=4, BW=17.0KiB/s (18.4kB/s)(6296KiB/350545msec); 0 zone resets clat (msec): min=38, max=856, avg=179.97, stdev=99.67 lat (msec): min=38, max=856, avg=179.97, stdev=99.67 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 178], | 70.00th=[ 203], 80.00th=[ 245], 90.00th=[ 317], 95.00th=[ 380], | 99.00th=[ 502], 99.50th=[ 584], 99.90th=[ 844], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 48, per=25.71%, avg=18.25, stdev= 9.28, samples=658 iops : min= 1, max= 12, avg= 3.94, stdev= 2.41, samples=658 lat (msec) : 10=1.66%, 20=13.77%, 50=22.10%, 100=16.15%, 250=36.07% lat (msec) : 500=9.67%, 750=0.49%, 1000=0.10% cpu : usr=0.03%, sys=1.01%, ctx=5278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143543: Mon Aug 10 23:55:13 2026 read: IOPS=4, BW=16.0KiB/s (17.4kB/s)(5940KiB/349940msec) clat (msec): min=6, max=803, avg=44.27, stdev=53.64 lat (msec): min=6, max=803, avg=44.27, stdev=53.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 97], 95.00th=[ 142], | 99.00th=[ 259], 99.50th=[ 317], 99.90th=[ 567], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 88, per=31.22%, avg=21.23, stdev=15.34, samples=538 iops : min= 1, max= 22, avg= 4.70, stdev= 3.89, samples=538 write: IOPS=4, BW=18.1KiB/s (18.6kB/s)(6348KiB/349940msec); 0 zone resets clat (msec): min=38, max=715, avg=178.81, stdev=98.42 lat (msec): min=38, max=715, avg=178.81, stdev=98.42 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 133], 50.00th=[ 155], 60.00th=[ 171], | 70.00th=[ 201], 80.00th=[ 247], 90.00th=[ 313], 95.00th=[ 384], | 99.00th=[ 498], 99.50th=[ 531], 99.90th=[ 709], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 55, per=25.83%, avg=18.34, stdev= 9.40, samples=661 iops : min= 1, max= 13, avg= 3.96, stdev= 2.44, samples=661 lat (msec) : 10=1.60%, 20=14.84%, 50=20.67%, 100=16.63%, 250=35.64% lat (msec) : 500=10.09%, 750=0.49%, 1000=0.03% cpu : usr=0.04%, sys=1.09%, ctx=5475, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143545: Mon Aug 10 23:55:13 2026 read: IOPS=4, BW=17.3KiB/s (17.7kB/s)(6028KiB/348993msec) clat (msec): min=5, max=538, avg=44.69, stdev=48.32 lat (msec): min=5, max=538, avg=44.69, stdev=48.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 104], 95.00th=[ 133], | 99.00th=[ 226], 99.50th=[ 338], 99.90th=[ 443], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 103, per=30.65%, avg=20.84, stdev=15.06, samples=555 iops : min= 1, max= 25, avg= 4.59, stdev= 3.83, samples=555 write: IOPS=4, BW=17.9KiB/s (18.4kB/s)(6260KiB/348993msec); 0 zone resets clat (msec): min=41, max=870, avg=179.72, stdev=95.72 lat (msec): min=41, max=870, avg=179.73, stdev=95.72 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 180], | 70.00th=[ 205], 80.00th=[ 247], 90.00th=[ 317], 95.00th=[ 372], | 99.00th=[ 506], 99.50th=[ 531], 99.90th=[ 684], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 48, per=25.37%, avg=18.01, stdev= 9.32, samples=663 iops : min= 1, max= 12, avg= 3.88, stdev= 2.43, samples=663 lat (msec) : 10=1.43%, 20=13.87%, 50=21.06%, 100=16.99%, 250=36.43% lat (msec) : 500=9.67%, 750=0.52%, 1000=0.03% cpu : usr=0.03%, sys=1.07%, ctx=5224, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143546: Mon Aug 10 23:55:13 2026 read: IOPS=4, BW=17.2KiB/s (17.7kB/s)(6052KiB/350996msec) clat (msec): min=6, max=447, avg=43.34, stdev=49.30 lat (msec): min=6, max=447, avg=43.35, stdev=49.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 61], 90.00th=[ 94], 95.00th=[ 140], | 99.00th=[ 247], 99.50th=[ 313], 99.90th=[ 443], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 112, per=32.95%, avg=22.41, stdev=16.30, samples=520 iops : min= 1, max= 28, avg= 4.99, stdev= 4.15, samples=520 write: IOPS=4, BW=17.8KiB/s (18.2kB/s)(6236KiB/350996msec); 0 zone resets clat (msec): min=40, max=997, avg=182.78, stdev=104.47 lat (msec): min=40, max=997, avg=182.78, stdev=104.48 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 178], | 70.00th=[ 203], 80.00th=[ 247], 90.00th=[ 321], 95.00th=[ 393], | 99.00th=[ 542], 99.50th=[ 617], 99.90th=[ 852], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 48, per=25.25%, avg=17.93, stdev= 9.46, samples=663 iops : min= 1, max= 12, avg= 3.86, stdev= 2.45, samples=663 lat (msec) : 10=1.66%, 20=15.49%, 50=20.96%, 100=15.92%, 250=35.58% lat (msec) : 500=9.60%, 750=0.72%, 1000=0.07% cpu : usr=0.03%, sys=1.04%, ctx=5236, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=68.4KiB/s (70.1kB/s), 16.0KiB/s-17.3KiB/s (17.4kB/s-17.7kB/s), io=23.4MiB (24.6MB), run=348993-350996msec WRITE: bw=71.6KiB/s (73.3kB/s), 17.8KiB/s-18.1KiB/s (18.2kB/s-18.6kB/s), io=24.6MiB (25.7MB), run=348993-350996msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143619: Mon Aug 10 23:56:05 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5920KiB/42147msec) clat (usec): min=35, max=341080, avg=55674.85, stdev=44309.48 lat (usec): min=36, max=341082, avg=55676.27, stdev=44309.46 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 19268], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 49021], 60.00th=[ 61604], | 70.00th=[ 71828], 80.00th=[ 88605], 90.00th=[110625], 95.00th=[125305], | 99.00th=[181404], 99.50th=[256902], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 61, max= 314, per=24.98%, avg=141.86, stdev=54.11, samples=81 iops : min= 3, max= 19, avg= 8.14, stdev= 3.42, samples=81 write: IOPS=9, BW=151KiB/s (155kB/s)(6368KiB/42147msec); 0 zone resets clat (usec): min=1680, max=305559, avg=53108.63, stdev=50980.68 lat (usec): min=1683, max=305562, avg=53118.32, stdev=50978.16 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3097], 10.00th=[ 5800], 20.00th=[ 9634], | 30.00th=[ 16057], 40.00th=[ 23725], 50.00th=[ 36439], 60.00th=[ 52691], | 70.00th=[ 71828], 80.00th=[ 93848], 90.00th=[117965], 95.00th=[147850], | 99.00th=[256902], 99.50th=[283116], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 30, max= 412, per=25.23%, avg=150.65, stdev=70.63, samples=82 iops : min= 1, max= 25, avg= 8.68, stdev= 4.44, samples=82 lat (usec) : 50=1.56%, 100=5.99%, 250=0.26%, 500=0.26%, 750=0.26% lat (msec) : 2=1.43%, 4=2.21%, 10=7.42%, 20=9.38%, 50=25.52% lat (msec) : 100=30.34%, 250=14.58%, 500=0.78% cpu : usr=0.05%, sys=4.25%, ctx=1631, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143621: Mon Aug 10 23:56:05 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5744KiB/41578msec) clat (usec): min=39, max=366288, avg=60299.68, stdev=46731.47 lat (usec): min=40, max=366289, avg=60306.19, stdev=46737.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 27657], | 30.00th=[ 37487], 40.00th=[ 46400], 50.00th=[ 54264], 60.00th=[ 63701], | 70.00th=[ 72877], 80.00th=[ 91751], 90.00th=[109577], 95.00th=[139461], | 99.00th=[202376], 99.50th=[316670], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 318, per=24.33%, avg=138.22, stdev=64.36, samples=81 iops : min= 1, max= 19, avg= 7.89, stdev= 4.07, samples=81 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41578msec); 0 zone resets clat (usec): min=1672, max=328088, avg=48248.62, stdev=49100.05 lat (usec): min=1675, max=328091, avg=48251.19, stdev=49099.82 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 20], 50.00th=[ 31], 60.00th=[ 45], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 241], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 29, max= 381, per=26.92%, avg=160.70, stdev=73.96, samples=79 iops : min= 1, max= 23, avg= 9.32, stdev= 4.72, samples=79 lat (usec) : 50=0.26%, 100=5.73%, 500=0.13%, 750=0.26% lat (msec) : 2=0.91%, 4=2.34%, 10=9.77%, 20=9.90%, 50=25.00% lat (msec) : 100=31.64%, 250=13.67%, 500=0.39% cpu : usr=0.04%, sys=4.15%, ctx=1631, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143622: Mon Aug 10 23:56:05 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41674msec) clat (usec): min=37, max=281950, avg=55812.37, stdev=44057.27 lat (usec): min=37, max=281950, avg=55862.15, stdev=44009.42 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 1254], | 30.00th=[ 32637], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 61604], | 70.00th=[ 74974], 80.00th=[ 88605], 90.00th=[109577], 95.00th=[137364], | 99.00th=[168821], 99.50th=[212861], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 351, per=27.04%, avg=153.57, stdev=66.07, samples=80 iops : min= 1, max= 21, avg= 8.85, stdev= 4.13, samples=80 write: IOPS=9, BW=145KiB/s (148kB/s)(6032KiB/41674msec); 0 zone resets clat (usec): min=1787, max=596332, avg=51365.29, stdev=57132.61 lat (usec): min=1790, max=596335, avg=51368.74, stdev=57133.34 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 9], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 34], 60.00th=[ 46], | 70.00th=[ 67], 80.00th=[ 82], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 213], 99.50th=[ 342], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 30, max= 349, per=24.50%, avg=146.29, stdev=73.80, samples=80 iops : min= 1, max= 21, avg= 8.39, stdev= 4.65, samples=80 lat (usec) : 50=0.78%, 100=7.81%, 250=0.39%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=0.65%, 4=3.12%, 10=7.94%, 20=7.94%, 50=26.43% lat (msec) : 100=29.30%, 250=14.06%, 500=0.39%, 750=0.13% cpu : usr=0.05%, sys=4.01%, ctx=1608, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143623: Mon Aug 10 23:56:05 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41577msec) clat (usec): min=41, max=355634, avg=58436.42, stdev=47610.77 lat (usec): min=41, max=355636, avg=58446.01, stdev=47606.17 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 2737], | 30.00th=[ 33424], 40.00th=[ 43254], 50.00th=[ 55837], 60.00th=[ 65799], | 70.00th=[ 77071], 80.00th=[ 88605], 90.00th=[117965], 95.00th=[141558], | 99.00th=[202376], 99.50th=[240124], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 319, per=26.29%, avg=149.35, stdev=65.93, samples=79 iops : min= 1, max= 19, avg= 8.58, stdev= 4.13, samples=79 write: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41577msec); 0 zone resets clat (usec): min=1635, max=437031, avg=49263.42, stdev=53239.99 lat (usec): min=1637, max=437034, avg=49266.41, stdev=53239.47 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 3326], 10.00th=[ 5080], 20.00th=[ 9372], | 30.00th=[ 14615], 40.00th=[ 21627], 50.00th=[ 30802], 60.00th=[ 44827], | 70.00th=[ 60556], 80.00th=[ 84411], 90.00th=[112722], 95.00th=[149947], | 99.00th=[238027], 99.50th=[308282], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 30, max= 445, per=26.00%, avg=155.24, stdev=77.52, samples=79 iops : min= 1, max= 27, avg= 8.96, stdev= 4.87, samples=79 lat (usec) : 50=0.65%, 100=7.16%, 250=1.17%, 750=0.26%, 1000=0.26% lat (msec) : 2=1.17%, 4=3.52%, 10=7.55%, 20=8.72%, 50=23.83% lat (msec) : 100=31.64%, 250=13.54%, 500=0.52% cpu : usr=0.04%, sys=4.07%, ctx=1573, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=568KiB/s (582kB/s), 138KiB/s-150KiB/s (141kB/s-154kB/s), io=23.4MiB (24.5MB), run=41577-42147msec WRITE: bw=598KiB/s (612kB/s), 145KiB/s-157KiB/s (148kB/s-161kB/s), io=24.6MiB (25.8MB), run=41577-42147msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143616: Mon Aug 10 23:57:01 2026 read: IOPS=3, BW=60.7KiB/s (62.1kB/s)(5920KiB/97593msec) clat (msec): min=9, max=518, avg=60.42, stdev=55.32 lat (msec): min=9, max=518, avg=60.42, stdev=55.32 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 108], 95.00th=[ 169], | 99.00th=[ 300], 99.50th=[ 380], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 223, per=29.96%, avg=73.10, stdev=42.53, samples=158 iops : min= 1, max= 13, avg= 3.79, stdev= 2.69, samples=158 write: IOPS=4, BW=65.2KiB/s (66.8kB/s)(6368KiB/97593msec); 0 zone resets clat (msec): min=46, max=597, avg=187.95, stdev=88.81 lat (msec): min=46, max=597, avg=187.96, stdev=88.82 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 91], 10.00th=[ 107], 20.00th=[ 122], | 30.00th=[ 138], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 182], | 70.00th=[ 205], 80.00th=[ 241], 90.00th=[ 309], 95.00th=[ 384], | 99.00th=[ 498], 99.50th=[ 584], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 22, max= 128, per=25.91%, avg=66.58, stdev=30.30, samples=187 iops : min= 1, max= 8, avg= 3.37, stdev= 2.02, samples=187 lat (msec) : 10=0.13%, 20=5.47%, 50=21.22%, 100=19.79%, 250=42.97% lat (msec) : 500=9.90%, 750=0.52% cpu : usr=0.03%, sys=1.14%, ctx=1429, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143617: Mon Aug 10 23:57:01 2026 read: IOPS=3, BW=58.7KiB/s (60.1kB/s)(5744KiB/97910msec) clat (msec): min=9, max=578, avg=61.42, stdev=57.74 lat (msec): min=9, max=578, avg=61.42, stdev=57.73 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 31], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 82], 90.00th=[ 116], 95.00th=[ 167], | 99.00th=[ 305], 99.50th=[ 351], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 21, max= 255, per=31.07%, avg=75.82, stdev=46.10, samples=149 iops : min= 1, max= 15, avg= 3.99, stdev= 2.91, samples=149 write: IOPS=4, BW=66.8KiB/s (68.4kB/s)(6544KiB/97910msec); 0 zone resets clat (msec): min=62, max=619, avg=184.58, stdev=88.89 lat (msec): min=62, max=619, avg=184.59, stdev=88.89 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 88], 10.00th=[ 101], 20.00th=[ 117], | 30.00th=[ 130], 40.00th=[ 142], 50.00th=[ 159], 60.00th=[ 178], | 70.00th=[ 207], 80.00th=[ 249], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 489], 99.50th=[ 542], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 21, max= 160, per=27.45%, avg=70.55, stdev=31.29, samples=182 iops : min= 1, max= 10, avg= 3.63, stdev= 2.07, samples=182 lat (msec) : 10=0.39%, 20=4.95%, 50=20.18%, 100=20.31%, 250=42.97% lat (msec) : 500=10.55%, 750=0.65% cpu : usr=0.04%, sys=1.16%, ctx=1453, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143618: Mon Aug 10 23:57:01 2026 read: IOPS=4, BW=66.0KiB/s (67.6kB/s)(6256KiB/94763msec) clat (msec): min=10, max=369, avg=57.29, stdev=48.94 lat (msec): min=10, max=369, avg=57.29, stdev=48.94 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 75], 90.00th=[ 109], 95.00th=[ 155], | 99.00th=[ 259], 99.50th=[ 313], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 255, per=33.25%, avg=81.13, stdev=53.61, samples=152 iops : min= 1, max= 15, avg= 4.31, stdev= 3.43, samples=152 write: IOPS=3, BW=63.7KiB/s (65.2kB/s)(6032KiB/94763msec); 0 zone resets clat (msec): min=64, max=596, avg=191.22, stdev=95.52 lat (msec): min=64, max=596, avg=191.23, stdev=95.52 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 91], 10.00th=[ 102], 20.00th=[ 120], | 30.00th=[ 129], 40.00th=[ 146], 50.00th=[ 165], 60.00th=[ 186], | 70.00th=[ 209], 80.00th=[ 255], 90.00th=[ 334], 95.00th=[ 401], | 99.00th=[ 506], 99.50th=[ 514], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 29, max= 160, per=26.35%, avg=67.72, stdev=29.82, samples=173 iops : min= 1, max= 10, avg= 3.44, stdev= 2.00, samples=173 lat (msec) : 20=6.64%, 50=23.05%, 100=19.40%, 250=40.36%, 500=9.90% lat (msec) : 750=0.65% cpu : usr=0.04%, sys=1.31%, ctx=1575, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143620: Mon Aug 10 23:57:01 2026 read: IOPS=3, BW=62.2KiB/s (63.7kB/s)(6032KiB/97020msec) clat (msec): min=10, max=473, avg=62.48, stdev=56.03 lat (msec): min=10, max=473, avg=62.48, stdev=56.03 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 129], 95.00th=[ 174], | 99.00th=[ 296], 99.50th=[ 372], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 29, max= 317, per=30.64%, avg=74.75, stdev=50.53, samples=157 iops : min= 1, max= 19, avg= 3.92, stdev= 3.20, samples=157 write: IOPS=4, BW=64.5KiB/s (66.0kB/s)(6256KiB/97020msec); 0 zone resets clat (msec): min=59, max=565, avg=187.65, stdev=86.85 lat (msec): min=59, max=565, avg=187.66, stdev=86.84 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 87], 10.00th=[ 103], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 150], 50.00th=[ 165], 60.00th=[ 186], | 70.00th=[ 209], 80.00th=[ 245], 90.00th=[ 317], 95.00th=[ 368], | 99.00th=[ 489], 99.50th=[ 502], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 30, max= 160, per=26.19%, avg=67.30, stdev=30.26, samples=182 iops : min= 1, max= 10, avg= 3.42, stdev= 2.01, samples=182 lat (msec) : 20=5.08%, 50=21.74%, 100=20.31%, 250=42.45%, 500=10.16% lat (msec) : 750=0.26% cpu : usr=0.04%, sys=1.19%, ctx=1522, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=245KiB/s (251kB/s), 58.7KiB/s-66.0KiB/s (60.1kB/s-67.6kB/s), io=23.4MiB (24.5MB), run=94763-97910msec WRITE: bw=257KiB/s (264kB/s), 63.7KiB/s-66.8KiB/s (65.2kB/s-68.4kB/s), io=24.6MiB (25.8MB), run=94763-97910msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143644: Mon Aug 10 23:57:15 2026 read: IOPS=1, BW=1614KiB/s (1653kB/s)(7168KiB/4441msec) clat (usec): min=520, max=526060, avg=182515.38, stdev=192855.23 lat (usec): min=521, max=526061, avg=182516.59, stdev=192855.25 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 1401], | 30.00th=[ 50070], 40.00th=[ 50070], 50.00th=[170918], 60.00th=[202376], | 70.00th=[202376], 80.00th=[329253], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 1946, max= 3670, per=69.66%, avg=2811.50, stdev=983.88, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1153KiB/s (1181kB/s)(5120KiB/4441msec); 0 zone resets clat (msec): min=376, max=854, avg=607.57, stdev=212.59 lat (msec): min=376, max=854, avg=607.72, stdev=212.48 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1526, max= 1973, per=32.89%, avg=1858.25, stdev=221.52, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=16.67%, 500=25.00%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=10.47%, ctx=175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143645: Mon Aug 10 23:57:15 2026 read: IOPS=0, BW=404KiB/s (413kB/s)(2048KiB/5074msec) clat (msec): min=2, max=218, avg=110.51, stdev=153.07 lat (msec): min=2, max=218, avg=110.51, stdev=153.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1855, max= 1965, per=47.32%, avg=1910.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2018KiB/s (2067kB/s)(10.0MiB/5074msec); 0 zone resets clat (msec): min=166, max=935, avg=480.87, stdev=266.42 lat (msec): min=166, max=935, avg=481.04, stdev=266.51 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 249], | 30.00th=[ 275], 40.00th=[ 317], 50.00th=[ 321], 60.00th=[ 414], | 70.00th=[ 600], 80.00th=[ 726], 90.00th=[ 802], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1526, max= 3938, per=43.45%, avg=2455.14, stdev=1024.04, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=9.58%, ctx=179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143646: Mon Aug 10 23:57:15 2026 read: IOPS=1, BW=1501KiB/s (1537kB/s)(6144KiB/4094msec) clat (usec): min=610, max=368115, avg=135652.63, stdev=166486.38 lat (usec): min=611, max=368115, avg=135653.78, stdev=166486.29 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 922], | 30.00th=[ 922], 40.00th=[ 4752], 50.00th=[ 4752], 60.00th=[127402], | 70.00th=[312476], 80.00th=[312476], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1526, max= 3938, per=58.24%, avg=2350.50, stdev=1078.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1501KiB/s (1537kB/s)(6144KiB/4094msec); 0 zone resets clat (msec): min=278, max=985, avg=529.04, stdev=247.40 lat (msec): min=278, max=985, avg=529.14, stdev=247.38 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 506], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1526, max= 3893, per=41.42%, avg=2340.25, stdev=1056.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=10.73%, ctx=126, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143647: Mon Aug 10 23:57:15 2026 read: IOPS=1, BW=1058KiB/s (1083kB/s)(5120KiB/4839msec) clat (usec): min=768, max=527988, avg=183603.70, stdev=239674.14 lat (usec): min=769, max=527989, avg=183604.80, stdev=239673.81 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 766], | 30.00th=[ 1860], 40.00th=[ 1860], 50.00th=[ 44303], 60.00th=[ 44303], | 70.00th=[341836], 80.00th=[341836], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 1961, max= 5094, per=87.40%, avg=3527.50, stdev=2215.37, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1481KiB/s (1517kB/s)(7168KiB/4839msec); 0 zone resets clat (msec): min=241, max=871, avg=551.40, stdev=224.15 lat (msec): min=241, max=873, avg=551.73, stdev=224.59 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 430], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 493], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 827], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1356, max= 3778, per=37.78%, avg=2134.60, stdev=946.89, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=8.33%, 500=33.33%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=9.32%, ctx=163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4036KiB/s (4133kB/s), 404KiB/s-1614KiB/s (413kB/s-1653kB/s), io=20.0MiB (20.0MB), run=4094-5074msec WRITE: bw=5651KiB/s (5786kB/s), 1153KiB/s-2018KiB/s (1181kB/s-2067kB/s), io=28.0MiB (29.4MB), run=4094-5074msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143650: Mon Aug 10 23:57:17 2026 read: IOPS=1, BW=1453KiB/s (1488kB/s)(7168KiB/4933msec) clat (msec): min=75, max=864, avg=277.55, stdev=305.76 lat (msec): min=75, max=864, avg=277.56, stdev=305.76 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 104], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 118], 60.00th=[ 124], | 70.00th=[ 124], 80.00th=[ 542], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1436, max= 3976, per=63.09%, avg=2256.60, stdev=988.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1038KiB/s (1063kB/s)(5120KiB/4933msec); 0 zone resets clat (msec): min=184, max=1456, avg=565.69, stdev=509.45 lat (msec): min=184, max=1456, avg=565.82, stdev=509.44 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1889, max= 4087, per=49.84%, avg=2496.25, stdev=1062.49, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.06%, sys=4.46%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143651: Mon Aug 10 23:57:17 2026 read: IOPS=0, BW=401KiB/s (410kB/s)(2048KiB/5111msec) clat (msec): min=106, max=899, avg=502.65, stdev=560.75 lat (msec): min=106, max=899, avg=502.65, stdev=560.75 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1988, max= 2048, per=56.42%, avg=2018.00, stdev=42.43, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2004KiB/s (2052kB/s)(10.0MiB/5111msec); 0 zone resets clat (msec): min=180, max=1107, avg=398.37, stdev=287.09 lat (msec): min=180, max=1109, avg=398.69, stdev=287.71 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 213], | 30.00th=[ 218], 40.00th=[ 245], 50.00th=[ 257], 60.00th=[ 309], | 70.00th=[ 351], 80.00th=[ 447], 90.00th=[ 659], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1812, max= 4096, per=52.96%, avg=2653.00, stdev=1116.37, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.84%, ctx=93, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143652: Mon Aug 10 23:57:17 2026 read: IOPS=1, BW=1114KiB/s (1140kB/s)(6144KiB/5517msec) clat (msec): min=93, max=497, avg=207.08, stdev=146.73 lat (msec): min=93, max=497, avg=207.08, stdev=146.73 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 180], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2048, max= 4087, per=94.96%, avg=3396.67, stdev=1168.09, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1114KiB/s (1140kB/s)(6144KiB/5517msec); 0 zone resets clat (msec): min=131, max=2089, avg=701.89, stdev=753.80 lat (msec): min=131, max=2089, avg=701.96, stdev=753.79 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 414], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1889, max= 4047, per=49.94%, avg=2501.50, stdev=1032.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.10%, ctx=61, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143653: Mon Aug 10 23:57:17 2026 read: IOPS=0, BW=894KiB/s (916kB/s)(5120KiB/5724msec) clat (msec): min=80, max=239, avg=156.92, stdev=61.37 lat (msec): min=80, max=239, avg=156.92, stdev=61.37 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 2027, max= 6131, per=100.00%, avg=4079.00, stdev=2901.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1252KiB/s (1282kB/s)(7168KiB/5724msec); 0 zone resets clat (msec): min=160, max=1878, avg=687.46, stdev=662.44 lat (msec): min=160, max=1878, avg=687.63, stdev=662.53 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 447], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 1284], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1889, max= 4096, per=53.29%, avg=2669.33, stdev=1237.34, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.13%, ctx=78, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3578KiB/s (3664kB/s), 401KiB/s-1453KiB/s (410kB/s-1488kB/s), io=20.0MiB (20.0MB), run=4933-5724msec WRITE: bw=5009KiB/s (5129kB/s), 1038KiB/s-2004KiB/s (1063kB/s-2052kB/s), io=28.0MiB (29.4MB), run=4933-5724msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143659: Mon Aug 10 23:57:32 2026 read: IOPS=0, BW=2880KiB/s (2949kB/s)(12.0MiB/4267msec) clat (msec): min=383, max=2104, avg=1335.17, stdev=875.17 lat (msec): min=383, max=2104, avg=1335.17, stdev=875.17 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.39%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143661: Mon Aug 10 23:57:32 2026 read: IOPS=0, BW=942KiB/s (965kB/s)(4096KiB/4348msec) clat (nsec): min=983917k, max=983917k, avg=983917243.00, stdev= 0.00 lat (nsec): min=983920k, max=983920k, avg=983919823.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1884KiB/s (1929kB/s)(8192KiB/4348msec); 0 zone resets clat (msec): min=1155, max=1988, avg=1571.86, stdev=588.63 lat (msec): min=1155, max=1994, avg=1575.22, stdev=593.06 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.35%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143662: Mon Aug 10 23:57:32 2026 write: IOPS=1, BW=4313KiB/s (4417kB/s)(12.0MiB/2849msec); 0 zone resets clat (msec): min=541, max=1552, avg=923.10, stdev=549.05 lat (msec): min=541, max=1552, avg=923.50, stdev=549.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7937, max= 8031, per=100.00%, avg=7984.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.98%, ctx=90, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143663: Mon Aug 10 23:57:32 2026 write: IOPS=0, BW=4055KiB/s (4153kB/s)(12.0MiB/3030msec); 0 zone resets clat (msec): min=427, max=1429, avg=973.41, stdev=506.57 lat (msec): min=433, max=1432, avg=976.71, stdev=504.94 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 6262, max= 8126, per=95.46%, avg=7194.00, stdev=1318.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.50%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3768KiB/s (3859kB/s), 942KiB/s-2880KiB/s (965kB/s-2949kB/s), io=16.0MiB (16.8MB), run=4267-4348msec WRITE: bw=7536KiB/s (7717kB/s), 1884KiB/s-4313KiB/s (1929kB/s-4417kB/s), io=32.0MiB (33.6MB), run=2849-4348msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143664: Mon Aug 10 23:57:33 2026 read: IOPS=0, BW=3246KiB/s (3324kB/s)(12.0MiB/3786msec) clat (msec): min=1099, max=1349, avg=1228.90, stdev=125.35 lat (msec): min=1099, max=1349, avg=1228.90, stdev=125.35 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7984, max= 8159, per=100.00%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=10.28%, ctx=304, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143665: Mon Aug 10 23:57:33 2026 read: IOPS=0, BW=837KiB/s (857kB/s)(4096KiB/4895msec) clat (nsec): min=1001.4M, max=1001.4M, avg=1001377924.00, stdev= 0.00 lat (nsec): min=1001.4M, max=1001.4M, avg=1001381447.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1674KiB/s (1714kB/s)(8192KiB/4895msec); 0 zone resets clat (msec): min=950, max=2422, avg=1686.42, stdev=1040.80 lat (msec): min=950, max=2440, avg=1695.73, stdev=1053.33 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.50%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143666: Mon Aug 10 23:57:33 2026 write: IOPS=0, BW=2484KiB/s (2544kB/s)(12.0MiB/4946msec); 0 zone resets clat (msec): min=477, max=2102, avg=1538.40, stdev=918.97 lat (msec): min=478, max=2104, avg=1539.76, stdev=919.36 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 2039], 50.00th=[ 2039], 60.00th=[ 2039], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.46%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143667: Mon Aug 10 23:57:33 2026 write: IOPS=0, BW=3479KiB/s (3563kB/s)(12.0MiB/3532msec); 0 zone resets clat (msec): min=487, max=1308, avg=1031.02, stdev=470.58 lat (msec): min=488, max=1309, avg=1032.08, stdev=470.93 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7968, max= 8110, per=100.00%, avg=8039.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.30%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3347KiB/s (3427kB/s), 837KiB/s-3246KiB/s (857kB/s-3324kB/s), io=16.0MiB (16.8MB), run=3786-4895msec WRITE: bw=6625KiB/s (6784kB/s), 1674KiB/s-3479KiB/s (1714kB/s-3563kB/s), io=32.0MiB (33.6MB), run=3532-4946msec