== sanity test 398b: DIO and buffer IO race ============== 04:27:41 (1787473661) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.27942 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178137: Sun Aug 23 04:30:30 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(5992KiB/143279msec) clat (usec): min=44, max=482543, avg=52658.59, stdev=35639.47 lat (usec): min=44, max=482545, avg=52660.52, stdev=35640.13 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13304], 10.00th=[ 20579], 20.00th=[ 26870], | 30.00th=[ 32900], 40.00th=[ 39584], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[166724], 99.50th=[183501], 99.90th=[358613], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 101, per=25.68%, avg=41.61, stdev=17.82, samples=280 iops : min= 1, max= 25, avg= 9.74, stdev= 4.47, samples=280 write: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6296KiB/143279msec); 0 zone resets clat (usec): min=836, max=848517, avg=40542.19, stdev=47525.89 lat (usec): min=837, max=848519, avg=40546.33, stdev=47525.45 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1745], 20.00th=[ 4293], | 30.00th=[ 8455], 40.00th=[ 16188], 50.00th=[ 26346], 60.00th=[ 36963], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 99091], 95.00th=[129500], | 99.00th=[183501], 99.50th=[217056], 99.90th=[278922], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 120, per=25.71%, avg=43.70, stdev=19.55, samples=280 iops : min= 1, max= 30, avg=10.28, stdev= 4.94, samples=280 lat (usec) : 50=0.03%, 100=1.56%, 250=0.16%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.70%, 4=3.97%, 10=7.32%, 20=7.94%, 50=35.81% lat (msec) : 100=28.42%, 250=8.69%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=4.33%, ctx=6465, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178139: Sun Aug 23 04:30:30 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5940KiB/146300msec) clat (usec): min=46, max=463014, avg=53599.38, stdev=35553.48 lat (usec): min=46, max=463015, avg=53601.47, stdev=35553.24 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13435], 10.00th=[ 20317], 20.00th=[ 27395], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[173016], 99.50th=[206570], 99.90th=[267387], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 5, max= 111, per=24.93%, avg=40.38, stdev=18.27, samples=286 iops : min= 1, max= 27, avg= 9.43, stdev= 4.59, samples=286 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6348KiB/146300msec); 0 zone resets clat (usec): min=988, max=888392, avg=41611.48, stdev=49420.39 lat (usec): min=989, max=888393, avg=41614.93, stdev=49419.55 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1696], 20.00th=[ 4293], | 30.00th=[ 8094], 40.00th=[ 16909], 50.00th=[ 28443], 60.00th=[ 40109], | 70.00th=[ 50594], 80.00th=[ 68682], 90.00th=[103285], 95.00th=[127402], | 99.00th=[208667], 99.50th=[250610], 99.90th=[291505], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 142, per=25.22%, avg=42.87, stdev=19.85, samples=287 iops : min= 1, max= 35, avg=10.07, stdev= 5.00, samples=287 lat (usec) : 50=0.07%, 100=1.33%, 250=0.23%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.96%, 4=3.87%, 10=7.36%, 20=7.58%, 50=35.87% lat (msec) : 100=27.80%, 250=9.47%, 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=4.31%, ctx=6451, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178140: Sun Aug 23 04:30:30 2026 read: IOPS=10, BW=42.1KiB/s (43.2kB/s)(6028KiB/143039msec) clat (usec): min=34, max=547045, avg=52099.74, stdev=37963.26 lat (usec): min=34, max=547046, avg=52101.22, stdev=37963.28 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12780], 10.00th=[ 19530], 20.00th=[ 25822], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[191890], 99.50th=[221250], 99.90th=[417334], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 111, per=25.93%, avg=42.00, stdev=17.04, samples=279 iops : min= 1, max= 27, avg= 9.84, stdev= 4.28, samples=279 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6260KiB/143039msec); 0 zone resets clat (usec): min=1126, max=973696, avg=40837.24, stdev=48456.34 lat (usec): min=1128, max=973699, avg=40839.86, stdev=48455.74 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1418], 10.00th=[ 1795], 20.00th=[ 4752], | 30.00th=[ 8717], 40.00th=[ 17433], 50.00th=[ 27395], 60.00th=[ 38536], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[126354], | 99.00th=[196084], 99.50th=[212861], 99.90th=[287310], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 112, per=25.68%, avg=43.65, stdev=20.44, samples=279 iops : min= 1, max= 28, avg=10.26, stdev= 5.16, samples=279 lat (usec) : 50=0.16%, 100=1.79%, 250=0.07%, 750=0.07%, 1000=0.03% lat (msec) : 2=5.60%, 4=3.29%, 10=7.62%, 20=8.30%, 50=36.75% lat (msec) : 100=28.03%, 250=8.11%, 500=0.13%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.46%, ctx=6246, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178143: Sun Aug 23 04:30:30 2026 read: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6052KiB/147653msec) clat (usec): min=36, max=905051, avg=55006.29, stdev=41722.08 lat (usec): min=37, max=905053, avg=55012.92, stdev=41718.84 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12518], 10.00th=[ 20317], 20.00th=[ 27132], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 55313], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[122160], | 99.00th=[170918], 99.50th=[210764], 99.90th=[274727], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 87, per=25.35%, avg=41.07, stdev=15.25, samples=287 iops : min= 1, max= 21, avg= 9.61, stdev= 3.84, samples=287 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6236KiB/147653msec); 0 zone resets clat (usec): min=826, max=305367, avg=40928.93, stdev=43373.54 lat (usec): min=826, max=305369, avg=40931.35, stdev=43373.39 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1369], 10.00th=[ 1713], 20.00th=[ 4424], | 30.00th=[ 8586], 40.00th=[ 16909], 50.00th=[ 28705], 60.00th=[ 40109], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 99091], 95.00th=[125305], | 99.00th=[202376], 99.50th=[233833], 99.90th=[283116], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 119, per=24.79%, avg=42.14, stdev=19.46, samples=288 iops : min= 1, max= 29, avg= 9.88, stdev= 4.88, samples=288 lat (usec) : 50=0.26%, 100=1.56%, 250=0.16%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.70%, 4=3.22%, 10=7.36%, 20=7.81%, 50=34.18% lat (msec) : 100=29.59%, 250=9.67%, 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=4.45%, ctx=6555, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.6KiB/s-42.1KiB/s (41.6kB/s-43.2kB/s), io=23.4MiB (24.6MB), run=143039-147653msec WRITE: bw=170KiB/s (174kB/s), 42.2KiB/s-43.9KiB/s (43.2kB/s-44.0kB/s), io=24.6MiB (25.7MB), run=143039-147653msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178136: Sun Aug 23 04:31:23 2026 read: IOPS=7, BW=30.0KiB/s (30.7kB/s)(5992KiB/199674msec) clat (msec): min=7, max=1003, avg=52.64, stdev=51.82 lat (msec): min=7, max=1003, avg=52.65, stdev=51.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 435], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 104, per=25.65%, avg=30.53, stdev=20.77, samples=380 iops : min= 1, max= 26, avg= 6.97, stdev= 5.26, samples=380 write: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6296KiB/199674msec); 0 zone resets clat (msec): min=10, max=506, avg=76.39, stdev=53.72 lat (msec): min=10, max=506, avg=76.40, stdev=53.72 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 111], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 264], 99.50th=[ 292], 99.90th=[ 456], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 103, per=25.69%, avg=31.86, stdev=20.15, samples=383 iops : min= 1, max= 25, avg= 7.30, stdev= 5.07, samples=383 lat (msec) : 10=0.72%, 20=9.86%, 50=41.57%, 100=28.81%, 250=18.10% lat (msec) : 500=0.88%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=5014, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178138: Sun Aug 23 04:31:23 2026 read: IOPS=7, BW=29.7KiB/s (30.4kB/s)(5940KiB/199756msec) clat (msec): min=5, max=907, avg=50.00, stdev=50.23 lat (msec): min=5, max=907, avg=50.00, stdev=50.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 215], 99.50th=[ 264], 99.90th=[ 359], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 119, per=26.63%, avg=31.69, stdev=21.50, samples=363 iops : min= 1, max= 29, avg= 7.26, stdev= 5.43, samples=363 write: IOPS=7, BW=31.8KiB/s (32.5kB/s)(6348KiB/199756msec); 0 zone resets clat (msec): min=15, max=562, avg=78.72, stdev=58.12 lat (msec): min=15, max=562, avg=78.72, stdev=58.12 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 73], | 70.00th=[ 93], 80.00th=[ 117], 90.00th=[ 155], 95.00th=[ 190], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 481], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 103, per=25.74%, avg=31.92, stdev=20.49, samples=385 iops : min= 1, max= 25, avg= 7.32, stdev= 5.17, samples=385 lat (msec) : 10=0.88%, 20=10.61%, 50=43.23%, 100=26.17%, 250=18.00% lat (msec) : 500=1.04%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.75%, ctx=4923, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178141: Sun Aug 23 04:31:23 2026 read: IOPS=7, BW=29.0KiB/s (30.7kB/s)(6028KiB/201235msec) clat (msec): min=5, max=371, avg=52.14, stdev=47.61 lat (msec): min=5, max=371, avg=52.14, stdev=47.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 78], 90.00th=[ 116], 95.00th=[ 155], | 99.00th=[ 239], 99.50th=[ 266], 99.90th=[ 326], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 116, per=25.93%, avg=30.86, stdev=21.20, samples=378 iops : min= 1, max= 29, avg= 7.06, stdev= 5.36, samples=378 write: IOPS=7, BW=31.1KiB/s (31.9kB/s)(6260KiB/201235msec); 0 zone resets clat (msec): min=10, max=943, avg=78.02, stdev=62.13 lat (msec): min=10, max=943, avg=78.02, stdev=62.13 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 90], 80.00th=[ 113], 90.00th=[ 150], 95.00th=[ 197], | 99.00th=[ 305], 99.50th=[ 351], 99.90th=[ 514], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 104, per=25.10%, avg=31.13, stdev=20.71, samples=389 iops : min= 1, max= 26, avg= 7.12, stdev= 5.24, samples=389 lat (msec) : 10=0.85%, 20=10.42%, 50=42.51%, 100=26.43%, 250=18.42% lat (msec) : 500=1.30%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.81%, ctx=5030, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178142: Sun Aug 23 04:31:23 2026 read: IOPS=7, BW=30.3KiB/s (30.0kB/s)(6052KiB/199993msec) clat (msec): min=6, max=423, avg=51.57, stdev=49.03 lat (msec): min=6, max=423, avg=51.57, stdev=49.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 249], 99.50th=[ 317], 99.90th=[ 376], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 111, per=26.52%, avg=31.56, stdev=22.24, samples=372 iops : min= 1, max= 27, avg= 7.22, stdev= 5.60, samples=372 write: IOPS=7, BW=31.2KiB/s (31.9kB/s)(6236KiB/199993msec); 0 zone resets clat (msec): min=15, max=886, avg=77.82, stdev=59.68 lat (msec): min=15, max=886, avg=77.83, stdev=59.68 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 114], 90.00th=[ 153], 95.00th=[ 182], | 99.00th=[ 292], 99.50th=[ 330], 99.90th=[ 506], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 96, per=25.13%, avg=31.16, stdev=19.64, samples=388 iops : min= 1, max= 24, avg= 7.12, stdev= 4.95, samples=388 lat (msec) : 10=0.98%, 20=9.64%, 50=43.52%, 100=26.76%, 250=17.68% lat (msec) : 500=1.37%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4939, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=119KiB/s (122kB/s), 29.7KiB/s-30.3KiB/s (30.4kB/s-30.0kB/s), io=23.4MiB (24.6MB), run=199674-201235msec WRITE: bw=125KiB/s (128kB/s), 31.1KiB/s-31.8KiB/s (31.9kB/s-32.5kB/s), io=24.6MiB (25.7MB), run=199674-201235msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178194: Sun Aug 23 04:32:14 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5920KiB/36312msec) clat (usec): min=34, max=280085, avg=54721.54, stdev=41027.63 lat (usec): min=35, max=280087, avg=54723.31, stdev=41027.22 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 110], 20.00th=[ 25822], | 30.00th=[ 32375], 40.00th=[ 39584], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[107480], 95.00th=[126354], | 99.00th=[212861], 99.50th=[246416], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 383, per=26.62%, avg=160.54, stdev=68.97, samples=71 iops : min= 1, max= 23, avg= 9.28, stdev= 4.39, samples=71 write: IOPS=10, BW=175KiB/s (180kB/s)(6368KiB/36312msec); 0 zone resets clat (usec): min=1595, max=207490, avg=40261.77, stdev=40648.80 lat (usec): min=1597, max=207492, avg=40267.45, stdev=40647.48 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 6325], | 30.00th=[ 10028], 40.00th=[ 19268], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 65274], 90.00th=[101188], 95.00th=[130548], | 99.00th=[177210], 99.50th=[181404], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 30, max= 416, per=27.48%, avg=174.48, stdev=79.73, samples=71 iops : min= 1, max= 26, avg=10.15, stdev= 5.05, samples=71 lat (usec) : 50=0.39%, 100=3.65%, 250=1.17% lat (msec) : 2=2.21%, 4=4.04%, 10=9.38%, 20=7.55%, 50=33.98% lat (msec) : 100=26.56%, 250=10.94%, 500=0.13% cpu : usr=0.06%, sys=4.91%, ctx=1657, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178195: Sun Aug 23 04:32:14 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(5744KiB/38321msec) clat (usec): min=39, max=226676, avg=56874.70, stdev=37912.29 lat (usec): min=40, max=226677, avg=56875.95, stdev=37912.37 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 13960], 20.00th=[ 27919], | 30.00th=[ 36439], 40.00th=[ 42730], 50.00th=[ 50070], 60.00th=[ 60556], | 70.00th=[ 71828], 80.00th=[ 82314], 90.00th=[103285], 95.00th=[127402], | 99.00th=[185598], 99.50th=[217056], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 30, max= 352, per=25.33%, avg=152.75, stdev=61.84, samples=73 iops : min= 1, max= 22, avg= 8.78, stdev= 3.98, samples=73 write: IOPS=10, BW=171KiB/s (175kB/s)(6544KiB/38321msec); 0 zone resets clat (usec): min=1417, max=220664, avg=43611.23, stdev=44369.80 lat (usec): min=1419, max=220666, avg=43627.30, stdev=44360.22 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2040], 10.00th=[ 2835], 20.00th=[ 6063], | 30.00th=[ 9634], 40.00th=[ 16909], 50.00th=[ 28967], 60.00th=[ 41681], | 70.00th=[ 53740], 80.00th=[ 82314], 90.00th=[106431], 95.00th=[141558], | 99.00th=[168821], 99.50th=[183501], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 476, per=26.72%, avg=169.68, stdev=80.30, samples=75 iops : min= 1, max= 29, avg= 9.84, stdev= 5.02, samples=75 lat (usec) : 50=0.13%, 100=3.52%, 250=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=4.82%, 10=8.98%, 20=7.81%, 50=30.60% lat (msec) : 100=29.04%, 250=11.98% cpu : usr=0.07%, sys=4.53%, ctx=1659, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178196: Sun Aug 23 04:32:14 2026 read: IOPS=9, BW=158KiB/s (161kB/s)(6256KiB/39683msec) clat (usec): min=44, max=277582, avg=57494.06, stdev=39301.82 lat (usec): min=44, max=277584, avg=57497.43, stdev=39301.21 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 19006], 20.00th=[ 29754], | 30.00th=[ 36963], 40.00th=[ 43779], 50.00th=[ 51643], 60.00th=[ 59507], | 70.00th=[ 69731], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[128451], | 99.00th=[210764], 99.50th=[250610], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 32, max= 351, per=26.13%, avg=157.56, stdev=67.95, samples=78 iops : min= 2, max= 21, avg= 9.08, stdev= 4.24, samples=78 write: IOPS=9, BW=152KiB/s (156kB/s)(6032KiB/39683msec); 0 zone resets clat (usec): min=1433, max=305282, avg=45453.03, stdev=42742.21 lat (usec): min=1435, max=305285, avg=45459.87, stdev=42749.02 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2040], 10.00th=[ 4015], 20.00th=[ 8979], | 30.00th=[ 16909], 40.00th=[ 22938], 50.00th=[ 33817], 60.00th=[ 42730], | 70.00th=[ 58983], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[130548], | 99.00th=[181404], 99.50th=[214959], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 352, per=23.51%, avg=149.29, stdev=65.82, samples=78 iops : min= 1, max= 22, avg= 8.56, stdev= 4.16, samples=78 lat (usec) : 50=0.13%, 100=3.26%, 250=0.13% lat (msec) : 2=2.34%, 4=2.60%, 10=5.86%, 20=8.20%, 50=33.33% lat (msec) : 100=32.42%, 250=11.33%, 500=0.39% cpu : usr=0.07%, sys=4.35%, ctx=1747, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178197: Sun Aug 23 04:32:14 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37273msec) clat (usec): min=40, max=298041, avg=54534.10, stdev=39853.88 lat (usec): min=40, max=298042, avg=54535.42, stdev=39854.09 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 176], 20.00th=[ 26084], | 30.00th=[ 32900], 40.00th=[ 40633], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 66847], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[124257], | 99.00th=[221250], 99.50th=[221250], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 350, per=27.16%, avg=163.78, stdev=67.47, samples=72 iops : min= 1, max= 21, avg= 9.47, stdev= 4.27, samples=72 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37273msec); 0 zone resets clat (usec): min=1088, max=265029, avg=42598.30, stdev=44032.19 lat (usec): min=1090, max=265032, avg=42607.66, stdev=44026.47 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2008], 10.00th=[ 3720], 20.00th=[ 7242], | 30.00th=[ 10814], 40.00th=[ 17957], 50.00th=[ 27919], 60.00th=[ 39584], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[133694], | 99.00th=[193987], 99.50th=[250610], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 414, per=26.49%, avg=168.21, stdev=73.83, samples=73 iops : min= 1, max= 25, avg= 9.77, stdev= 4.70, samples=73 lat (usec) : 50=0.13%, 100=4.04%, 250=0.91%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=3.26%, 10=8.59%, 20=8.59%, 50=31.51% lat (msec) : 100=30.21%, 250=9.64%, 500=0.39% cpu : usr=0.07%, sys=4.40%, ctx=1658, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=604KiB/s (618kB/s), 150KiB/s-163KiB/s (153kB/s-167kB/s), io=23.4MiB (24.5MB), run=36312-39683msec WRITE: bw=635KiB/s (650kB/s), 152KiB/s-175KiB/s (156kB/s-180kB/s), io=24.6MiB (25.8MB), run=36312-39683msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178189: Sun Aug 23 04:32:27 2026 read: IOPS=7, BW=113KiB/s (115kB/s)(5920KiB/52571msec) clat (msec): min=8, max=247, avg=56.49, stdev=46.91 lat (msec): min=8, max=247, avg=56.49, stdev=46.91 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 132], 95.00th=[ 163], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 29, max= 319, per=25.26%, avg=114.18, stdev=71.74, samples=101 iops : min= 1, max= 19, avg= 6.32, stdev= 4.51, samples=101 write: IOPS=7, BW=121KiB/s (124kB/s)(6368KiB/52571msec); 0 zone resets clat (msec): min=13, max=344, avg=78.97, stdev=54.15 lat (msec): min=13, max=344, avg=78.97, stdev=54.15 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 88], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 197], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 416, per=25.62%, avg=121.96, stdev=75.18, samples=102 iops : min= 1, max= 26, avg= 6.81, stdev= 4.78, samples=102 lat (msec) : 10=0.26%, 20=6.38%, 50=42.58%, 100=30.21%, 250=19.27% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.61%, ctx=1172, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178190: Sun Aug 23 04:32:27 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(5744KiB/52661msec) clat (msec): min=8, max=288, avg=54.95, stdev=47.35 lat (msec): min=8, max=288, avg=54.96, stdev=47.36 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 84], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 245], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 21, max= 349, per=25.50%, avg=115.28, stdev=74.96, samples=97 iops : min= 1, max= 21, avg= 6.40, stdev= 4.72, samples=97 write: IOPS=7, BW=124KiB/s (127kB/s)(6544KiB/52661msec); 0 zone resets clat (msec): min=13, max=378, avg=80.06, stdev=55.70 lat (msec): min=13, max=378, avg=80.06, stdev=55.70 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 92], 80.00th=[ 121], 90.00th=[ 153], 95.00th=[ 186], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 29, max= 480, per=25.90%, avg=123.28, stdev=78.94, samples=103 iops : min= 1, max= 30, avg= 6.89, stdev= 5.00, samples=103 lat (msec) : 10=0.26%, 20=7.42%, 50=44.01%, 100=26.56%, 250=20.44% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.51%, ctx=1177, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178191: Sun Aug 23 04:32:27 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6256KiB/52559msec) clat (msec): min=7, max=332, avg=55.31, stdev=50.15 lat (msec): min=7, max=332, avg=55.32, stdev=50.15 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 82], 90.00th=[ 115], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 330], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 414, per=26.32%, avg=118.96, stdev=87.86, samples=103 iops : min= 1, max= 25, avg= 6.62, stdev= 5.56, samples=103 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52559msec); 0 zone resets clat (msec): min=17, max=323, avg=81.82, stdev=53.78 lat (msec): min=17, max=323, avg=81.84, stdev=53.77 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 80], | 70.00th=[ 96], 80.00th=[ 118], 90.00th=[ 159], 95.00th=[ 197], | 99.00th=[ 241], 99.50th=[ 305], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 383, per=24.36%, avg=115.97, stdev=71.50, samples=101 iops : min= 1, max= 23, avg= 6.44, stdev= 4.53, samples=101 lat (msec) : 10=0.52%, 20=8.07%, 50=42.06%, 100=28.65%, 250=20.05% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.59%, ctx=1183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178192: Sun Aug 23 04:32:27 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52879msec) clat (msec): min=9, max=334, avg=56.26, stdev=46.36 lat (msec): min=9, max=334, avg=56.26, stdev=46.37 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 86], 90.00th=[ 127], 95.00th=[ 161], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 29, max= 384, per=25.07%, avg=113.31, stdev=77.50, samples=104 iops : min= 1, max= 24, avg= 6.28, stdev= 4.91, samples=104 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52879msec); 0 zone resets clat (msec): min=20, max=385, avg=80.37, stdev=55.14 lat (msec): min=20, max=385, avg=80.37, stdev=55.14 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 65], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 115], 90.00th=[ 157], 95.00th=[ 197], | 99.00th=[ 253], 99.50th=[ 338], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 351, per=24.84%, avg=118.25, stdev=76.46, samples=104 iops : min= 1, max= 21, avg= 6.59, stdev= 4.87, samples=104 lat (msec) : 10=0.13%, 20=6.90%, 50=42.97%, 100=28.78%, 250=20.57% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.75%, ctx=1245, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=453KiB/s (464kB/s), 109KiB/s-119KiB/s (112kB/s-122kB/s), io=23.4MiB (24.5MB), run=52559-52879msec WRITE: bw=477KiB/s (488kB/s), 115KiB/s-124KiB/s (118kB/s-127kB/s), io=24.6MiB (25.8MB), run=52559-52879msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178211: Sun Aug 23 04:32:46 2026 read: IOPS=2, BW=2442KiB/s (2501kB/s)(7168KiB/2935msec) clat (msec): min=70, max=868, avg=261.26, stdev=275.12 lat (msec): min=70, max=868, avg=261.26, stdev=275.12 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 127], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 174], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 275], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1996, max= 4822, per=100.00%, avg=2952.33, stdev=1619.32, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1744KiB/s (1786kB/s)(5120KiB/2935msec); 0 zone resets clat (msec): min=85, max=378, avg=194.11, stdev=125.09 lat (msec): min=85, max=378, avg=194.22, stdev=125.07 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 133], 60.00th=[ 133], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1996, max= 4000, per=67.45%, avg=2678.33, stdev=1144.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=5.28%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178212: Sun Aug 23 04:32:46 2026 read: IOPS=0, BW=284KiB/s (290kB/s)(2048KiB/7220msec) clat (msec): min=201, max=373, avg=287.42, stdev=121.62 lat (msec): min=201, max=373, avg=287.42, stdev=121.62 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1750, max= 2003, per=66.17%, avg=1876.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1418KiB/s (1452kB/s)(10.0MiB/7220msec); 0 zone resets clat (msec): min=128, max=3476, avg=656.27, stdev=1023.58 lat (msec): min=128, max=3476, avg=656.48, stdev=1023.56 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 157], | 30.00th=[ 169], 40.00th=[ 171], 50.00th=[ 190], 60.00th=[ 192], | 70.00th=[ 550], 80.00th=[ 718], 90.00th=[ 810], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1750, max= 4096, per=64.23%, avg=2550.71, stdev=1054.31, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.06%, ctx=70, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178213: Sun Aug 23 04:32:46 2026 read: IOPS=1, BW=1048KiB/s (1073kB/s)(6144KiB/5863msec) clat (msec): min=81, max=697, avg=235.23, stdev=238.49 lat (msec): min=81, max=697, avg=235.23, stdev=238.49 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 155], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1885, max= 5988, per=100.00%, avg=3302.67, stdev=2326.78, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1048KiB/s (1073kB/s)(6144KiB/5863msec); 0 zone resets clat (msec): min=123, max=3082, avg=732.45, stdev=1157.40 lat (msec): min=123, max=3082, avg=732.66, stdev=1157.34 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 347], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1996, max= 3155, per=56.55%, avg=2245.60, stdev=508.72, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=2.00%, ctx=44, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178214: Sun Aug 23 04:32:46 2026 read: IOPS=0, BW=811KiB/s (831kB/s)(5120KiB/6312msec) clat (msec): min=96, max=383, avg=192.86, stdev=122.76 lat (msec): min=96, max=383, avg=192.86, stdev=122.76 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1136KiB/s (1163kB/s)(7168KiB/6312msec); 0 zone resets clat (msec): min=219, max=2885, avg=744.73, stdev=975.41 lat (msec): min=219, max=2885, avg=745.11, stdev=975.27 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 236], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 334], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 927], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1996, max= 4015, per=66.62%, avg=2645.60, stdev=916.30, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.04%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2837KiB/s (2905kB/s), 284KiB/s-2442KiB/s (290kB/s-2501kB/s), io=20.0MiB (20.0MB), run=2935-7220msec WRITE: bw=3971KiB/s (4066kB/s), 1048KiB/s-1744KiB/s (1073kB/s-1786kB/s), io=28.0MiB (29.4MB), run=2935-7220msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178216: Sun Aug 23 04:32:46 2026 read: IOPS=1, BW=1079KiB/s (1104kB/s)(7168KiB/6646msec) clat (msec): min=181, max=3546, avg=710.66, stdev=1251.08 lat (msec): min=181, max=3546, avg=710.66, stdev=1251.08 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 209], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 243], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2019, max= 4063, per=91.39%, avg=2734.25, stdev=962.60, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=770KiB/s (789kB/s)(5120KiB/6646msec); 0 zone resets clat (msec): min=188, max=666, avg=333.73, stdev=193.09 lat (msec): min=188, max=666, avg=333.85, stdev=193.09 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1976, max= 2035, per=48.11%, avg=2015.25, stdev=27.04, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.84%, ctx=541, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178217: Sun Aug 23 04:32:46 2026 read: IOPS=0, BW=299KiB/s (306kB/s)(2048KiB/6843msec) clat (msec): min=258, max=817, avg=537.63, stdev=395.28 lat (msec): min=258, max=817, avg=537.63, stdev=395.28 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1976, max= 2015, per=66.69%, avg=1995.50, stdev=27.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1496KiB/s (1532kB/s)(10.0MiB/6843msec); 0 zone resets clat (msec): min=155, max=3296, avg=576.20, stdev=960.44 lat (msec): min=156, max=3296, avg=576.66, stdev=960.32 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 178], | 30.00th=[ 194], 40.00th=[ 218], 50.00th=[ 234], 60.00th=[ 317], | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 439], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1976, max= 6107, per=72.33%, avg=3030.00, stdev=1718.16, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.81%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178218: Sun Aug 23 04:32:46 2026 read: IOPS=0, BW=923KiB/s (946kB/s)(6144KiB/6653msec) clat (usec): min=520, max=331999, avg=186814.67, stdev=116827.91 lat (usec): min=522, max=332014, avg=186818.25, stdev=116831.12 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[107480], | 30.00th=[107480], 40.00th=[208667], 50.00th=[208667], 60.00th=[217056], | 70.00th=[256902], 80.00th=[256902], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2035, max= 4063, per=100.00%, avg=3350.33, stdev=1140.44, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=923KiB/s (946kB/s)(6144KiB/6653msec); 0 zone resets clat (msec): min=116, max=3814, avg=921.63, stdev=1429.77 lat (msec): min=116, max=3815, avg=921.73, stdev=1429.76 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 414], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1418, max= 2035, per=45.24%, avg=1895.00, stdev=267.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.00%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178219: Sun Aug 23 04:32:46 2026 read: IOPS=0, BW=764KiB/s (783kB/s)(5120KiB/6699msec) clat (usec): min=607, max=212002, avg=95116.48, stdev=103148.39 lat (usec): min=609, max=212002, avg=95117.91, stdev=103147.91 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 3195], 40.00th=[ 3195], 50.00th=[ 62653], 60.00th=[ 62653], | 70.00th=[198181], 80.00th=[198181], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1070KiB/s (1096kB/s)(7168KiB/6699msec); 0 zone resets clat (msec): min=150, max=3780, avg=888.67, stdev=1296.45 lat (msec): min=150, max=3781, avg=888.81, stdev=1296.60 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 220], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 397], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 852], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1976, max= 2035, per=48.08%, avg=2014.25, stdev=26.92, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.23%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2993KiB/s (3065kB/s), 299KiB/s-1079KiB/s (306kB/s-1104kB/s), io=20.0MiB (20.0MB), run=6646-6843msec WRITE: bw=4190KiB/s (4291kB/s), 770KiB/s-1496KiB/s (789kB/s-1532kB/s), io=28.0MiB (29.4MB), run=6646-6843msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178226: Sun Aug 23 04:33:01 2026 read: IOPS=0, BW=4076KiB/s (4173kB/s)(12.0MiB/3015msec) clat (msec): min=426, max=1507, avg=953.92, stdev=540.78 lat (msec): min=426, max=1507, avg=953.92, stdev=540.78 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7861, max= 7937, per=100.00%, avg=7899.00, stdev=53.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.25%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178227: Sun Aug 23 04:33:01 2026 read: IOPS=0, BW=1221KiB/s (1250kB/s)(4096KiB/3355msec) clat (nsec): min=926813k, max=926813k, avg=926813183.00, stdev= 0.00 lat (nsec): min=926815k, max=926815k, avg=926814579.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2442KiB/s (2500kB/s)(8192KiB/3355msec); 0 zone resets clat (msec): min=1029, max=1251, avg=1140.79, stdev=156.94 lat (msec): min=1030, max=1252, avg=1141.15, stdev=157.16 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8094, max= 8094, per=82.88%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.09%, sys=3.46%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178228: Sun Aug 23 04:33:01 2026 write: IOPS=2, BW=9608KiB/s (9838kB/s)(12.0MiB/1279msec); 0 zone resets clat (msec): min=269, max=489, avg=385.75, stdev=110.34 lat (msec): min=270, max=491, avg=386.64, stdev=110.83 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 5936, max= 8175, per=72.25%, avg=7055.50, stdev=1583.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.08%, sys=7.20%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178229: Sun Aug 23 04:33:01 2026 write: IOPS=1, BW=5456KiB/s (5587kB/s)(12.0MiB/2252msec); 0 zone resets clat (msec): min=225, max=1544, avg=671.95, stdev=755.41 lat (msec): min=225, max=1549, avg=674.79, stdev=757.27 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7656, max= 8159, per=80.97%, avg=7907.50, stdev=355.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.18%, sys=5.95%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4883KiB/s (5001kB/s), 1221KiB/s-4076KiB/s (1250kB/s-4173kB/s), io=16.0MiB (16.8MB), run=3015-3355msec WRITE: bw=9767KiB/s (10.0MB/s), 2442KiB/s-9608KiB/s (2500kB/s-9838kB/s), io=32.0MiB (33.6MB), run=1279-3355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178230: Sun Aug 23 04:33:01 2026 read: IOPS=1, BW=4656KiB/s (4768kB/s)(12.0MiB/2639msec) clat (msec): min=629, max=968, avg=837.30, stdev=182.11 lat (msec): min=629, max=968, avg=837.30, stdev=182.11 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.58%, ctx=339, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178231: Sun Aug 23 04:33:01 2026 read: IOPS=0, BW=2066KiB/s (2115kB/s)(4096KiB/1983msec) clat (nsec): min=726977k, max=726977k, avg=726976617.00, stdev= 0.00 lat (nsec): min=726980k, max=726980k, avg=726979715.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4131KiB/s (4230kB/s)(8192KiB/1983msec); 0 zone resets clat (msec): min=508, max=674, avg=591.64, stdev=117.63 lat (msec): min=512, max=675, avg=593.84, stdev=115.01 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=87.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.20%, sys=4.99%, ctx=145, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178232: Sun Aug 23 04:33:01 2026 write: IOPS=0, BW=3493KiB/s (3577kB/s)(12.0MiB/3518msec); 0 zone resets clat (msec): min=512, max=1651, avg=1153.90, stdev=583.04 lat (msec): min=512, max=1651, avg=1154.47, stdev=582.95 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7907, max= 8192, per=86.42%, avg=8049.50, stdev=201.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.24%, ctx=154, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178233: Sun Aug 23 04:33:01 2026 write: IOPS=1, BW=4867KiB/s (4983kB/s)(12.0MiB/2525msec); 0 zone resets clat (msec): min=344, max=1597, avg=808.73, stdev=686.42 lat (msec): min=345, max=1599, avg=810.05, stdev=687.66 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7074, max= 8143, per=81.69%, avg=7608.50, stdev=755.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.49%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6208KiB/s (6357kB/s), 2066KiB/s-4656KiB/s (2115kB/s-4768kB/s), io=16.0MiB (16.8MB), run=1983-2639msec WRITE: bw=9314KiB/s (9538kB/s), 3493KiB/s-4867KiB/s (3577kB/s-4983kB/s), io=32.0MiB (33.6MB), run=1983-3518msec