== sanity test 398b: DIO and buffer IO race ============== 02:22:46 (1788934966) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.11449 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178084: Wed Sep 9 02:25:01 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5992KiB/110811msec) clat (usec): min=43, max=198767, avg=39840.21, stdev=24966.11 lat (usec): min=43, max=198769, avg=39843.99, stdev=24965.45 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 10028], 10.00th=[ 15664], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[129500], 99.50th=[154141], 99.90th=[183501], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 119, per=25.75%, avg=53.83, stdev=19.95, samples=218 iops : min= 1, max= 29, avg=12.82, stdev= 5.03, samples=218 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6296KiB/110811msec); 0 zone resets clat (usec): min=754, max=488230, avg=32128.28, stdev=33166.34 lat (usec): min=755, max=488232, avg=32134.14, stdev=33165.69 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 3916], | 30.00th=[ 8029], 40.00th=[ 17433], 50.00th=[ 24511], 60.00th=[ 31327], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[152044], 99.90th=[263193], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 136, per=25.79%, avg=56.48, stdev=23.76, samples=218 iops : min= 1, max= 34, avg=13.50, stdev= 5.99, samples=218 lat (usec) : 50=0.07%, 100=1.73%, 250=0.23%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.66%, 4=4.69%, 10=6.28%, 20=12.99%, 50=43.42% lat (msec) : 100=21.65%, 250=3.06%, 500=0.10% cpu : usr=0.10%, sys=5.90%, ctx=6737, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178085: Wed Sep 9 02:25:01 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5940KiB/109797msec) clat (usec): min=43, max=241434, avg=40426.63, stdev=25574.31 lat (usec): min=43, max=241434, avg=40428.03, stdev=25574.38 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10552], 10.00th=[ 16057], 20.00th=[ 21890], | 30.00th=[ 25822], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 84411], | 99.00th=[137364], 99.50th=[154141], 99.90th=[204473], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 104, per=25.86%, avg=54.05, stdev=19.58, samples=215 iops : min= 1, max= 26, avg=12.88, stdev= 4.95, samples=215 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6348KiB/109797msec); 0 zone resets clat (usec): min=793, max=514595, avg=30971.52, stdev=33870.01 lat (usec): min=794, max=514596, avg=30977.71, stdev=33866.75 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1680], 20.00th=[ 3621], | 30.00th=[ 6587], 40.00th=[ 14746], 50.00th=[ 21890], 60.00th=[ 30016], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[158335], 99.90th=[299893], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 174, per=26.17%, avg=57.32, stdev=23.57, samples=217 iops : min= 1, max= 43, avg=13.71, stdev= 5.94, samples=217 lat (usec) : 50=0.03%, 100=1.73%, 250=0.16%, 750=0.03%, 1000=0.29% lat (msec) : 2=6.02%, 4=5.01%, 10=7.16%, 20=11.33%, 50=44.04% lat (msec) : 100=21.39%, 250=2.73%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.92%, ctx=6551, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178086: Wed Sep 9 02:25:01 2026 read: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6028KiB/114519msec) clat (usec): min=39, max=198777, avg=41516.07, stdev=26064.70 lat (usec): min=39, max=198778, avg=41518.59, stdev=26065.22 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 10159], 10.00th=[ 15926], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[128451], 99.50th=[149947], 99.90th=[181404], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 15, max= 103, per=25.12%, avg=52.49, stdev=17.51, samples=224 iops : min= 3, max= 25, avg=12.50, stdev= 4.43, samples=224 write: IOPS=13, BW=54.7KiB/s (55.0kB/s)(6260KiB/114519msec); 0 zone resets clat (usec): min=864, max=558544, avg=32821.66, stdev=34719.06 lat (usec): min=866, max=558549, avg=32825.40, stdev=34719.05 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 3818], | 30.00th=[ 8094], 40.00th=[ 16057], 50.00th=[ 24249], 60.00th=[ 31589], | 70.00th=[ 42206], 80.00th=[ 55837], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[162530], 99.90th=[206570], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 15, max= 111, per=25.08%, avg=54.93, stdev=22.00, samples=222 iops : min= 3, max= 27, avg=13.10, stdev= 5.56, samples=222 lat (usec) : 50=0.10%, 100=1.63%, 250=0.33%, 1000=0.03% lat (msec) : 2=5.70%, 4=4.65%, 10=6.48%, 20=12.24%, 50=42.19% lat (msec) : 100=22.88%, 250=3.74%, 750=0.03% cpu : usr=0.09%, sys=5.71%, ctx=6721, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178087: Wed Sep 9 02:25:01 2026 read: IOPS=13, BW=55.0KiB/s (56.3kB/s)(6052KiB/110026msec) clat (usec): min=36, max=515423, avg=40614.04, stdev=28672.03 lat (usec): min=36, max=515425, avg=40616.13, stdev=28673.26 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 8848], 10.00th=[ 15533], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[129500], 99.50th=[168821], 99.90th=[261096], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 120, per=26.17%, avg=54.70, stdev=21.66, samples=216 iops : min= 1, max= 30, avg=13.05, stdev= 5.48, samples=216 write: IOPS=14, BW=56.7KiB/s (58.0kB/s)(6236KiB/110026msec); 0 zone resets clat (usec): min=877, max=206427, avg=30761.71, stdev=30606.54 lat (usec): min=879, max=206429, avg=30763.89, stdev=30606.38 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1713], 20.00th=[ 3982], | 30.00th=[ 7242], 40.00th=[ 15139], 50.00th=[ 22676], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[128451], 99.50th=[139461], 99.90th=[198181], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 15, max= 148, per=25.67%, avg=56.21, stdev=23.45, samples=216 iops : min= 3, max= 37, avg=13.44, stdev= 5.93, samples=216 lat (usec) : 50=0.16%, 100=1.50%, 250=0.36%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.66%, 4=4.46%, 10=7.75%, 20=12.08%, 50=42.38% lat (msec) : 100=22.49%, 250=2.80%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=5.86%, ctx=6696, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.6KiB/s-55.0KiB/s (53.9kB/s-56.3kB/s), io=23.4MiB (24.6MB), run=109797-114519msec WRITE: bw=220KiB/s (225kB/s), 54.7KiB/s-57.8KiB/s (55.0kB/s-59.2kB/s), io=24.6MiB (25.7MB), run=109797-114519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178089: Wed Sep 9 02:25:41 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(5992KiB/154153msec) clat (msec): min=4, max=567, avg=41.34, stdev=36.99 lat (msec): min=4, max=567, avg=41.34, stdev=36.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 275], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 127, per=25.39%, avg=39.10, stdev=23.16, samples=298 iops : min= 1, max= 31, avg= 9.10, stdev= 5.84, samples=298 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154153msec); 0 zone resets clat (msec): min=12, max=296, avg=58.24, stdev=36.21 lat (msec): min=12, max=296, avg=58.25, stdev=36.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 69], 80.00th=[ 83], 90.00th=[ 106], 95.00th=[ 129], | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 288], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 125, per=25.09%, avg=40.65, stdev=20.99, samples=301 iops : min= 1, max= 31, avg= 9.50, stdev= 5.29, samples=301 lat (msec) : 10=1.69%, 20=14.97%, 50=46.52%, 100=27.44%, 250=9.18% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.01%, ctx=4746, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178090: Wed Sep 9 02:25:41 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5940KiB/154866msec) clat (msec): min=6, max=528, avg=40.58, stdev=36.47 lat (msec): min=6, max=528, avg=40.59, stdev=36.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 178], 99.50th=[ 197], 99.90th=[ 275], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 141, per=24.75%, avg=38.12, stdev=22.87, samples=303 iops : min= 1, max= 35, avg= 8.86, stdev= 5.76, samples=303 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6348KiB/154866msec); 0 zone resets clat (msec): min=11, max=379, avg=59.31, stdev=37.04 lat (msec): min=11, max=379, avg=59.31, stdev=37.04 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 176], 99.50th=[ 211], 99.90th=[ 313], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 118, per=25.04%, avg=40.56, stdev=20.39, samples=305 iops : min= 1, max= 29, avg= 9.47, stdev= 5.13, samples=305 lat (msec) : 10=1.63%, 20=14.32%, 50=47.40%, 100=26.63%, 250=9.77% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.06%, sys=2.07%, ctx=4818, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178091: Wed Sep 9 02:25:41 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6028KiB/155096msec) clat (msec): min=6, max=257, avg=40.28, stdev=33.06 lat (msec): min=6, max=257, avg=40.28, stdev=33.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 169], 99.50th=[ 184], 99.90th=[ 226], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 135, per=25.24%, avg=38.88, stdev=23.15, samples=301 iops : min= 1, max= 33, avg= 9.05, stdev= 5.85, samples=301 write: IOPS=10, BW=40.4KiB/s (41.3kB/s)(6260KiB/155096msec); 0 zone resets clat (msec): min=11, max=546, avg=60.02, stdev=40.99 lat (msec): min=11, max=546, avg=60.03, stdev=40.99 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 111, per=24.65%, avg=39.93, stdev=21.77, samples=304 iops : min= 1, max= 27, avg= 9.31, stdev= 5.48, samples=304 lat (msec) : 10=1.56%, 20=14.71%, 50=46.78%, 100=26.60%, 250=10.16% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=1.98%, ctx=4793, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178092: Wed Sep 9 02:25:41 2026 read: IOPS=9, BW=39.0KiB/s (39.0kB/s)(6052KiB/155033msec) clat (msec): min=4, max=267, avg=40.53, stdev=33.58 lat (msec): min=4, max=267, avg=40.53, stdev=33.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 85], 95.00th=[ 117], | 99.00th=[ 165], 99.50th=[ 192], 99.90th=[ 262], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 127, per=25.64%, avg=39.48, stdev=23.39, samples=298 iops : min= 1, max= 31, avg= 9.20, stdev= 5.89, samples=298 write: IOPS=10, BW=40.2KiB/s (41.2kB/s)(6236KiB/155033msec); 0 zone resets clat (msec): min=10, max=494, avg=59.77, stdev=38.71 lat (msec): min=10, max=495, avg=59.77, stdev=38.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 108], 95.00th=[ 132], | 99.00th=[ 199], 99.50th=[ 245], 99.90th=[ 300], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 118, per=24.60%, avg=39.86, stdev=20.53, samples=304 iops : min= 1, max= 29, avg= 9.30, stdev= 5.17, samples=304 lat (msec) : 10=1.69%, 20=14.94%, 50=45.87%, 100=28.03%, 250=9.24% lat (msec) : 500=0.23% cpu : usr=0.07%, sys=2.03%, ctx=4818, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.4KiB/s-39.0KiB/s (39.3kB/s-39.0kB/s), io=23.4MiB (24.6MB), run=154153-155096msec WRITE: bw=162KiB/s (166kB/s), 40.2KiB/s-40.0KiB/s (41.2kB/s-41.0kB/s), io=24.6MiB (25.7MB), run=154153-155096msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178136: Wed Sep 9 02:26:21 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5920KiB/29335msec) clat (usec): min=41, max=164552, avg=41511.40, stdev=26433.37 lat (usec): min=41, max=164554, avg=41513.03, stdev=26433.03 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 13698], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[129500], 99.50th=[149947], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 381, per=24.76%, avg=200.84, stdev=73.49, samples=57 iops : min= 3, max= 23, avg=11.79, stdev= 4.69, samples=57 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29335msec); 0 zone resets clat (usec): min=1552, max=204906, avg=34777.21, stdev=33158.44 lat (usec): min=1555, max=204908, avg=34779.62, stdev=33158.46 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1958], 10.00th=[ 3195], 20.00th=[ 5735], | 30.00th=[ 10945], 40.00th=[ 20317], 50.00th=[ 25822], 60.00th=[ 32900], | 70.00th=[ 41157], 80.00th=[ 57410], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[156238], 99.50th=[183501], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 32, max= 473, per=25.57%, avg=218.11, stdev=84.41, samples=57 iops : min= 2, max= 29, avg=12.86, stdev= 5.29, samples=57 lat (usec) : 50=0.13%, 100=3.12%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.86%, 4=3.91%, 10=7.16%, 20=10.03%, 50=43.75% lat (msec) : 100=23.96%, 250=4.17% cpu : usr=0.06%, sys=6.43%, ctx=1774, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178137: Wed Sep 9 02:26:21 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(5744KiB/29509msec) clat (usec): min=44, max=203445, avg=42008.64, stdev=26403.92 lat (usec): min=44, max=203446, avg=42012.18, stdev=26405.43 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 120], 10.00th=[ 15795], 20.00th=[ 23200], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 43779], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[139461], 99.50th=[145753], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 22, max= 382, per=24.05%, avg=195.03, stdev=77.33, samples=58 iops : min= 1, max= 23, avg=11.43, stdev= 4.87, samples=58 write: IOPS=13, BW=222KiB/s (227kB/s)(6544KiB/29509msec); 0 zone resets clat (usec): min=1224, max=174513, avg=34530.69, stdev=32671.30 lat (usec): min=1226, max=174515, avg=34534.50, stdev=32671.01 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2180], 10.00th=[ 3589], 20.00th=[ 6128], | 30.00th=[ 11600], 40.00th=[ 19268], 50.00th=[ 25035], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[137364], 99.50th=[160433], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 512, per=26.02%, avg=221.91, stdev=92.64, samples=58 iops : min= 3, max= 32, avg=13.12, stdev= 5.88, samples=58 lat (usec) : 50=0.13%, 100=2.08%, 250=0.26%, 500=0.13% lat (msec) : 2=2.47%, 4=4.30%, 10=8.98%, 20=11.07%, 50=43.88% lat (msec) : 100=22.27%, 250=4.43% cpu : usr=0.08%, sys=6.21%, ctx=1822, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178138: Wed Sep 9 02:26:21 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6256KiB/28665msec) clat (usec): min=39, max=222117, avg=40565.36, stdev=26361.52 lat (usec): min=40, max=222119, avg=40566.63, stdev=26361.55 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 72], 10.00th=[ 15401], 20.00th=[ 22938], | 30.00th=[ 27919], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[141558], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 414, per=27.09%, avg=219.73, stdev=80.83, samples=56 iops : min= 3, max= 25, avg=12.96, stdev= 5.10, samples=56 write: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28665msec); 0 zone resets clat (usec): min=1540, max=148514, avg=33152.69, stdev=28823.96 lat (usec): min=1543, max=148515, avg=33158.57, stdev=28828.66 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 3654], 20.00th=[ 7177], | 30.00th=[ 12780], 40.00th=[ 19792], 50.00th=[ 25035], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[135267], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 91, max= 346, per=24.47%, avg=208.75, stdev=62.06, samples=56 iops : min= 5, max= 21, avg=12.29, stdev= 3.89, samples=56 lat (usec) : 50=0.39%, 100=3.52%, 250=0.13%, 500=0.26% lat (msec) : 2=2.21%, 4=2.86%, 10=7.55%, 20=10.81%, 50=45.83% lat (msec) : 100=23.18%, 250=3.26% cpu : usr=0.07%, sys=6.46%, ctx=1732, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178139: Wed Sep 9 02:26:21 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27903msec) clat (usec): min=46, max=188983, avg=40792.59, stdev=27325.85 lat (usec): min=46, max=188984, avg=40794.10, stdev=27325.95 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 76], 10.00th=[ 13435], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[139461], 99.50th=[160433], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 414, per=26.51%, avg=215.02, stdev=81.28, samples=54 iops : min= 3, max= 25, avg=12.69, stdev= 5.17, samples=54 write: IOPS=14, BW=224KiB/s (230kB/s)(6256KiB/27903msec); 0 zone resets clat (usec): min=1252, max=170055, avg=31213.10, stdev=30202.34 lat (usec): min=1254, max=170057, avg=31217.06, stdev=30203.19 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2147], 10.00th=[ 2900], 20.00th=[ 5932], | 30.00th=[ 8979], 40.00th=[ 16057], 50.00th=[ 22414], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[164627], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 91, max= 509, per=26.23%, avg=223.72, stdev=80.87, samples=54 iops : min= 5, max= 31, avg=13.22, stdev= 5.07, samples=54 lat (usec) : 50=0.13%, 100=4.04%, 250=0.26%, 500=0.13% lat (msec) : 2=2.21%, 4=4.56%, 10=9.90%, 20=10.81%, 50=42.58% lat (msec) : 100=22.14%, 250=3.26% cpu : usr=0.08%, sys=6.12%, ctx=1780, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=812KiB/s (831kB/s), 195KiB/s-218KiB/s (199kB/s-223kB/s), io=23.4MiB (24.5MB), run=27903-29509msec WRITE: bw=854KiB/s (874kB/s), 210KiB/s-224KiB/s (215kB/s-230kB/s), io=24.6MiB (25.8MB), run=27903-29509msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178132: Wed Sep 9 02:26:30 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5920KiB/38703msec) clat (msec): min=7, max=173, avg=41.42, stdev=33.22 lat (msec): min=7, max=173, avg=41.42, stdev=33.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 118], | 99.00th=[ 165], 99.50th=[ 169], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 510, per=24.71%, avg=151.72, stdev=91.33, samples=76 iops : min= 1, max= 31, avg= 8.66, stdev= 5.75, samples=76 write: IOPS=10, BW=165KiB/s (168kB/s)(6368KiB/38703msec); 0 zone resets clat (msec): min=15, max=257, avg=58.01, stdev=36.27 lat (msec): min=15, max=257, avg=58.01, stdev=36.27 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 384, per=25.74%, avg=166.28, stdev=85.43, samples=75 iops : min= 1, max= 24, avg= 9.57, stdev= 5.41, samples=75 lat (msec) : 10=1.04%, 20=12.63%, 50=48.31%, 100=27.86%, 250=10.03% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=1.98%, ctx=1176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178133: Wed Sep 9 02:26:30 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5744KiB/38990msec) clat (msec): min=6, max=226, avg=41.22, stdev=36.21 lat (msec): min=6, max=226, avg=41.23, stdev=36.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 120], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 22, max= 447, per=24.50%, avg=150.42, stdev=95.70, samples=74 iops : min= 1, max= 27, avg= 8.57, stdev= 6.03, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/38990msec); 0 zone resets clat (msec): min=14, max=223, avg=58.67, stdev=37.75 lat (msec): min=14, max=223, avg=58.68, stdev=37.75 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 138], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 416, per=25.58%, avg=165.26, stdev=88.42, samples=76 iops : min= 1, max= 26, avg= 9.50, stdev= 5.59, samples=76 lat (msec) : 10=0.91%, 20=14.19%, 50=49.61%, 100=24.22%, 250=11.07% cpu : usr=0.06%, sys=1.99%, ctx=1171, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178134: Wed Sep 9 02:26:30 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38378msec) clat (msec): min=5, max=191, avg=41.79, stdev=33.45 lat (msec): min=5, max=191, avg=41.79, stdev=33.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 161], 99.50th=[ 176], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 510, per=26.74%, avg=164.17, stdev=103.10, samples=75 iops : min= 1, max= 31, avg= 9.43, stdev= 6.50, samples=75 write: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38378msec); 0 zone resets clat (msec): min=12, max=247, avg=57.84, stdev=33.72 lat (msec): min=12, max=247, avg=57.85, stdev=33.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 106], 95.00th=[ 121], | 99.00th=[ 167], 99.50th=[ 169], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 415, per=24.47%, avg=158.11, stdev=81.43, samples=74 iops : min= 1, max= 25, avg= 9.04, stdev= 5.14, samples=74 lat (msec) : 10=1.04%, 20=13.80%, 50=49.22%, 100=25.00%, 250=10.94% cpu : usr=0.07%, sys=2.02%, ctx=1171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178135: Wed Sep 9 02:26:30 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38619msec) clat (msec): min=9, max=217, avg=41.71, stdev=34.41 lat (msec): min=9, max=217, avg=41.71, stdev=34.41 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 95], 95.00th=[ 117], | 99.00th=[ 165], 99.50th=[ 207], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 448, per=25.21%, avg=154.80, stdev=90.50, samples=76 iops : min= 1, max= 28, avg= 8.84, stdev= 5.76, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38619msec); 0 zone resets clat (msec): min=9, max=203, avg=58.39, stdev=36.70 lat (msec): min=9, max=203, avg=58.40, stdev=36.70 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 112], 95.00th=[ 129], | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 574, per=25.13%, avg=162.36, stdev=91.61, samples=76 iops : min= 1, max= 35, avg= 9.32, stdev= 5.79, samples=76 lat (msec) : 10=0.52%, 20=15.49%, 50=47.79%, 100=25.13%, 250=11.07% cpu : usr=0.05%, sys=2.04%, ctx=1176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=614KiB/s (629kB/s), 147KiB/s-163KiB/s (151kB/s-167kB/s), io=23.4MiB (24.5MB), run=38378-38990msec WRITE: bw=646KiB/s (662kB/s), 157KiB/s-168KiB/s (161kB/s-172kB/s), io=24.6MiB (25.8MB), run=38378-38990msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178153: Wed Sep 9 02:26:50 2026 read: IOPS=1, BW=1026KiB/s (1051kB/s)(7168KiB/6985msec) clat (msec): min=2, max=4102, avg=722.27, stdev=1493.23 lat (msec): min=2, max=4102, avg=722.27, stdev=1493.23 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 105], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 161], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 271], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 1627, max= 4079, per=80.66%, avg=2358.40, stdev=977.60, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=733KiB/s (751kB/s)(5120KiB/6985msec); 0 zone resets clat (msec): min=71, max=697, avg=324.81, stdev=239.87 lat (msec): min=71, max=697, avg=325.03, stdev=239.92 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2000, max= 4087, per=66.15%, avg=2707.33, stdev=1194.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.18%, ctx=349, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178155: Wed Sep 9 02:26:50 2026 read: IOPS=0, BW=292KiB/s (299kB/s)(2048KiB/7004msec) clat (msec): min=173, max=311, avg=242.38, stdev=97.35 lat (msec): min=173, max=311, avg=242.38, stdev=97.35 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1648, max= 2043, per=63.12%, avg=1845.50, stdev=279.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1462KiB/s (1497kB/s)(10.0MiB/7004msec); 0 zone resets clat (msec): min=92, max=2929, avg=638.42, stdev=832.49 lat (msec): min=92, max=2929, avg=638.54, stdev=832.49 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 247], | 30.00th=[ 275], 40.00th=[ 296], 50.00th=[ 305], 60.00th=[ 326], | 70.00th=[ 414], 80.00th=[ 693], 90.00th=[ 810], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2043, max= 4079, per=72.29%, avg=2958.67, stdev=1009.93, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=10.20%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178157: Wed Sep 9 02:26:50 2026 read: IOPS=1, BW=1068KiB/s (1094kB/s)(6144KiB/5752msec) clat (msec): min=154, max=372, avg=243.01, stdev=81.43 lat (msec): min=154, max=372, avg=243.01, stdev=81.43 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 264], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 3716, max= 3828, per=100.00%, avg=3772.00, stdev=79.20, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1068KiB/s (1094kB/s)(6144KiB/5752msec); 0 zone resets clat (msec): min=208, max=2628, avg=708.49, stdev=958.61 lat (msec): min=208, max=2628, avg=708.60, stdev=958.61 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 249], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1858, max= 3145, per=55.18%, avg=2258.50, stdev=595.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.04%, ctx=237, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178159: Wed Sep 9 02:26:50 2026 read: IOPS=0, BW=759KiB/s (777kB/s)(5120KiB/6749msec) clat (usec): min=708, max=304043, avg=153379.30, stdev=133208.62 lat (usec): min=710, max=304045, avg=153381.06, stdev=133208.77 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 38011], 40.00th=[ 38011], 50.00th=[164627], 60.00th=[164627], | 70.00th=[261096], 80.00th=[261096], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2043, max= 6119, per=100.00%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1062KiB/s (1088kB/s)(7168KiB/6749msec); 0 zone resets clat (msec): min=145, max=2717, avg=817.77, stdev=879.92 lat (msec): min=146, max=2717, avg=817.89, stdev=879.87 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 262], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 617], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 844], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1914, max= 2043, per=49.19%, avg=2013.20, stdev=55.70, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=9.13%, ctx=147, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2924KiB/s (2994kB/s), 292KiB/s-1068KiB/s (299kB/s-1094kB/s), io=20.0MiB (20.0MB), run=5752-7004msec WRITE: bw=4094KiB/s (4192kB/s), 733KiB/s-1462KiB/s (751kB/s-1497kB/s), io=28.0MiB (29.4MB), run=5752-7004msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178152: Wed Sep 9 02:26:51 2026 read: IOPS=2, BW=2357KiB/s (2414kB/s)(7168KiB/3041msec) clat (msec): min=83, max=305, avg=158.56, stdev=83.20 lat (msec): min=83, max=305, avg=158.56, stdev=83.20 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 111], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 114], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 247], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1957, max= 4345, per=100.00%, avg=3457.67, stdev=1306.82, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1684KiB/s (1724kB/s)(5120KiB/3041msec); 0 zone resets clat (msec): min=107, max=543, avg=375.48, stdev=181.71 lat (msec): min=108, max=543, avg=375.58, stdev=181.70 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1957, max= 3915, per=65.82%, avg=2476.75, stdev=959.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=6.28%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178154: Wed Sep 9 02:26:51 2026 read: IOPS=0, BW=271KiB/s (278kB/s)(2048KiB/7549msec) clat (msec): min=96, max=564, avg=330.10, stdev=330.91 lat (msec): min=96, max=564, avg=330.10, stdev=330.92 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2035, max= 2048, per=75.95%, avg=2041.50, stdev= 9.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1356KiB/s (1389kB/s)(10.0MiB/7549msec); 0 zone resets clat (msec): min=139, max=2685, avg=660.76, stdev=743.90 lat (msec): min=139, max=2685, avg=660.94, stdev=743.87 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 205], | 30.00th=[ 247], 40.00th=[ 338], 50.00th=[ 414], 60.00th=[ 426], | 70.00th=[ 701], 80.00th=[ 726], 90.00th=[ 735], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2000, max= 6144, per=80.34%, avg=3023.33, stdev=1706.41, samples=6 iops : min= 1, max= 6, avg= 2.17, stdev= 2.04, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.90%, ctx=144, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178156: Wed Sep 9 02:26:51 2026 read: IOPS=0, BW=806KiB/s (826kB/s)(6144KiB/7619msec) clat (msec): min=123, max=586, avg=316.38, stdev=157.01 lat (msec): min=123, max=586, avg=316.38, stdev=157.01 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 305], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1957, max= 4055, per=93.77%, avg=2520.50, stdev=1023.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=806KiB/s (826kB/s)(6144KiB/7619msec); 0 zone resets clat (msec): min=102, max=3064, avg=935.46, stdev=1102.62 lat (msec): min=103, max=3064, avg=936.12, stdev=1102.51 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 735], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1957, max= 2043, per=53.60%, avg=2016.83, stdev=33.08, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.75%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178158: Wed Sep 9 02:26:51 2026 read: IOPS=0, BW=823KiB/s (843kB/s)(5120KiB/6221msec) clat (msec): min=100, max=306, avg=171.65, stdev=81.40 lat (msec): min=100, max=306, avg=171.66, stdev=81.40 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1957, max= 5873, per=100.00%, avg=3915.00, stdev=2769.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1152KiB/s (1180kB/s)(7168KiB/6221msec); 0 zone resets clat (msec): min=115, max=3193, avg=726.96, stdev=1113.13 lat (msec): min=115, max=3193, avg=727.10, stdev=1113.19 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 121], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 236], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 676], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2000, max= 3915, per=70.42%, avg=2650.00, stdev=1095.66, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=2.75%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2688KiB/s (2753kB/s), 271KiB/s-2357KiB/s (278kB/s-2414kB/s), io=20.0MiB (20.0MB), run=3041-7619msec WRITE: bw=3763KiB/s (3854kB/s), 806KiB/s-1684KiB/s (826kB/s-1724kB/s), io=28.0MiB (29.4MB), run=3041-7619msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178167: Wed Sep 9 02:27:11 2026 read: IOPS=0, BW=2483KiB/s (2543kB/s)(12.0MiB/4948msec) clat (msec): min=631, max=2660, avg=1590.30, stdev=1018.82 lat (msec): min=631, max=2660, avg=1590.30, stdev=1018.82 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.43%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178168: Wed Sep 9 02:27:11 2026 read: IOPS=0, BW=751KiB/s (769kB/s)(4096KiB/5457msec) clat (nsec): min=1043.7M, max=1043.7M, avg=1043742818.00, stdev= 0.00 lat (nsec): min=1043.7M, max=1043.7M, avg=1043745998.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1501KiB/s (1537kB/s)(8192KiB/5457msec); 0 zone resets clat (msec): min=1104, max=3204, avg=2154.37, stdev=1484.99 lat (msec): min=1104, max=3205, avg=2154.83, stdev=1485.32 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 3205], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=1.89%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178170: Wed Sep 9 02:27:11 2026 write: IOPS=0, BW=2283KiB/s (2338kB/s)(12.0MiB/5383msec); 0 zone resets clat (msec): min=305, max=2954, avg=1775.99, stdev=1348.32 lat (msec): min=306, max=2955, avg=1777.39, stdev=1348.50 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 2072], 50.00th=[ 2072], 60.00th=[ 2072], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.29%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178172: Wed Sep 9 02:27:11 2026 write: IOPS=0, BW=2614KiB/s (2677kB/s)(12.0MiB/4701msec); 0 zone resets clat (msec): min=505, max=3192, avg=1544.91, stdev=1443.31 lat (msec): min=507, max=3193, avg=1545.81, stdev=1442.77 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 7772, max= 8143, per=100.00%, avg=7957.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.21%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3002KiB/s (3074kB/s), 751KiB/s-2483KiB/s (769kB/s-2543kB/s), io=16.0MiB (16.8MB), run=4948-5457msec WRITE: bw=6005KiB/s (6149kB/s), 1501KiB/s-2614KiB/s (1537kB/s-2677kB/s), io=32.0MiB (33.6MB), run=4701-5457msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178169: Wed Sep 9 02:27:11 2026 read: IOPS=0, BW=2697KiB/s (2762kB/s)(12.0MiB/4556msec) clat (msec): min=826, max=2551, avg=1489.80, stdev=928.53 lat (msec): min=826, max=2551, avg=1489.80, stdev=928.53 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.35%, ctx=595, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178171: Wed Sep 9 02:27:11 2026 read: IOPS=0, BW=835KiB/s (855kB/s)(4096KiB/4906msec) clat (nsec): min=936285k, max=936285k, avg=936285060.00, stdev= 0.00 lat (nsec): min=936289k, max=936289k, avg=936288646.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1670KiB/s (1710kB/s)(8192KiB/4906msec); 0 zone resets clat (msec): min=1090, max=2820, avg=1955.61, stdev=1223.33 lat (msec): min=1090, max=2821, avg=1956.11, stdev=1223.48 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.90%, ctx=195, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178173: Wed Sep 9 02:27:11 2026 write: IOPS=0, BW=2145KiB/s (2197kB/s)(12.0MiB/5728msec); 0 zone resets clat (msec): min=255, max=4171, avg=1899.75, stdev=2031.75 lat (msec): min=256, max=4171, avg=1900.60, stdev=2031.57 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.76%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178174: Wed Sep 9 02:27:11 2026 write: IOPS=0, BW=2535KiB/s (2596kB/s)(12.0MiB/4847msec); 0 zone resets clat (msec): min=643, max=2829, avg=1598.54, stdev=1118.73 lat (msec): min=652, max=2829, avg=1601.97, stdev=1114.93 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8047, max= 8078, per=100.00%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.08%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3340KiB/s (3420kB/s), 835KiB/s-2697KiB/s (855kB/s-2762kB/s), io=16.0MiB (16.8MB), run=4556-4906msec WRITE: bw=5721KiB/s (5858kB/s), 1670KiB/s-2535KiB/s (1710kB/s-2596kB/s), io=32.0MiB (33.6MB), run=4847-5728msec