== sanity test 398b: DIO and buffer IO race ============== 02:04:05 (1789020245) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.82016 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146814: Thu Sep 10 02:06:25 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(5992KiB/122777msec) clat (usec): min=36, max=533931, avg=41159.77, stdev=30707.82 lat (usec): min=36, max=533932, avg=41163.10, stdev=30707.54 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 13173], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[133694], 99.50th=[160433], 99.90th=[333448], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 127, per=25.23%, avg=48.69, stdev=19.10, samples=240 iops : min= 1, max= 31, avg=11.52, stdev= 4.80, samples=240 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6296KiB/122777msec); 0 zone resets clat (usec): min=919, max=801139, avg=38718.68, stdev=42193.07 lat (usec): min=921, max=801141, avg=38721.80, stdev=42192.91 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 2147], 20.00th=[ 4817], | 30.00th=[ 8979], 40.00th=[ 19530], 50.00th=[ 28967], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[162530], 99.50th=[179307], 99.90th=[283116], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 157, per=25.10%, avg=50.96, stdev=21.11, samples=241 iops : min= 1, max= 39, avg=12.10, stdev= 5.30, samples=241 lat (usec) : 50=0.23%, 100=2.86%, 250=0.36%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=4.82%, 4=4.07%, 10=7.52%, 20=9.83%, 50=40.10% lat (msec) : 100=24.45%, 250=5.21%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.57%, ctx=6713, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146815: Thu Sep 10 02:06:25 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(5940KiB/122923msec) clat (usec): min=28, max=496701, avg=41278.79, stdev=31391.19 lat (usec): min=28, max=496701, avg=41286.34, stdev=31389.21 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 13435], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[173016], 99.90th=[295699], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 141, per=24.98%, avg=48.22, stdev=21.04, samples=240 iops : min= 1, max= 35, avg=11.40, stdev= 5.28, samples=240 write: IOPS=12, BW=51.6KiB/s (52.9kB/s)(6348KiB/122923msec); 0 zone resets clat (usec): min=1041, max=710501, avg=38721.96, stdev=43346.65 lat (usec): min=1043, max=710502, avg=38724.11, stdev=43346.96 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1926], 20.00th=[ 4621], | 30.00th=[ 9110], 40.00th=[ 18220], 50.00th=[ 28705], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[177210], 99.50th=[214959], 99.90th=[387974], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 127, per=25.26%, avg=51.27, stdev=23.80, samples=241 iops : min= 1, max= 31, avg=12.17, stdev= 5.96, samples=241 lat (usec) : 50=0.20%, 100=3.03%, 250=0.42%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.34%, 4=4.23%, 10=7.13%, 20=10.32%, 50=39.10% lat (msec) : 100=24.54%, 250=5.37%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.80%, ctx=6762, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146816: Thu Sep 10 02:06:25 2026 read: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6028KiB/123831msec) clat (usec): min=36, max=501005, avg=39950.25, stdev=31288.22 lat (usec): min=36, max=501006, avg=39952.23, stdev=31288.06 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 9372], 20.00th=[ 19268], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[133694], 99.50th=[160433], 99.90th=[235930], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 115, per=25.10%, avg=48.44, stdev=21.07, samples=242 iops : min= 1, max= 28, avg=11.45, stdev= 5.28, samples=242 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6260KiB/123831msec); 0 zone resets clat (usec): min=1033, max=716883, avg=40487.24, stdev=44239.35 lat (usec): min=1034, max=716885, avg=40490.81, stdev=44240.16 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 2057], 20.00th=[ 4883], | 30.00th=[ 9896], 40.00th=[ 20317], 50.00th=[ 30802], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[119014], | 99.00th=[173016], 99.50th=[191890], 99.90th=[438305], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 111, per=24.71%, avg=50.16, stdev=20.29, samples=242 iops : min= 1, max= 27, avg=11.90, stdev= 5.11, samples=242 lat (usec) : 50=0.29%, 100=3.68%, 250=0.46%, 500=0.10% lat (msec) : 2=5.08%, 4=3.58%, 10=7.16%, 20=10.58%, 50=39.78% lat (msec) : 100=22.82%, 250=6.32%, 500=0.10%, 750=0.07% cpu : usr=0.10%, sys=5.56%, ctx=6820, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146817: Thu Sep 10 02:06:25 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6052KiB/121954msec) clat (usec): min=37, max=293284, avg=39024.04, stdev=28565.92 lat (usec): min=37, max=293286, avg=39026.86, stdev=28566.18 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 9503], 20.00th=[ 19268], | 30.00th=[ 23987], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[164627], 99.90th=[256902], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 15, max= 119, per=25.88%, avg=49.94, stdev=20.34, samples=237 iops : min= 3, max= 29, avg=11.83, stdev= 5.12, samples=237 write: IOPS=12, BW=51.1KiB/s (52.4kB/s)(6236KiB/121954msec); 0 zone resets clat (usec): min=998, max=770500, avg=40244.90, stdev=43819.68 lat (usec): min=999, max=770503, avg=40249.07, stdev=43818.01 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1844], 20.00th=[ 4424], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 30278], 60.00th=[ 41681], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[168821], 99.50th=[189793], 99.90th=[358613], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=51.03, stdev=21.22, samples=239 iops : min= 1, max= 29, avg=12.11, stdev= 5.34, samples=239 lat (usec) : 50=0.33%, 100=3.52%, 250=0.33%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.63%, 4=4.00%, 10=6.80%, 20=10.90%, 50=38.64% lat (msec) : 100=23.70%, 250=5.60%, 500=0.13%, 1000=0.03% cpu : usr=0.10%, sys=5.58%, ctx=6749, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=194KiB/s (199kB/s), 48.3KiB/s-49.6KiB/s (49.5kB/s-50.8kB/s), io=23.4MiB (24.6MB), run=121954-123831msec WRITE: bw=203KiB/s (208kB/s), 50.6KiB/s-51.6KiB/s (51.8kB/s-52.9kB/s), io=24.6MiB (25.7MB), run=121954-123831msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146809: Thu Sep 10 02:08:53 2026 read: IOPS=5, BW=22.1KiB/s (22.7kB/s)(5992KiB/270741msec) clat (msec): min=4, max=661, avg=37.82, stdev=36.82 lat (msec): min=4, max=661, avg=37.82, stdev=36.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 75], 95.00th=[ 96], | 99.00th=[ 184], 99.50th=[ 218], 99.90th=[ 313], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 93, per=27.93%, avg=24.58, stdev=16.26, samples=470 iops : min= 1, max= 23, avg= 5.52, stdev= 4.12, samples=470 write: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6296KiB/270741msec); 0 zone resets clat (msec): min=33, max=544, avg=135.82, stdev=60.28 lat (msec): min=33, max=544, avg=135.82, stdev=60.28 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 251], | 99.00th=[ 347], 99.50th=[ 384], 99.90th=[ 477], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 56, per=25.13%, avg=23.12, stdev= 9.51, samples=524 iops : min= 1, max= 14, avg= 5.15, stdev= 2.44, samples=524 lat (msec) : 10=3.06%, 20=13.93%, 50=21.16%, 100=24.61%, 250=34.47% lat (msec) : 500=2.70%, 750=0.07% cpu : usr=0.04%, sys=1.30%, ctx=5378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146810: Thu Sep 10 02:08:53 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5940KiB/272257msec) clat (msec): min=5, max=553, avg=36.80, stdev=33.75 lat (msec): min=5, max=553, avg=36.80, stdev=33.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 155], 99.50th=[ 213], 99.90th=[ 236], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 88, per=28.20%, avg=24.81, stdev=16.35, samples=462 iops : min= 1, max= 22, avg= 5.57, stdev= 4.13, samples=462 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6348KiB/272257msec); 0 zone resets clat (msec): min=33, max=928, avg=136.89, stdev=63.10 lat (msec): min=33, max=928, avg=136.90, stdev=63.10 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 334], 99.50th=[ 372], 99.90th=[ 558], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 55, per=24.92%, avg=22.92, stdev= 9.64, samples=533 iops : min= 1, max= 13, avg= 5.10, stdev= 2.46, samples=533 lat (msec) : 10=3.78%, 20=13.05%, 50=21.81%, 100=22.95%, 250=35.68% lat (msec) : 500=2.64%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5479, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146811: Thu Sep 10 02:08:53 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270774msec) clat (msec): min=5, max=315, avg=38.89, stdev=32.97 lat (msec): min=5, max=315, avg=38.89, stdev=32.97 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 103], | 99.00th=[ 167], 99.50th=[ 205], 99.90th=[ 245], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 104, per=27.13%, avg=23.87, stdev=16.08, samples=487 iops : min= 1, max= 26, avg= 5.34, stdev= 4.05, samples=487 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6260KiB/270774msec); 0 zone resets clat (msec): min=39, max=622, avg=135.36, stdev=61.43 lat (msec): min=39, max=622, avg=135.36, stdev=61.43 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 342], 99.50th=[ 376], 99.90th=[ 575], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 56, per=24.58%, avg=22.61, stdev=10.02, samples=532 iops : min= 1, max= 14, avg= 5.02, stdev= 2.57, samples=532 lat (msec) : 10=3.16%, 20=12.43%, 50=22.30%, 100=24.51%, 250=35.03% lat (msec) : 500=2.51%, 750=0.07% cpu : usr=0.04%, sys=1.31%, ctx=5348, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146812: Thu Sep 10 02:08:53 2026 read: IOPS=5, BW=22.7KiB/s (23.3kB/s)(6052KiB/266185msec) clat (msec): min=5, max=315, avg=37.15, stdev=33.27 lat (msec): min=5, max=315, avg=37.16, stdev=33.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 107], | 99.00th=[ 159], 99.50th=[ 213], 99.90th=[ 253], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 103, per=28.84%, avg=25.38, stdev=17.04, samples=461 iops : min= 1, max= 25, avg= 5.72, stdev= 4.29, samples=461 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6236KiB/266185msec); 0 zone resets clat (msec): min=33, max=939, avg=134.46, stdev=65.56 lat (msec): min=33, max=939, avg=134.47, stdev=65.56 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 330], 99.50th=[ 388], 99.90th=[ 625], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=23.06, stdev=10.01, samples=521 iops : min= 1, max= 14, avg= 5.13, stdev= 2.57, samples=521 lat (msec) : 10=3.42%, 20=13.51%, 50=22.59%, 100=23.83%, 250=33.95% lat (msec) : 500=2.57%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.31%, ctx=5434, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.2KiB/s (90.3kB/s), 21.8KiB/s-22.7KiB/s (22.3kB/s-23.3kB/s), io=23.4MiB (24.6MB), run=266185-272257msec WRITE: bw=92.3KiB/s (94.6kB/s), 23.1KiB/s-23.4KiB/s (23.7kB/s-23.0kB/s), io=24.6MiB (25.7MB), run=266185-272257msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146872: Thu Sep 10 02:09:40 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5920KiB/37534msec) clat (usec): min=35, max=246401, avg=46765.66, stdev=43260.77 lat (usec): min=35, max=246401, avg=46774.07, stdev=43259.71 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 88], | 30.00th=[ 21365], 40.00th=[ 31851], 50.00th=[ 40633], 60.00th=[ 50594], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[124257], | 99.00th=[214959], 99.50th=[242222], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 443, per=25.09%, avg=159.81, stdev=80.47, samples=72 iops : min= 1, max= 27, avg= 9.19, stdev= 5.11, samples=72 write: IOPS=10, BW=170KiB/s (174kB/s)(6368KiB/37534msec); 0 zone resets clat (usec): min=1450, max=411461, avg=50453.25, stdev=57669.65 lat (usec): min=1453, max=411463, avg=50470.08, stdev=57679.73 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2008], 10.00th=[ 4293], 20.00th=[ 8160], | 30.00th=[ 13698], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 41157], | 70.00th=[ 56886], 80.00th=[ 84411], 90.00th=[128451], 95.00th=[160433], | 99.00th=[250610], 99.50th=[346031], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 31, max= 405, per=25.69%, avg=172.10, stdev=69.44, samples=72 iops : min= 1, max= 25, avg= 9.99, stdev= 4.42, samples=72 lat (usec) : 50=1.04%, 100=9.51%, 250=1.82%, 750=0.26%, 1000=0.13% lat (msec) : 2=2.73%, 4=2.60%, 10=7.03%, 20=9.38%, 50=28.91% lat (msec) : 100=23.18%, 250=12.89%, 500=0.52% cpu : usr=0.07%, sys=4.99%, ctx=1415, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146873: Thu Sep 10 02:09:40 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5744KiB/37570msec) clat (usec): min=36, max=392283, avg=50440.83, stdev=47078.21 lat (usec): min=36, max=392283, avg=50444.68, stdev=47079.56 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 86], | 30.00th=[ 25035], 40.00th=[ 36963], 50.00th=[ 45876], 60.00th=[ 55837], | 70.00th=[ 64226], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[132645], | 99.00th=[185598], 99.50th=[341836], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 29, max= 411, per=25.35%, avg=161.51, stdev=77.95, samples=69 iops : min= 1, max= 25, avg= 9.30, stdev= 4.94, samples=69 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37570msec); 0 zone resets clat (usec): min=1418, max=433624, avg=47417.42, stdev=57266.48 lat (usec): min=1421, max=433626, avg=47420.55, stdev=57266.81 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1729], 10.00th=[ 2376], 20.00th=[ 7177], | 30.00th=[ 11600], 40.00th=[ 16581], 50.00th=[ 25822], 60.00th=[ 41157], | 70.00th=[ 57410], 80.00th=[ 80217], 90.00th=[121111], 95.00th=[149947], | 99.00th=[278922], 99.50th=[316670], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 31, max= 416, per=25.97%, avg=174.03, stdev=84.17, samples=73 iops : min= 1, max= 26, avg=10.08, stdev= 5.35, samples=73 lat (usec) : 50=1.69%, 100=8.46%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=4.04%, 4=2.99%, 10=6.77%, 20=11.07%, 50=24.61% lat (msec) : 100=26.43%, 250=11.98%, 500=0.91% cpu : usr=0.08%, sys=4.99%, ctx=1399, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146874: Thu Sep 10 02:09:40 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35837msec) clat (usec): min=36, max=293715, avg=48962.82, stdev=43039.91 lat (usec): min=37, max=293717, avg=48970.57, stdev=43036.73 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 97], | 30.00th=[ 26346], 40.00th=[ 36439], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[208667], 99.50th=[252707], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 62, max= 341, per=27.53%, avg=175.34, stdev=68.55, samples=70 iops : min= 3, max= 21, avg=10.17, stdev= 4.33, samples=70 write: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35837msec); 0 zone resets clat (usec): min=1450, max=254240, avg=44017.15, stdev=47077.30 lat (usec): min=1453, max=254242, avg=44031.34, stdev=47069.80 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2180], 10.00th=[ 3621], 20.00th=[ 7046], | 30.00th=[ 11338], 40.00th=[ 16909], 50.00th=[ 28181], 60.00th=[ 40109], | 70.00th=[ 56886], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[135267], | 99.00th=[223347], 99.50th=[244319], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 30, max= 371, per=24.94%, avg=167.09, stdev=74.96, samples=70 iops : min= 1, max= 23, avg= 9.64, stdev= 4.76, samples=70 lat (usec) : 50=0.52%, 100=9.77%, 250=0.91%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.47%, 4=3.39%, 10=8.33%, 20=8.07%, 50=26.17% lat (msec) : 100=29.30%, 250=10.03%, 500=0.39% cpu : usr=0.05%, sys=4.85%, ctx=1400, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146875: Thu Sep 10 02:09:40 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36455msec) clat (usec): min=35, max=226929, avg=50588.44, stdev=43489.27 lat (usec): min=36, max=226931, avg=50592.70, stdev=43488.81 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 92], | 30.00th=[ 26608], 40.00th=[ 35914], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[109577], 95.00th=[139461], | 99.00th=[183501], 99.50th=[212861], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 443, per=25.75%, avg=164.04, stdev=69.19, samples=71 iops : min= 1, max= 27, avg= 9.44, stdev= 4.35, samples=71 write: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36455msec); 0 zone resets clat (usec): min=1381, max=299006, avg=44253.13, stdev=50249.49 lat (usec): min=1383, max=299008, avg=44263.74, stdev=50254.19 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1827], 10.00th=[ 2671], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 14615], 50.00th=[ 25822], 60.00th=[ 40109], | 70.00th=[ 54789], 80.00th=[ 74974], 90.00th=[107480], 95.00th=[145753], | 99.00th=[229639], 99.50th=[270533], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 380, per=26.01%, avg=174.29, stdev=82.14, samples=70 iops : min= 1, max= 23, avg=10.11, stdev= 5.23, samples=70 lat (usec) : 50=1.30%, 100=9.24%, 250=0.91% lat (msec) : 2=3.78%, 4=4.82%, 10=8.07%, 20=8.46%, 50=24.48% lat (msec) : 100=26.95%, 250=11.72%, 500=0.26% cpu : usr=0.08%, sys=5.34%, ctx=1434, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=638KiB/s (653kB/s), 153KiB/s-175KiB/s (157kB/s-179kB/s), io=23.4MiB (24.5MB), run=35837-37570msec WRITE: bw=671KiB/s (687kB/s), 168KiB/s-174KiB/s (172kB/s-178kB/s), io=24.6MiB (25.8MB), run=35837-37570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146867: Thu Sep 10 02:10:36 2026 read: IOPS=3, BW=63.4KiB/s (64.9kB/s)(5920KiB/93441msec) clat (msec): min=6, max=540, avg=51.21, stdev=57.20 lat (msec): min=6, max=540, avg=51.21, stdev=57.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 111], 95.00th=[ 153], | 99.00th=[ 279], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 352, per=30.77%, avg=78.15, stdev=49.80, samples=148 iops : min= 1, max= 22, avg= 4.11, stdev= 3.20, samples=148 write: IOPS=4, BW=68.1KiB/s (69.8kB/s)(6368KiB/93441msec); 0 zone resets clat (msec): min=42, max=711, avg=186.97, stdev=97.80 lat (msec): min=42, max=711, avg=186.97, stdev=97.80 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 104], | 30.00th=[ 127], 40.00th=[ 148], 50.00th=[ 167], 60.00th=[ 192], | 70.00th=[ 222], 80.00th=[ 259], 90.00th=[ 321], 95.00th=[ 388], | 99.00th=[ 472], 99.50th=[ 531], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 24, max= 190, per=25.96%, avg=69.57, stdev=37.64, samples=179 iops : min= 1, max= 11, avg= 3.58, stdev= 2.39, samples=179 lat (msec) : 10=1.04%, 20=10.42%, 50=22.27%, 100=18.49%, 250=35.81% lat (msec) : 500=11.59%, 750=0.39% cpu : usr=0.03%, sys=1.02%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146868: Thu Sep 10 02:10:36 2026 read: IOPS=3, BW=61.1KiB/s (62.6kB/s)(5744KiB/93946msec) clat (msec): min=8, max=370, avg=50.97, stdev=49.97 lat (msec): min=8, max=370, avg=50.97, stdev=49.97 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 74], 90.00th=[ 115], 95.00th=[ 150], | 99.00th=[ 236], 99.50th=[ 363], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 24, max= 285, per=32.14%, avg=81.64, stdev=51.32, samples=137 iops : min= 1, max= 17, avg= 4.33, stdev= 3.23, samples=137 write: IOPS=4, BW=69.7KiB/s (71.3kB/s)(6544KiB/93946msec); 0 zone resets clat (msec): min=46, max=471, avg=184.43, stdev=91.36 lat (msec): min=46, max=471, avg=184.43, stdev=91.36 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 103], | 30.00th=[ 126], 40.00th=[ 148], 50.00th=[ 169], 60.00th=[ 188], | 70.00th=[ 222], 80.00th=[ 259], 90.00th=[ 326], 95.00th=[ 368], | 99.00th=[ 426], 99.50th=[ 439], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 30, max= 190, per=26.21%, avg=70.23, stdev=36.14, samples=182 iops : min= 1, max= 11, avg= 3.61, stdev= 2.34, samples=182 lat (msec) : 10=0.78%, 20=10.42%, 50=20.83%, 100=18.49%, 250=37.50% lat (msec) : 500=11.98% cpu : usr=0.03%, sys=1.11%, ctx=1360, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146869: Thu Sep 10 02:10:36 2026 read: IOPS=4, BW=68.7KiB/s (70.3kB/s)(6256KiB/91109msec) clat (msec): min=6, max=476, avg=47.45, stdev=54.94 lat (msec): min=6, max=476, avg=47.45, stdev=54.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 146], | 99.00th=[ 292], 99.50th=[ 388], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 349, per=33.15%, avg=84.20, stdev=63.19, samples=146 iops : min= 1, max= 21, avg= 4.47, stdev= 4.00, samples=146 write: IOPS=4, BW=66.2KiB/s (67.8kB/s)(6032KiB/91109msec); 0 zone resets clat (msec): min=40, max=624, avg=191.99, stdev=100.23 lat (msec): min=40, max=624, avg=192.02, stdev=100.26 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 68], 10.00th=[ 88], 20.00th=[ 109], | 30.00th=[ 130], 40.00th=[ 153], 50.00th=[ 174], 60.00th=[ 197], | 70.00th=[ 224], 80.00th=[ 264], 90.00th=[ 342], 95.00th=[ 401], | 99.00th=[ 523], 99.50th=[ 584], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 30, max= 160, per=25.22%, avg=67.60, stdev=31.82, samples=173 iops : min= 1, max= 10, avg= 3.45, stdev= 2.06, samples=173 lat (msec) : 10=1.56%, 20=12.89%, 50=23.31%, 100=17.19%, 250=33.46% lat (msec) : 500=10.94%, 750=0.65% cpu : usr=0.05%, sys=1.03%, ctx=1350, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146870: Thu Sep 10 02:10:36 2026 read: IOPS=4, BW=64.3KiB/s (65.8kB/s)(6032KiB/93844msec) clat (msec): min=7, max=517, avg=52.85, stdev=64.69 lat (msec): min=7, max=517, avg=52.85, stdev=64.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 111], 95.00th=[ 174], | 99.00th=[ 397], 99.50th=[ 477], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 28, max= 256, per=30.65%, avg=77.85, stdev=56.30, samples=151 iops : min= 1, max= 16, avg= 4.09, stdev= 3.52, samples=151 write: IOPS=4, BW=66.7KiB/s (68.3kB/s)(6256KiB/93844msec); 0 zone resets clat (msec): min=34, max=718, avg=188.72, stdev=96.83 lat (msec): min=34, max=718, avg=188.72, stdev=96.83 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 83], 20.00th=[ 105], | 30.00th=[ 124], 40.00th=[ 150], 50.00th=[ 174], 60.00th=[ 203], | 70.00th=[ 230], 80.00th=[ 253], 90.00th=[ 305], 95.00th=[ 368], | 99.00th=[ 489], 99.50th=[ 535], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 28, max= 222, per=25.98%, avg=69.62, stdev=35.53, samples=176 iops : min= 1, max= 13, avg= 3.58, stdev= 2.29, samples=176 lat (msec) : 10=1.95%, 20=10.16%, 50=23.57%, 100=17.19%, 250=34.64% lat (msec) : 500=12.11%, 750=0.39% cpu : usr=0.03%, sys=0.98%, ctx=1310, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=255KiB/s (261kB/s), 61.1KiB/s-68.7KiB/s (62.6kB/s-70.3kB/s), io=23.4MiB (24.5MB), run=91109-93946msec WRITE: bw=268KiB/s (275kB/s), 66.2KiB/s-69.7KiB/s (67.8kB/s-71.3kB/s), io=24.6MiB (25.8MB), run=91109-93946msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146898: Thu Sep 10 02:10:53 2026 read: IOPS=1, BW=1712KiB/s (1753kB/s)(7168KiB/4186msec) clat (msec): min=90, max=457, avg=229.63, stdev=165.89 lat (msec): min=90, max=457, avg=229.63, stdev=165.89 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 92], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 117], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 409], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2043, max= 6000, per=100.00%, avg=4022.00, stdev=1978.50, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1223KiB/s (1252kB/s)(5120KiB/4186msec); 0 zone resets clat (msec): min=310, max=820, avg=491.02, stdev=214.37 lat (msec): min=310, max=821, avg=491.18, stdev=214.35 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2007, max= 3992, per=55.46%, avg=2678.00, stdev=1138.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=3.23%, ctx=59, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146899: Thu Sep 10 02:10:53 2026 read: IOPS=0, BW=345KiB/s (353kB/s)(2048KiB/5937msec) clat (msec): min=173, max=279, avg=226.41, stdev=75.37 lat (msec): min=173, max=279, avg=226.42, stdev=75.37 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1444, max= 2019, per=50.20%, avg=1731.50, stdev=406.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1725KiB/s (1766kB/s)(10.0MiB/5937msec); 0 zone resets clat (msec): min=182, max=1100, avg=530.28, stdev=325.85 lat (msec): min=182, max=1101, avg=530.45, stdev=325.84 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 184], | 30.00th=[ 243], 40.00th=[ 334], 50.00th=[ 498], 60.00th=[ 518], | 70.00th=[ 558], 80.00th=[ 659], 90.00th=[ 1028], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1992, max= 4000, per=52.93%, avg=2556.00, stdev=926.50, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=16.67% cpu : usr=0.02%, sys=4.09%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146900: Thu Sep 10 02:10:53 2026 read: IOPS=1, BW=1052KiB/s (1078kB/s)(6144KiB/5838msec) clat (msec): min=141, max=945, avg=327.29, stdev=307.67 lat (msec): min=141, max=945, avg=327.29, stdev=307.67 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 226], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1992, max= 4031, per=73.01%, avg=2518.25, stdev=1008.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1052KiB/s (1078kB/s)(6144KiB/5838msec); 0 zone resets clat (msec): min=260, max=882, avg=585.40, stdev=238.07 lat (msec): min=260, max=882, avg=585.53, stdev=238.06 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 693], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1910, max= 2035, per=41.37%, avg=1997.67, stdev=45.16, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=3.67%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146902: Thu Sep 10 02:10:53 2026 read: IOPS=0, BW=1000KiB/s (1024kB/s)(5120KiB/5122msec) clat (msec): min=152, max=687, avg=359.95, stdev=241.03 lat (msec): min=152, max=687, avg=359.95, stdev=241.03 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 4023, max= 4079, per=100.00%, avg=4051.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1399KiB/s (1433kB/s)(7168KiB/5122msec); 0 zone resets clat (msec): min=211, max=729, avg=452.09, stdev=209.96 lat (msec): min=214, max=729, avg=452.59, stdev=209.43 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 251], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 514], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 651], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1910, max= 4031, per=48.28%, avg=2331.67, stdev=833.53, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=16.67%, 750=50.00% cpu : usr=0.00%, sys=4.57%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3450KiB/s (3532kB/s), 345KiB/s-1712KiB/s (353kB/s-1753kB/s), io=20.0MiB (20.0MB), run=4186-5937msec WRITE: bw=4829KiB/s (4945kB/s), 1052KiB/s-1725KiB/s (1078kB/s-1766kB/s), io=28.0MiB (29.4MB), run=4186-5937msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146901: Thu Sep 10 02:10:53 2026 read: IOPS=1, BW=2004KiB/s (2053kB/s)(7168KiB/3576msec) clat (msec): min=3, max=336, avg=199.83, stdev=141.10 lat (msec): min=3, max=336, avg=199.83, stdev=141.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 243], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 330], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2000, max= 2884, per=65.65%, avg=2195.40, stdev=385.27, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1432KiB/s (1466kB/s)(5120KiB/3576msec); 0 zone resets clat (msec): min=248, max=630, avg=389.59, stdev=174.08 lat (msec): min=248, max=630, avg=389.69, stdev=174.07 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2000, max= 3710, per=55.20%, avg=2584.33, stdev=975.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=16.67%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=14.80%, ctx=204, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146903: Thu Sep 10 02:10:53 2026 read: IOPS=0, BW=334KiB/s (343kB/s)(2048KiB/6123msec) clat (usec): min=621, max=269132, avg=134876.89, stdev=189865.67 lat (usec): min=622, max=269134, avg=134878.62, stdev=189866.39 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1381, max= 2019, per=50.84%, avg=1700.00, stdev=451.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1672KiB/s (1713kB/s)(10.0MiB/6123msec); 0 zone resets clat (msec): min=224, max=1150, avg=571.05, stdev=313.14 lat (msec): min=224, max=1151, avg=571.23, stdev=313.24 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 234], | 30.00th=[ 414], 40.00th=[ 422], 50.00th=[ 430], 60.00th=[ 489], | 70.00th=[ 542], 80.00th=[ 827], 90.00th=[ 986], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1855, max= 4079, per=48.29%, avg=2260.75, stdev=737.25, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=10.70%, ctx=163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146904: Thu Sep 10 02:10:53 2026 read: IOPS=1, BW=1437KiB/s (1471kB/s)(6144KiB/4276msec) clat (usec): min=709, max=581677, avg=259049.60, stdev=186398.40 lat (usec): min=710, max=581689, avg=259052.69, stdev=186402.12 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[221250], | 30.00th=[221250], 40.00th=[235930], 50.00th=[235930], 60.00th=[235930], | 70.00th=[278922], 80.00th=[278922], 90.00th=[583009], 95.00th=[583009], | 99.00th=[583009], 99.50th=[583009], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 1855, max= 4039, per=74.43%, avg=2489.00, stdev=1036.71, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1437KiB/s (1471kB/s)(6144KiB/4276msec); 0 zone resets clat (msec): min=261, max=700, avg=410.92, stdev=152.58 lat (msec): min=262, max=700, avg=411.19, stdev=152.49 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 409], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1434, max= 2031, per=39.89%, avg=1867.80, stdev=252.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=12.47%, ctx=191, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146905: Thu Sep 10 02:10:53 2026 read: IOPS=0, BW=988KiB/s (1012kB/s)(5120KiB/5181msec) clat (msec): min=2, max=459, avg=255.61, stdev=216.08 lat (msec): min=2, max=459, avg=255.62, stdev=216.08 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 4039, max= 4087, per=100.00%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1384KiB/s (1417kB/s)(7168KiB/5181msec); 0 zone resets clat (msec): min=248, max=842, avg=515.26, stdev=223.00 lat (msec): min=248, max=842, avg=515.36, stdev=223.00 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 317], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 493], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 718], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2019, max= 3710, per=50.50%, avg=2364.40, stdev=752.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 4=8.33%, 50=8.33%, 250=8.33%, 500=50.00%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.02%, sys=10.58%, ctx=220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3345KiB/s (3425kB/s), 334KiB/s-2004KiB/s (343kB/s-2053kB/s), io=20.0MiB (20.0MB), run=3576-6123msec WRITE: bw=4683KiB/s (4795kB/s), 1384KiB/s-1672KiB/s (1417kB/s-1713kB/s), io=28.0MiB (29.4MB), run=3576-6123msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146913: Thu Sep 10 02:11:10 2026 read: IOPS=0, BW=2087KiB/s (2137kB/s)(12.0MiB/5888msec) clat (msec): min=881, max=3832, avg=1879.46, stdev=1691.28 lat (msec): min=881, max=3832, avg=1879.46, stdev=1691.28 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 3842], 80.00th=[ 3842], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.71%, ctx=742, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146914: Thu Sep 10 02:11:10 2026 read: IOPS=0, BW=667KiB/s (683kB/s)(4096KiB/6139msec) clat (nsec): min=3836.3M, max=3836.3M, avg=3836348432.00, stdev= 0.00 lat (nsec): min=3836.4M, max=3836.4M, avg=3836352142.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3842], 5.00th=[ 3842], 10.00th=[ 3842], 20.00th=[ 3842], | 30.00th=[ 3842], 40.00th=[ 3842], 50.00th=[ 3842], 60.00th=[ 3842], | 70.00th=[ 3842], 80.00th=[ 3842], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1334KiB/s (1366kB/s)(8192KiB/6139msec); 0 zone resets clat (msec): min=245, max=1953, avg=1099.35, stdev=1207.84 lat (msec): min=245, max=1954, avg=1099.97, stdev=1207.97 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.54%, ctx=548, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146915: Thu Sep 10 02:11:10 2026 write: IOPS=0, BW=1808KiB/s (1851kB/s)(12.0MiB/6798msec); 0 zone resets clat (msec): min=999, max=4087, avg=2183.45, stdev=1664.96 lat (msec): min=1000, max=4087, avg=2184.35, stdev=1664.62 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.37%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146916: Thu Sep 10 02:11:10 2026 write: IOPS=0, BW=1991KiB/s (2039kB/s)(12.0MiB/6171msec); 0 zone resets clat (msec): min=331, max=5245, avg=1995.18, stdev=2814.77 lat (msec): min=332, max=5245, avg=1995.55, stdev=2814.73 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 5269], 80.00th=[ 5269], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min= 6234, max= 8031, per=100.00%, avg=7132.50, stdev=1270.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=2.11%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2669KiB/s (2733kB/s), 667KiB/s-2087KiB/s (683kB/s-2137kB/s), io=16.0MiB (16.8MB), run=5888-6139msec WRITE: bw=4820KiB/s (4936kB/s), 1334KiB/s-1991KiB/s (1366kB/s-2039kB/s), io=32.0MiB (33.6MB), run=6139-6798msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146917: Thu Sep 10 02:11:11 2026 read: IOPS=0, BW=2048KiB/s (2097kB/s)(12.0MiB/6001msec) clat (msec): min=229, max=4559, avg=1929.80, stdev=2309.42 lat (msec): min=229, max=4559, avg=1929.80, stdev=2309.43 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.03%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146918: Thu Sep 10 02:11:11 2026 read: IOPS=0, BW=630KiB/s (645kB/s)(4096KiB/6501msec) clat (nsec): min=4199.6M, max=4199.6M, avg=4199617616.00, stdev= 0.00 lat (nsec): min=4199.6M, max=4199.6M, avg=4199620471.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4212], 5.00th=[ 4212], 10.00th=[ 4212], 20.00th=[ 4212], | 30.00th=[ 4212], 40.00th=[ 4212], 50.00th=[ 4212], 60.00th=[ 4212], | 70.00th=[ 4212], 80.00th=[ 4212], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1260KiB/s (1290kB/s)(8192KiB/6501msec); 0 zone resets clat (msec): min=743, max=1463, avg=1103.44, stdev=509.54 lat (msec): min=743, max=1464, avg=1103.90, stdev=509.40 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.15%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146919: Thu Sep 10 02:11:11 2026 write: IOPS=0, BW=1742KiB/s (1784kB/s)(12.0MiB/7055msec); 0 zone resets clat (msec): min=279, max=5224, avg=2244.56, stdev=2624.22 lat (msec): min=280, max=5225, avg=2245.23, stdev=2624.61 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 5201], 80.00th=[ 5201], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.55%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146920: Thu Sep 10 02:11:11 2026 write: IOPS=0, BW=1942KiB/s (1989kB/s)(12.0MiB/6326msec); 0 zone resets clat (msec): min=222, max=5362, avg=2027.50, stdev=2891.72 lat (msec): min=222, max=5363, avg=2027.98, stdev=2891.74 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 5336], 80.00th=[ 5336], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.12%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2520KiB/s (2581kB/s), 630KiB/s-2048KiB/s (645kB/s-2097kB/s), io=16.0MiB (16.8MB), run=6001-6501msec WRITE: bw=4645KiB/s (4756kB/s), 1260KiB/s-1942KiB/s (1290kB/s-1989kB/s), io=32.0MiB (33.6MB), run=6326-7055msec