== sanity test 398b: DIO and buffer IO race ============== 06:14:17 (1790676857) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.74439 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144885: Tue Sep 29 06:17:04 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(5992KiB/145822msec) clat (usec): min=36, max=424146, avg=48657.14, stdev=37415.71 lat (usec): min=36, max=424148, avg=48662.07, stdev=37415.05 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 10421], 20.00th=[ 23200], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[107480], | 99.00th=[162530], 99.50th=[208667], 99.90th=[413139], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 95, per=25.06%, avg=41.09, stdev=16.83, samples=283 iops : min= 1, max= 23, avg= 9.62, stdev= 4.23, samples=283 write: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6296KiB/145822msec); 0 zone resets clat (usec): min=1082, max=471603, avg=46145.81, stdev=45443.75 lat (usec): min=1083, max=471605, avg=46153.08, stdev=45443.96 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1483], 10.00th=[ 2442], 20.00th=[ 5866], | 30.00th=[ 11600], 40.00th=[ 24249], 50.00th=[ 36439], 60.00th=[ 48497], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[125305], | 99.00th=[189793], 99.50th=[231736], 99.90th=[367002], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 6, max= 125, per=24.85%, avg=42.74, stdev=19.41, samples=286 iops : min= 1, max= 31, avg=10.03, stdev= 4.90, samples=286 lat (usec) : 50=0.26%, 100=3.45%, 250=0.78%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.17%, 4=3.74%, 10=6.41%, 20=7.81%, 50=34.28% lat (msec) : 100=29.72%, 250=8.82%, 500=0.36% cpu : usr=0.07%, sys=4.78%, ctx=6851, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144886: Tue Sep 29 06:17:04 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5940KiB/145551msec) clat (usec): min=28, max=350810, avg=47274.23, stdev=33722.36 lat (usec): min=29, max=350812, avg=47277.36, stdev=33723.84 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 79], 10.00th=[ 14222], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[143655], 99.50th=[170918], 99.90th=[346031], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 6, max= 96, per=25.09%, avg=41.15, stdev=16.95, samples=281 iops : min= 1, max= 24, avg= 9.63, stdev= 4.30, samples=281 write: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6348KiB/145551msec); 0 zone resets clat (usec): min=1044, max=517899, avg=47330.31, stdev=48948.43 lat (usec): min=1045, max=517900, avg=47333.87, stdev=48949.76 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2409], 20.00th=[ 5604], | 30.00th=[ 10945], 40.00th=[ 22152], 50.00th=[ 36439], 60.00th=[ 47449], | 70.00th=[ 63177], 80.00th=[ 79168], 90.00th=[109577], 95.00th=[139461], | 99.00th=[204473], 99.50th=[250610], 99.90th=[446694], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=43.24, stdev=18.62, samples=286 iops : min= 1, max= 25, avg=10.16, stdev= 4.69, samples=286 lat (usec) : 50=0.33%, 100=2.64%, 250=0.75%, 500=0.10%, 750=0.10% lat (msec) : 2=4.49%, 4=3.42%, 10=7.23%, 20=7.85%, 50=35.84% lat (msec) : 100=27.18%, 250=9.73%, 500=0.33%, 750=0.03% cpu : usr=0.09%, sys=4.80%, ctx=6706, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144887: Tue Sep 29 06:17:04 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6028KiB/146076msec) clat (usec): min=30, max=560861, avg=47984.99, stdev=35922.77 lat (usec): min=30, max=560863, avg=47988.09, stdev=35922.11 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 74], 10.00th=[ 12518], 20.00th=[ 22676], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[145753], 99.50th=[168821], 99.90th=[413139], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=41.33, stdev=17.87, samples=284 iops : min= 1, max= 27, avg= 9.68, stdev= 4.50, samples=284 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6260KiB/146076msec); 0 zone resets clat (usec): min=1070, max=477808, avg=46980.02, stdev=47881.06 lat (usec): min=1071, max=477811, avg=46983.20, stdev=47880.62 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1467], 10.00th=[ 2606], 20.00th=[ 6063], | 30.00th=[ 11338], 40.00th=[ 23462], 50.00th=[ 36963], 60.00th=[ 48497], | 70.00th=[ 62129], 80.00th=[ 78119], 90.00th=[105382], 95.00th=[139461], | 99.00th=[204473], 99.50th=[235930], 99.90th=[450888], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 103, per=24.77%, avg=42.61, stdev=18.19, samples=286 iops : min= 1, max= 25, avg=10.00, stdev= 4.59, samples=286 lat (usec) : 50=0.29%, 100=3.39%, 250=0.62%, 500=0.03%, 1000=0.07% lat (msec) : 2=4.04%, 4=3.39%, 10=7.36%, 20=8.40%, 50=32.58% lat (msec) : 100=30.99%, 250=8.59%, 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=4.73%, ctx=6768, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144888: Tue Sep 29 06:17:04 2026 read: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6052KiB/143307msec) clat (usec): min=36, max=337654, avg=46676.76, stdev=33419.05 lat (usec): min=36, max=337655, avg=46681.19, stdev=33418.03 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 4883], 20.00th=[ 22938], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[139461], 99.50th=[181404], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 104, per=25.61%, avg=42.00, stdev=18.26, samples=280 iops : min= 1, max= 26, avg= 9.85, stdev= 4.60, samples=280 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6236KiB/143307msec); 0 zone resets clat (usec): min=1039, max=509061, avg=46474.65, stdev=46640.02 lat (usec): min=1041, max=509064, avg=46479.50, stdev=46638.57 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1434], 10.00th=[ 2180], 20.00th=[ 5407], | 30.00th=[ 11469], 40.00th=[ 23987], 50.00th=[ 36963], 60.00th=[ 46400], | 70.00th=[ 61604], 80.00th=[ 82314], 90.00th=[105382], 95.00th=[127402], | 99.00th=[189793], 99.50th=[233833], 99.90th=[408945], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 6, max= 117, per=25.05%, avg=43.09, stdev=17.44, samples=281 iops : min= 1, max= 29, avg=10.12, stdev= 4.39, samples=281 lat (usec) : 50=0.33%, 100=3.71%, 250=0.55%, 500=0.16%, 750=0.07% lat (msec) : 2=4.72%, 4=3.71%, 10=6.05%, 20=7.78%, 50=35.03% lat (msec) : 100=29.23%, 250=8.40%, 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6810, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=164KiB/s (168kB/s), 40.8KiB/s-42.2KiB/s (41.8kB/s-43.2kB/s), io=23.4MiB (24.6MB), run=143307-146076msec WRITE: bw=172KiB/s (176kB/s), 42.9KiB/s-43.6KiB/s (43.9kB/s-44.7kB/s), io=24.6MiB (25.7MB), run=143307-146076msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Tue Sep 29 06:19:06 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(5992KiB/268575msec) clat (msec): min=5, max=930, avg=38.40, stdev=47.47 lat (msec): min=5, max=930, avg=38.40, stdev=47.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 211], 99.50th=[ 262], 99.90th=[ 376], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 103, per=28.50%, avg=25.36, stdev=17.77, samples=456 iops : min= 1, max= 25, avg= 5.68, stdev= 4.45, samples=456 write: IOPS=5, BW=23.4KiB/s (24.0kB/s)(6296KiB/268575msec); 0 zone resets clat (msec): min=34, max=556, avg=133.76, stdev=71.07 lat (msec): min=34, max=556, avg=133.76, stdev=71.07 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 130], | 70.00th=[ 155], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 372], 99.50th=[ 409], 99.90th=[ 514], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 63, per=25.01%, avg=23.26, stdev=12.28, samples=520 iops : min= 1, max= 15, avg= 5.15, stdev= 3.09, samples=520 lat (msec) : 10=3.61%, 20=18.72%, 50=17.22%, 100=25.91%, 250=30.11% lat (msec) : 500=4.33%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.20%, ctx=5385, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Tue Sep 29 06:19:06 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5940KiB/268721msec) clat (msec): min=5, max=1054, avg=37.95, stdev=49.20 lat (msec): min=5, max=1054, avg=37.96, stdev=49.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 456], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 111, per=28.21%, avg=25.11, stdev=17.00, samples=456 iops : min= 1, max= 27, avg= 5.62, stdev= 4.27, samples=456 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6348KiB/268721msec); 0 zone resets clat (msec): min=33, max=612, avg=133.47, stdev=69.02 lat (msec): min=33, max=612, avg=133.47, stdev=69.02 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 130], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 489], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 63, per=25.20%, avg=23.44, stdev=11.95, samples=520 iops : min= 1, max= 15, avg= 5.20, stdev= 3.02, samples=520 lat (msec) : 10=3.16%, 20=19.43%, 50=16.73%, 100=25.46%, 250=31.25% lat (msec) : 500=3.91%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5323, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144882: Tue Sep 29 06:19:06 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6028KiB/269019msec) clat (msec): min=5, max=631, avg=39.92, stdev=45.71 lat (msec): min=5, max=631, avg=39.93, stdev=45.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 38], 80.00th=[ 59], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 243], 99.50th=[ 279], 99.90th=[ 355], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 111, per=27.29%, avg=24.29, stdev=17.83, samples=477 iops : min= 1, max= 27, avg= 5.42, stdev= 4.48, samples=477 write: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6260KiB/269019msec); 0 zone resets clat (msec): min=35, max=1186, avg=133.11, stdev=74.55 lat (msec): min=35, max=1186, avg=133.12, stdev=74.55 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 153], 80.00th=[ 182], 90.00th=[ 224], 95.00th=[ 266], | 99.00th=[ 368], 99.50th=[ 401], 99.90th=[ 617], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 63, per=24.95%, avg=23.20, stdev=12.35, samples=518 iops : min= 1, max= 15, avg= 5.14, stdev= 3.11, samples=518 lat (msec) : 10=3.19%, 20=18.10%, 50=17.61%, 100=26.40%, 250=30.92% lat (msec) : 500=3.61%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5261, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144883: Tue Sep 29 06:19:06 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6052KiB/267221msec) clat (msec): min=6, max=631, avg=36.70, stdev=41.05 lat (msec): min=6, max=631, avg=36.71, stdev=41.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 83], 95.00th=[ 121], | 99.00th=[ 182], 99.50th=[ 241], 99.90th=[ 363], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 103, per=28.88%, avg=25.70, stdev=17.92, samples=455 iops : min= 1, max= 25, avg= 5.77, stdev= 4.50, samples=455 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267221msec); 0 zone resets clat (msec): min=36, max=1202, avg=135.46, stdev=74.98 lat (msec): min=36, max=1202, avg=135.46, stdev=74.98 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 103], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 527], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 71, per=24.87%, avg=23.13, stdev=11.83, samples=519 iops : min= 1, max= 17, avg= 5.12, stdev= 2.98, samples=519 lat (msec) : 10=3.06%, 20=18.78%, 50=18.39%, 100=25.07%, 250=30.92% lat (msec) : 500=3.68%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.23%, ctx=5112, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.3KiB/s (91.4kB/s), 22.1KiB/s-22.6KiB/s (22.6kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267221-269019msec WRITE: bw=93.5KiB/s (95.7kB/s), 23.3KiB/s-23.6KiB/s (23.8kB/s-24.2kB/s), io=24.6MiB (25.7MB), run=267221-269019msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Tue Sep 29 06:19:45 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5920KiB/28546msec) clat (usec): min=42, max=224564, avg=37688.10, stdev=28066.21 lat (usec): min=42, max=224564, avg=37689.81, stdev=28066.05 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 83], 20.00th=[ 17957], | 30.00th=[ 23725], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 80217], | 99.00th=[120062], 99.50th=[158335], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 541, per=24.59%, avg=206.29, stdev=88.52, samples=56 iops : min= 1, max= 33, avg=12.11, stdev= 5.57, samples=56 write: IOPS=13, BW=223KiB/s (228kB/s)(6368KiB/28546msec); 0 zone resets clat (usec): min=1305, max=215377, avg=36013.42, stdev=36760.54 lat (usec): min=1305, max=215379, avg=36017.10, stdev=36760.91 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2114], 10.00th=[ 3261], 20.00th=[ 5800], | 30.00th=[ 8455], 40.00th=[ 14222], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[177210], 99.50th=[202376], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 415, per=25.27%, avg=222.84, stdev=80.60, samples=56 iops : min= 3, max= 25, avg=13.14, stdev= 5.07, samples=56 lat (usec) : 50=0.65%, 100=4.95%, 250=1.56%, 500=0.13%, 1000=0.26% lat (msec) : 2=2.86%, 4=4.04%, 10=11.72%, 20=9.24%, 50=36.33% lat (msec) : 100=23.31%, 250=4.95% cpu : usr=0.07%, sys=6.09%, ctx=1602, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Tue Sep 29 06:19:45 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5744KiB/28091msec) clat (usec): min=41, max=216103, avg=39765.61, stdev=30290.10 lat (usec): min=41, max=216105, avg=39770.74, stdev=30291.44 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 81], 20.00th=[ 17957], | 30.00th=[ 26608], 40.00th=[ 32637], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[168821], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 28, max= 349, per=24.73%, avg=207.44, stdev=74.00, samples=54 iops : min= 1, max= 21, avg=12.17, stdev= 4.68, samples=54 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28091msec); 0 zone resets clat (usec): min=1512, max=240260, avg=33074.68, stdev=35227.93 lat (usec): min=1514, max=240263, avg=33092.72, stdev=35236.83 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2343], 10.00th=[ 3687], 20.00th=[ 5407], | 30.00th=[ 8094], 40.00th=[ 11863], 50.00th=[ 20579], 60.00th=[ 31065], | 70.00th=[ 42730], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[152044], 99.50th=[217056], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 28, max= 412, per=26.40%, avg=232.82, stdev=83.33, samples=55 iops : min= 1, max= 25, avg=13.76, stdev= 5.22, samples=55 lat (usec) : 50=0.52%, 100=6.51%, 250=0.26%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.08%, 4=4.17%, 10=13.54%, 20=8.59%, 50=36.46% lat (msec) : 100=23.18%, 250=4.17% cpu : usr=0.11%, sys=6.07%, ctx=1615, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Tue Sep 29 06:19:45 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28162msec) clat (usec): min=39, max=179573, avg=38183.46, stdev=29594.85 lat (usec): min=39, max=179575, avg=38187.49, stdev=29597.99 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 1696], | 30.00th=[ 24511], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[158335], 99.50th=[162530], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 29, max= 443, per=26.71%, avg=224.13, stdev=73.49, samples=55 iops : min= 1, max= 27, avg=13.22, stdev= 4.63, samples=55 write: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28162msec); 0 zone resets clat (usec): min=1415, max=350729, avg=34815.37, stdev=39200.83 lat (usec): min=1415, max=350731, avg=34829.27, stdev=39197.20 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2212], 10.00th=[ 3392], 20.00th=[ 5866], | 30.00th=[ 8455], 40.00th=[ 13173], 50.00th=[ 22152], 60.00th=[ 30802], | 70.00th=[ 44303], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[109577], | 99.00th=[185598], 99.50th=[240124], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 445, per=24.22%, avg=213.64, stdev=91.98, samples=55 iops : min= 1, max= 27, avg=12.56, stdev= 5.79, samples=55 lat (usec) : 50=0.91%, 100=6.90%, 250=1.43%, 500=0.52%, 1000=0.26% lat (msec) : 2=2.34%, 4=4.56%, 10=10.68%, 20=8.59%, 50=36.20% lat (msec) : 100=23.57%, 250=3.91%, 500=0.13% cpu : usr=0.08%, sys=6.22%, ctx=1592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Tue Sep 29 06:19:45 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27983msec) clat (usec): min=32, max=279038, avg=37916.12, stdev=31455.54 lat (usec): min=32, max=279039, avg=37918.65, stdev=31455.42 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 204], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[129500], 99.50th=[145753], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 445, per=26.02%, avg=218.31, stdev=92.23, samples=54 iops : min= 1, max= 27, avg=12.85, stdev= 5.79, samples=54 write: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27983msec); 0 zone resets clat (usec): min=1463, max=266668, avg=34449.42, stdev=38235.70 lat (usec): min=1465, max=266670, avg=34452.52, stdev=38235.67 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2114], 10.00th=[ 3326], 20.00th=[ 5473], | 30.00th=[ 7963], 40.00th=[ 11994], 50.00th=[ 18744], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 60556], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[191890], 99.50th=[206570], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 63, max= 444, per=25.32%, avg=223.33, stdev=85.87, samples=55 iops : min= 3, max= 27, avg=13.18, stdev= 5.38, samples=55 lat (usec) : 50=0.52%, 100=8.07%, 250=1.30%, 500=0.26%, 750=0.26% lat (msec) : 2=2.47%, 4=4.17%, 10=12.11%, 20=9.64%, 50=34.51% lat (msec) : 100=21.09%, 250=5.34%, 500=0.26% cpu : usr=0.09%, sys=5.86%, ctx=1556, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=839KiB/s (859kB/s), 204KiB/s-222KiB/s (209kB/s-227kB/s), io=23.4MiB (24.5MB), run=27983-28546msec WRITE: bw=883KiB/s (904kB/s), 214KiB/s-233KiB/s (219kB/s-239kB/s), io=24.6MiB (25.8MB), run=27983-28546msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Tue Sep 29 06:20:21 2026 read: IOPS=5, BW=92.0KiB/s (95.2kB/s)(5920KiB/63657msec) clat (msec): min=7, max=343, avg=39.97, stdev=45.09 lat (msec): min=7, max=343, avg=39.97, stdev=45.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 88], 95.00th=[ 132], | 99.00th=[ 213], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 378, per=27.03%, avg=101.10, stdev=64.82, samples=115 iops : min= 1, max= 23, avg= 5.52, stdev= 4.11, samples=115 write: IOPS=6, BW=100KiB/s (102kB/s)(6368KiB/63657msec); 0 zone resets clat (msec): min=43, max=437, avg=122.62, stdev=55.62 lat (msec): min=43, max=437, avg=122.62, stdev=55.62 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 123], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 192], 95.00th=[ 226], | 99.00th=[ 359], 99.50th=[ 409], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 31, max= 192, per=25.50%, avg=100.23, stdev=42.06, samples=125 iops : min= 1, max= 12, avg= 5.46, stdev= 2.70, samples=125 lat (msec) : 10=0.65%, 20=18.36%, 50=20.05%, 100=26.43%, 250=32.55% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.43%, ctx=1348, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Tue Sep 29 06:20:21 2026 read: IOPS=5, BW=89.7KiB/s (91.9kB/s)(5744KiB/64033msec) clat (msec): min=7, max=402, avg=39.02, stdev=43.95 lat (msec): min=7, max=402, avg=39.02, stdev=43.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 126], | 99.00th=[ 186], 99.50th=[ 342], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 28, max= 380, per=28.12%, avg=105.19, stdev=67.62, samples=108 iops : min= 1, max= 23, avg= 5.78, stdev= 4.33, samples=108 write: IOPS=6, BW=102KiB/s (105kB/s)(6544KiB/64033msec); 0 zone resets clat (msec): min=40, max=315, avg=121.60, stdev=52.88 lat (msec): min=40, max=315, avg=121.60, stdev=52.88 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 120], | 70.00th=[ 138], 80.00th=[ 163], 90.00th=[ 194], 95.00th=[ 222], | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 28, max= 224, per=26.08%, avg=102.48, stdev=46.47, samples=126 iops : min= 1, max= 14, avg= 5.60, stdev= 2.95, samples=126 lat (msec) : 10=1.82%, 20=16.93%, 50=19.01%, 100=27.08%, 250=33.07% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.34%, ctx=1318, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Tue Sep 29 06:20:21 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6256KiB/61723msec) clat (msec): min=6, max=249, avg=34.14, stdev=33.67 lat (msec): min=6, max=249, avg=34.14, stdev=33.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 349, per=29.30%, avg=109.57, stdev=72.14, samples=113 iops : min= 1, max= 21, avg= 6.05, stdev= 4.53, samples=113 write: IOPS=6, BW=97.7KiB/s (100kB/s)(6032KiB/61723msec); 0 zone resets clat (msec): min=39, max=431, avg=127.94, stdev=60.52 lat (msec): min=39, max=431, avg=127.94, stdev=60.52 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 239], | 99.00th=[ 338], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 31, max= 192, per=24.88%, avg=97.77, stdev=41.34, samples=121 iops : min= 1, max= 12, avg= 5.31, stdev= 2.64, samples=121 lat (msec) : 10=1.82%, 20=18.88%, 50=22.79%, 100=23.96%, 250=30.60% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.38%, ctx=1333, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Tue Sep 29 06:20:21 2026 read: IOPS=5, BW=95.8KiB/s (98.1kB/s)(6032KiB/62989msec) clat (msec): min=7, max=270, avg=36.12, stdev=35.29 lat (msec): min=7, max=270, avg=36.12, stdev=35.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 115], | 99.00th=[ 186], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 318, per=28.03%, avg=104.84, stdev=67.10, samples=112 iops : min= 1, max= 19, avg= 5.76, stdev= 4.25, samples=112 write: IOPS=6, BW=99.3KiB/s (102kB/s)(6256KiB/62989msec); 0 zone resets clat (msec): min=34, max=350, avg=125.90, stdev=52.43 lat (msec): min=34, max=350, avg=125.91, stdev=52.43 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 199], 95.00th=[ 236], | 99.00th=[ 292], 99.50th=[ 309], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 191, per=25.53%, avg=100.33, stdev=41.03, samples=122 iops : min= 1, max= 11, avg= 5.47, stdev= 2.60, samples=122 lat (msec) : 10=1.69%, 20=16.80%, 50=22.14%, 100=23.96%, 250=33.33% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.39%, ctx=1301, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 89.7KiB/s-101KiB/s (91.9kB/s-104kB/s), io=23.4MiB (24.5MB), run=61723-64033msec WRITE: bw=394KiB/s (403kB/s), 97.7KiB/s-102KiB/s (100kB/s-105kB/s), io=24.6MiB (25.8MB), run=61723-64033msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Tue Sep 29 06:20:38 2026 read: IOPS=2, BW=2210KiB/s (2263kB/s)(7168KiB/3243msec) clat (usec): min=687, max=308858, avg=165559.71, stdev=100140.64 lat (usec): min=688, max=308860, avg=165561.54, stdev=100140.90 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 95945], | 30.00th=[143655], 40.00th=[143655], 50.00th=[168821], 60.00th=[196084], | 70.00th=[196084], 80.00th=[244319], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 1828, max= 4134, per=100.00%, avg=3349.67, stdev=1318.01, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1579KiB/s (1617kB/s)(5120KiB/3243msec); 0 zone resets clat (msec): min=229, max=601, avg=400.86, stdev=161.52 lat (msec): min=229, max=604, avg=408.19, stdev=163.41 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1828, max= 2043, per=49.64%, avg=1980.25, stdev=102.91, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.08%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Tue Sep 29 06:20:38 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7186msec) clat (usec): min=1007, max=650977, avg=325992.80, stdev=459597.92 lat (usec): min=1009, max=651054, avg=326032.07, stdev=459651.69 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], 20.00th=[ 1012], | 30.00th=[ 1012], 40.00th=[ 1012], 50.00th=[ 1012], 60.00th=[650118], | 70.00th=[650118], 80.00th=[650118], 90.00th=[650118], 95.00th=[650118], | 99.00th=[650118], 99.50th=[650118], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 2007, max= 2011, per=70.52%, avg=2009.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1425KiB/s (1459kB/s)(10.0MiB/7186msec); 0 zone resets clat (msec): min=87, max=3596, avg=644.27, stdev=1050.36 lat (msec): min=87, max=3596, avg=644.37, stdev=1050.36 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 115], | 30.00th=[ 174], 40.00th=[ 213], 50.00th=[ 300], 60.00th=[ 464], | 70.00th=[ 477], 80.00th=[ 489], 90.00th=[ 531], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1828, max= 6131, per=80.72%, avg=3220.00, stdev=1871.52, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=10.03%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Tue Sep 29 06:20:38 2026 read: IOPS=1, BW=1744KiB/s (1786kB/s)(6144KiB/3522msec) clat (usec): min=597, max=463637, avg=212817.65, stdev=181077.43 lat (usec): min=599, max=463637, avg=212818.92, stdev=181077.08 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 1975], | 30.00th=[ 1975], 40.00th=[238027], 50.00th=[238027], 60.00th=[278922], | 70.00th=[295699], 80.00th=[295699], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 2011, max= 3657, per=85.59%, avg=2438.50, stdev=812.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1744KiB/s (1786kB/s)(6144KiB/3522msec); 0 zone resets clat (msec): min=212, max=504, avg=368.32, stdev=112.43 lat (msec): min=214, max=504, avg=368.66, stdev=112.07 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 430], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1479, max= 4015, per=58.49%, avg=2333.25, stdev=1142.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=19.40%, ctx=288, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144971: Tue Sep 29 06:20:38 2026 read: IOPS=0, BW=782KiB/s (801kB/s)(5120KiB/6548msec) clat (usec): min=589, max=3274.2k, avg=728181.85, stdev=1431941.00 lat (usec): min=591, max=3274.2k, avg=728183.24, stdev=1431940.61 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], | 20.00th=[ 586], 30.00th=[ 594], 40.00th=[ 594], | 50.00th=[ 979], 60.00th=[ 979], 70.00th=[ 362808], | 80.00th=[ 362808], 90.00th=[3271558], 95.00th=[3271558], | 99.00th=[3271558], 99.50th=[3271558], 99.90th=[3271558], | 99.95th=[3271558], 99.99th=[3271558] bw ( KiB/s): min= 3657, max= 4031, per=100.00%, avg=3844.00, stdev=264.46, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1095KiB/s (1121kB/s)(7168KiB/6548msec); 0 zone resets clat (msec): min=139, max=714, avg=402.02, stdev=224.90 lat (msec): min=139, max=715, avg=402.27, stdev=225.13 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 197], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 456], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 600], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1828, max= 2043, per=49.82%, avg=1987.20, stdev=90.47, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=10.91%, ctx=625, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2850KiB/s (2918kB/s), 285KiB/s-2210KiB/s (292kB/s-2263kB/s), io=20.0MiB (20.0MB), run=3243-7186msec WRITE: bw=3990KiB/s (4086kB/s), 1095KiB/s-1744KiB/s (1121kB/s-1786kB/s), io=28.0MiB (29.4MB), run=3243-7186msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144970: Tue Sep 29 06:20:39 2026 read: IOPS=1, BW=1893KiB/s (1938kB/s)(7168KiB/3787msec) clat (msec): min=92, max=314, avg=166.88, stdev=78.38 lat (msec): min=92, max=314, avg=166.88, stdev=78.38 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 165], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 205], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2031, max= 3871, per=100.00%, avg=2706.50, stdev=870.77, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1352KiB/s (1384kB/s)(5120KiB/3787msec); 0 zone resets clat (msec): min=194, max=860, avg=466.98, stdev=292.78 lat (msec): min=194, max=861, avg=467.24, stdev=293.02 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2019, max= 4096, per=95.75%, avg=3382.00, stdev=1180.84, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=7.29%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144972: Tue Sep 29 06:20:39 2026 read: IOPS=0, BW=259KiB/s (265kB/s)(2048KiB/7921msec) clat (msec): min=260, max=632, avg=446.18, stdev=263.22 lat (msec): min=260, max=632, avg=446.18, stdev=263.22 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2031, max= 2031, per=80.50%, avg=2031.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1293KiB/s (1324kB/s)(10.0MiB/7921msec); 0 zone resets clat (msec): min=102, max=2835, avg=677.15, stdev=814.21 lat (msec): min=102, max=2835, avg=677.24, stdev=814.21 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 142], | 30.00th=[ 259], 40.00th=[ 271], 50.00th=[ 405], 60.00th=[ 456], | 70.00th=[ 531], 80.00th=[ 642], 90.00th=[ 1133], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1935, max= 4071, per=65.47%, avg=2312.43, stdev=776.46, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.13%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144973: Tue Sep 29 06:20:39 2026 read: IOPS=0, BW=802KiB/s (821kB/s)(6144KiB/7660msec) clat (msec): min=113, max=392, avg=274.18, stdev=130.41 lat (msec): min=113, max=392, avg=274.19, stdev=130.41 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 380], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2031, max= 4063, per=100.00%, avg=2709.67, stdev=1172.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=802KiB/s (821kB/s)(6144KiB/7660msec); 0 zone resets clat (msec): min=160, max=3527, avg=959.47, stdev=1285.45 lat (msec): min=160, max=3528, avg=959.78, stdev=1285.89 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 609], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1492, max= 2048, per=53.96%, avg=1905.80, stdev=235.48, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.41%, ctx=132, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144974: Tue Sep 29 06:20:39 2026 read: IOPS=0, BW=631KiB/s (646kB/s)(5120KiB/8116msec) clat (msec): min=73, max=361, avg=249.61, stdev=137.42 lat (msec): min=73, max=361, avg=249.61, stdev=137.42 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2035, max= 4063, per=100.00%, avg=2712.33, stdev=1169.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=883KiB/s (904kB/s)(7168KiB/8116msec); 0 zone resets clat (msec): min=176, max=3007, avg=958.82, stdev=1012.23 lat (msec): min=176, max=3008, avg=958.98, stdev=1012.22 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 201], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 609], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1250], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 2015, max= 2048, per=57.49%, avg=2030.40, stdev=13.70, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.74%, ctx=131, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2523KiB/s (2584kB/s), 259KiB/s-1893KiB/s (265kB/s-1938kB/s), io=20.0MiB (20.0MB), run=3787-8116msec WRITE: bw=3533KiB/s (3618kB/s), 802KiB/s-1352KiB/s (821kB/s-1384kB/s), io=28.0MiB (29.4MB), run=3787-8116msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Tue Sep 29 06:20:57 2026 read: IOPS=0, BW=1999KiB/s (2047kB/s)(12.0MiB/6147msec) clat (msec): min=944, max=3940, avg=1985.21, stdev=1694.86 lat (msec): min=944, max=3940, avg=1985.21, stdev=1694.87 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.44%, ctx=357, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Tue Sep 29 06:20:57 2026 read: IOPS=0, BW=538KiB/s (551kB/s)(4096KiB/7614msec) clat (nsec): min=3973.9M, max=3973.9M, avg=3973856969.00, stdev= 0.00 lat (nsec): min=3973.9M, max=3973.9M, avg=3973858611.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3977], 5.00th=[ 3977], 10.00th=[ 3977], 20.00th=[ 3977], | 30.00th=[ 3977], 40.00th=[ 3977], 50.00th=[ 3977], 60.00th=[ 3977], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1076KiB/s (1102kB/s)(8192KiB/7614msec); 0 zone resets clat (msec): min=1669, max=1840, avg=1755.04, stdev=120.37 lat (msec): min=1670, max=1840, avg=1755.57, stdev=120.30 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.80%, ctx=634, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Tue Sep 29 06:20:57 2026 write: IOPS=0, BW=1592KiB/s (1630kB/s)(12.0MiB/7719msec); 0 zone resets clat (msec): min=550, max=3685, avg=2538.73, stdev=1728.98 lat (msec): min=550, max=3687, avg=2539.80, stdev=1729.54 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 3373], 50.00th=[ 3373], 60.00th=[ 3373], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.63%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Tue Sep 29 06:20:57 2026 write: IOPS=0, BW=1810KiB/s (1853kB/s)(12.0MiB/6790msec); 0 zone resets clat (msec): min=533, max=3584, avg=2218.61, stdev=1550.15 lat (msec): min=534, max=3587, avg=2232.36, stdev=1555.12 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 2534], 50.00th=[ 2534], 60.00th=[ 2534], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8015, max= 8094, per=100.00%, avg=8054.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.55%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2152KiB/s (2203kB/s), 538KiB/s-1999KiB/s (551kB/s-2047kB/s), io=16.0MiB (16.8MB), run=6147-7614msec WRITE: bw=4245KiB/s (4347kB/s), 1076KiB/s-1810KiB/s (1102kB/s-1853kB/s), io=32.0MiB (33.6MB), run=6790-7719msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144986: Tue Sep 29 06:20:58 2026 read: IOPS=0, BW=1607KiB/s (1645kB/s)(12.0MiB/7648msec) clat (msec): min=744, max=4824, avg=2480.21, stdev=2106.90 lat (msec): min=744, max=4824, avg=2480.21, stdev=2106.90 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 4799], 80.00th=[ 4799], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.48%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144987: Tue Sep 29 06:20:58 2026 read: IOPS=0, BW=537KiB/s (550kB/s)(4096KiB/7621msec) clat (nsec): min=4489.0M, max=4489.0M, avg=4489964976.00, stdev= 0.00 lat (nsec): min=4489.0M, max=4489.0M, avg=4489969363.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4463], 5.00th=[ 4463], 10.00th=[ 4463], 20.00th=[ 4463], | 30.00th=[ 4463], 40.00th=[ 4463], 50.00th=[ 4463], 60.00th=[ 4463], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1075KiB/s (1101kB/s)(8192KiB/7621msec); 0 zone resets clat (msec): min=1023, max=1959, avg=1491.32, stdev=662.24 lat (msec): min=1027, max=1959, avg=1493.51, stdev=659.50 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.29%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Tue Sep 29 06:20:58 2026 write: IOPS=0, BW=1722KiB/s (1763kB/s)(12.0MiB/7136msec); 0 zone resets clat (msec): min=930, max=4166, avg=2341.73, stdev=1657.36 lat (msec): min=931, max=4169, avg=2344.77, stdev=1658.10 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.45%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144989: Tue Sep 29 06:20:58 2026 write: IOPS=0, BW=1748KiB/s (1790kB/s)(12.0MiB/7030msec); 0 zone resets clat (msec): min=462, max=4356, avg=2307.42, stdev=1955.05 lat (msec): min=463, max=4357, avg=2307.90, stdev=1955.06 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 2106], 50.00th=[ 2106], 60.00th=[ 2106], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.10%, ctx=34, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2142KiB/s (2194kB/s), 537KiB/s-1607KiB/s (550kB/s-1645kB/s), io=16.0MiB (16.8MB), run=7621-7648msec WRITE: bw=4300KiB/s (4403kB/s), 1075KiB/s-1748KiB/s (1101kB/s-1790kB/s), io=32.0MiB (33.6MB), run=7030-7621msec