== sanity test 398b: DIO and buffer IO race ============== 09:23:06 (1788268986) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.88 s, 17.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179306: Tue Sep 1 09:24:04 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(5992KiB/47895msec) clat (usec): min=33, max=658797, avg=17568.50, stdev=18936.52 lat (usec): min=33, max=658798, avg=17569.29, stdev=18936.58 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 7177], 10.00th=[ 8291], 20.00th=[ 9896], | 30.00th=[ 11469], 40.00th=[ 13304], 50.00th=[ 15533], 60.00th=[ 17695], | 70.00th=[ 20317], 80.00th=[ 23200], 90.00th=[ 28705], 95.00th=[ 33424], | 99.00th=[ 49546], 99.50th=[ 55837], 99.90th=[ 84411], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 13, max= 199, per=24.95%, avg=124.75, stdev=30.55, samples=95 iops : min= 3, max= 49, avg=30.83, stdev= 7.69, samples=95 write: IOPS=32, BW=131KiB/s (135kB/s)(6296KiB/47895msec); 0 zone resets clat (usec): min=603, max=99278, avg=13579.50, stdev=11546.47 lat (usec): min=603, max=99280, avg=13580.46, stdev=11546.46 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 1713], 10.00th=[ 2343], 20.00th=[ 3032], | 30.00th=[ 4752], 40.00th=[ 8356], 50.00th=[11076], 60.00th=[13960], | 70.00th=[17433], 80.00th=[22152], 90.00th=[28967], 95.00th=[35390], | 99.00th=[49546], 99.50th=[60031], 99.90th=[76022], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 64, max= 223, per=25.32%, avg=132.68, stdev=31.26, samples=94 iops : min= 16, max= 55, avg=32.81, stdev= 7.79, samples=94 lat (usec) : 50=0.10%, 100=0.36%, 250=0.72%, 750=0.13%, 1000=0.52% lat (msec) : 2=2.83%, 4=10.51%, 10=18.39%, 20=39.32%, 50=26.20% lat (msec) : 100=0.88%, 750=0.03% cpu : usr=0.13%, sys=20.84%, ctx=7973, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179307: Tue Sep 1 09:24:04 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(5940KiB/47356msec) clat (usec): min=30, max=64961, avg=16977.75, stdev=8981.01 lat (usec): min=30, max=64962, avg=16978.49, stdev=8981.03 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 6915], 10.00th=[ 8225], 20.00th=[ 9765], | 30.00th=[11469], 40.00th=[13304], 50.00th=[15270], 60.00th=[17171], | 70.00th=[19792], 80.00th=[23200], 90.00th=[28443], 95.00th=[33162], | 99.00th=[50070], 99.50th=[53740], 99.90th=[64226], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 6, max= 184, per=25.05%, avg=125.26, stdev=31.38, samples=94 iops : min= 1, max= 46, avg=30.95, stdev= 7.89, samples=94 write: IOPS=33, BW=134KiB/s (137kB/s)(6348KiB/47356msec); 0 zone resets clat (usec): min=754, max=679212, avg=13822.07, stdev=20071.18 lat (usec): min=755, max=679213, avg=13822.97, stdev=20071.18 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1844], 10.00th=[ 2409], 20.00th=[ 3130], | 30.00th=[ 5080], 40.00th=[ 8848], 50.00th=[ 11338], 60.00th=[ 13829], | 70.00th=[ 16909], 80.00th=[ 21103], 90.00th=[ 28443], 95.00th=[ 34866], | 99.00th=[ 53216], 99.50th=[ 61604], 99.90th=[ 81265], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 6, max= 224, per=25.50%, avg=133.61, stdev=34.26, samples=94 iops : min= 1, max= 56, avg=33.03, stdev= 8.58, samples=94 lat (usec) : 50=0.16%, 100=0.36%, 250=0.46%, 1000=0.42% lat (msec) : 2=2.77%, 4=10.35%, 10=18.75%, 20=40.53%, 50=25.13% lat (msec) : 100=1.04%, 750=0.03% cpu : usr=0.12%, sys=21.22%, ctx=7919, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179308: Tue Sep 1 09:24:04 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(6028KiB/47608msec) clat (usec): min=47, max=691940, avg=17759.78, stdev=19897.81 lat (usec): min=47, max=691941, avg=17760.63, stdev=19897.81 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 6652], 10.00th=[ 8029], 20.00th=[ 10028], | 30.00th=[ 11469], 40.00th=[ 13435], 50.00th=[ 15664], 60.00th=[ 17957], | 70.00th=[ 20317], 80.00th=[ 23200], 90.00th=[ 28705], 95.00th=[ 33424], | 99.00th=[ 53216], 99.50th=[ 63177], 99.90th=[ 88605], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 64, max= 183, per=25.54%, avg=127.71, stdev=29.78, samples=93 iops : min= 16, max= 45, avg=31.57, stdev= 7.42, samples=93 write: IOPS=32, BW=131KiB/s (135kB/s)(6260KiB/47608msec); 0 zone resets clat (usec): min=784, max=87541, avg=13186.54, stdev=11240.06 lat (usec): min=786, max=87541, avg=13189.31, stdev=11240.09 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1713], 10.00th=[ 2311], 20.00th=[ 2999], | 30.00th=[ 4490], 40.00th=[ 8160], 50.00th=[10552], 60.00th=[13173], | 70.00th=[16712], 80.00th=[21890], 90.00th=[28181], 95.00th=[35390], | 99.00th=[47449], 99.50th=[56361], 99.90th=[74974], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 20, max= 216, per=24.99%, avg=130.93, stdev=36.31, samples=94 iops : min= 5, max= 54, avg=32.37, stdev= 9.09, samples=94 lat (usec) : 50=0.07%, 100=0.55%, 250=0.62%, 500=0.03%, 1000=0.59% lat (msec) : 2=3.06%, 4=10.64%, 10=18.03%, 20=39.49%, 50=25.94% lat (msec) : 100=0.94%, 750=0.03% cpu : usr=0.12%, sys=21.07%, ctx=7920, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Tue Sep 1 09:24:04 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6052KiB/47962msec) clat (usec): min=21, max=82280, avg=17177.25, stdev=9179.50 lat (usec): min=21, max=82281, avg=17178.04, stdev=9179.48 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 6915], 10.00th=[ 8586], 20.00th=[10159], | 30.00th=[11600], 40.00th=[13566], 50.00th=[15533], 60.00th=[17695], | 70.00th=[20055], 80.00th=[23200], 90.00th=[27657], 95.00th=[33162], | 99.00th=[49021], 99.50th=[56361], 99.90th=[71828], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 32, max= 200, per=25.46%, avg=127.30, stdev=27.80, samples=94 iops : min= 8, max= 50, avg=31.47, stdev= 6.95, samples=94 write: IOPS=32, BW=130KiB/s (133kB/s)(6236KiB/47962msec); 0 zone resets clat (usec): min=690, max=700611, avg=13962.87, stdev=20847.24 lat (usec): min=691, max=700613, avg=13963.76, stdev=20847.27 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1778], 10.00th=[ 2343], 20.00th=[ 2966], | 30.00th=[ 4424], 40.00th=[ 8455], 50.00th=[ 11076], 60.00th=[ 13829], | 70.00th=[ 17695], 80.00th=[ 21890], 90.00th=[ 29492], 95.00th=[ 35914], | 99.00th=[ 49546], 99.50th=[ 62129], 99.90th=[ 85459], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 47, max= 231, per=25.03%, avg=131.15, stdev=34.51, samples=94 iops : min= 11, max= 57, avg=32.43, stdev= 8.67, samples=94 lat (usec) : 50=0.16%, 100=0.42%, 250=0.72%, 750=0.10%, 1000=0.59% lat (msec) : 2=2.57%, 4=11.39%, 10=16.93%, 20=39.84%, 50=26.33% lat (msec) : 100=0.91%, 750=0.03% cpu : usr=0.13%, sys=20.51%, ctx=7948, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=501KiB/s (513kB/s), 125KiB/s-127KiB/s (128kB/s-130kB/s), io=23.4MiB (24.6MB), run=47356-47962msec WRITE: bw=524KiB/s (537kB/s), 130KiB/s-134KiB/s (133kB/s-137kB/s), io=24.6MiB (25.7MB), run=47356-47962msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Tue Sep 1 09:24:17 2026 read: IOPS=24, BW=98.1KiB/s (100kB/s)(5992KiB/61069msec) clat (msec): min=2, max=666, avg=17.29, stdev=20.65 lat (msec): min=2, max=666, avg=17.29, stdev=20.65 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 65], 99.50th=[ 70], 99.90th=[ 85], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 31, max= 232, per=25.20%, avg=98.28, stdev=46.84, samples=120 iops : min= 7, max= 58, avg=24.18, stdev=11.81, samples=120 write: IOPS=25, BW=103KiB/s (106kB/s)(6296KiB/61069msec); 0 zone resets clat (msec): min=4, max=116, avg=22.23, stdev=13.93 lat (msec): min=4, max=116, avg=22.23, stdev=13.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 72], 99.50th=[ 84], 99.90th=[ 111], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 39, max= 239, per=25.22%, avg=103.15, stdev=45.42, samples=120 iops : min= 9, max= 59, avg=25.40, stdev=11.45, samples=120 lat (msec) : 4=0.65%, 10=22.46%, 20=41.31%, 50=32.39%, 100=3.09% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=8.91%, ctx=5249, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Tue Sep 1 09:24:17 2026 read: IOPS=24, BW=96.6KiB/s (98.0kB/s)(5940KiB/61462msec) clat (msec): min=2, max=695, avg=17.25, stdev=21.42 lat (msec): min=2, max=695, avg=17.26, stdev=21.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 68], 99.90th=[ 81], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 15, max= 264, per=24.81%, avg=96.74, stdev=48.62, samples=121 iops : min= 3, max= 66, avg=23.80, stdev=12.24, samples=121 write: IOPS=25, BW=103KiB/s (106kB/s)(6348KiB/61462msec); 0 zone resets clat (msec): min=4, max=118, avg=22.47, stdev=14.58 lat (msec): min=4, max=118, avg=22.47, stdev=14.58 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 75], 99.50th=[ 91], 99.90th=[ 105], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 47, max= 280, per=25.19%, avg=103.02, stdev=46.79, samples=121 iops : min= 11, max= 70, avg=25.37, stdev=11.80, samples=121 lat (msec) : 4=0.85%, 10=22.40%, 20=41.31%, 50=31.54%, 100=3.81% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.09%, sys=8.79%, ctx=5223, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179312: Tue Sep 1 09:24:17 2026 read: IOPS=24, BW=98.4KiB/s (101kB/s)(6028KiB/61243msec) clat (usec): min=2472, max=87735, avg=16909.72, stdev=12483.31 lat (usec): min=2473, max=87736, avg=16911.18, stdev=12483.38 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 4948], 10.00th=[ 6194], 20.00th=[ 8225], | 30.00th=[ 9634], 40.00th=[11207], 50.00th=[12649], 60.00th=[14746], | 70.00th=[17957], 80.00th=[22938], 90.00th=[35390], 95.00th=[44303], | 99.00th=[60031], 99.50th=[65274], 99.90th=[83362], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 23, max= 256, per=25.16%, avg=98.14, stdev=47.62, samples=120 iops : min= 5, max= 64, avg=24.15, stdev=11.98, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6260KiB/61243msec); 0 zone resets clat (msec): min=4, max=690, avg=22.73, stdev=22.04 lat (msec): min=4, max=690, avg=22.73, stdev=22.04 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 70], 99.50th=[ 77], 99.90th=[ 111], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 39, max= 256, per=24.89%, avg=101.82, stdev=46.05, samples=120 iops : min= 9, max= 64, avg=25.07, stdev=11.61, samples=120 lat (msec) : 4=0.85%, 10=23.01%, 20=41.15%, 50=31.05%, 100=3.87% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.14%, sys=8.73%, ctx=5268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179313: Tue Sep 1 09:24:17 2026 read: IOPS=24, BW=98.8KiB/s (101kB/s)(6052KiB/61279msec) clat (usec): min=2817, max=81266, avg=17068.15, stdev=12300.67 lat (usec): min=2817, max=81267, avg=17068.87, stdev=12300.67 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 5145], 10.00th=[ 6259], 20.00th=[ 8160], | 30.00th=[ 9765], 40.00th=[11076], 50.00th=[12780], 60.00th=[14877], | 70.00th=[18220], 80.00th=[23987], 90.00th=[35914], 95.00th=[43779], | 99.00th=[58459], 99.50th=[66323], 99.90th=[77071], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 31, max= 256, per=25.50%, avg=99.45, stdev=46.58, samples=121 iops : min= 7, max= 64, avg=24.48, stdev=11.71, samples=121 write: IOPS=25, BW=102KiB/s (104kB/s)(6236KiB/61279msec); 0 zone resets clat (msec): min=4, max=698, avg=22.63, stdev=22.16 lat (msec): min=4, max=698, avg=22.63, stdev=22.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 75], 99.50th=[ 90], 99.90th=[ 105], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 39, max= 232, per=25.06%, avg=102.49, stdev=46.60, samples=121 iops : min= 9, max= 58, avg=25.24, stdev=11.76, samples=121 lat (msec) : 4=0.75%, 10=22.59%, 20=40.85%, 50=32.52%, 100=3.22% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=8.78%, ctx=5294, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=391KiB/s (400kB/s), 96.6KiB/s-98.8KiB/s (98.0kB/s-101kB/s), io=23.4MiB (24.6MB), run=61069-61462msec WRITE: bw=409KiB/s (419kB/s), 102KiB/s-103KiB/s (104kB/s-106kB/s), io=24.6MiB (25.7MB), run=61069-61462msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179339: Tue Sep 1 09:24:35 2026 read: IOPS=28, BW=452KiB/s (463kB/s)(5920KiB/13093msec) clat (usec): min=59, max=69553, avg=17817.48, stdev=9311.42 lat (usec): min=60, max=69553, avg=17818.27, stdev=9311.41 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 141], 10.00th=[ 8225], 20.00th=[11076], | 30.00th=[13042], 40.00th=[15008], 50.00th=[16909], 60.00th=[19006], | 70.00th=[21627], 80.00th=[23987], 90.00th=[27919], 95.00th=[34341], | 99.00th=[43779], 99.50th=[53740], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 255, max= 672, per=24.47%, avg=442.96, stdev=106.46, samples=25 iops : min= 15, max= 42, avg=27.20, stdev= 6.81, samples=25 write: IOPS=30, BW=486KiB/s (498kB/s)(6368KiB/13093msec); 0 zone resets clat (usec): min=1385, max=59783, avg=16258.11, stdev=11489.96 lat (usec): min=1386, max=59784, avg=16259.69, stdev=11489.77 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3228], 10.00th=[ 3982], 20.00th=[ 5080], | 30.00th=[ 8848], 40.00th=[11338], 50.00th=[13173], 60.00th=[16450], | 70.00th=[20317], 80.00th=[24773], 90.00th=[33162], 95.00th=[40109], | 99.00th=[52167], 99.50th=[59507], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 288, max= 608, per=25.24%, avg=480.88, stdev=87.01, samples=25 iops : min= 18, max= 38, avg=29.60, stdev= 5.47, samples=25 lat (usec) : 100=1.04%, 250=1.95%, 750=0.13% lat (msec) : 2=0.65%, 4=4.56%, 10=17.06%, 20=40.76%, 50=33.07% lat (msec) : 100=0.78% cpu : usr=0.11%, sys=24.71%, ctx=2473, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179340: Tue Sep 1 09:24:35 2026 read: IOPS=27, BW=437KiB/s (447kB/s)(5744KiB/13150msec) clat (usec): min=50, max=69697, avg=18688.52, stdev=9904.71 lat (usec): min=51, max=69698, avg=18689.21, stdev=9904.68 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 141], 10.00th=[ 9372], 20.00th=[11863], | 30.00th=[13435], 40.00th=[15401], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22152], 80.00th=[24773], 90.00th=[30802], 95.00th=[36963], | 99.00th=[52691], 99.50th=[54789], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 138, max= 605, per=24.24%, avg=438.65, stdev=110.76, samples=26 iops : min= 8, max= 37, avg=26.96, stdev= 7.00, samples=26 write: IOPS=31, BW=498KiB/s (510kB/s)(6544KiB/13150msec); 0 zone resets clat (usec): min=990, max=66850, avg=15441.34, stdev=11177.37 lat (usec): min=991, max=66851, avg=15442.77, stdev=11177.35 clat percentiles (usec): | 1.00th=[ 2089], 5.00th=[ 3326], 10.00th=[ 4047], 20.00th=[ 5014], | 30.00th=[ 7504], 40.00th=[10421], 50.00th=[12649], 60.00th=[15795], | 70.00th=[18744], 80.00th=[24511], 90.00th=[32637], 95.00th=[37487], | 99.00th=[44303], 99.50th=[49546], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 288, max= 768, per=26.13%, avg=497.73, stdev=129.65, samples=26 iops : min= 18, max= 48, avg=30.65, stdev= 8.13, samples=26 lat (usec) : 100=1.17%, 250=1.95%, 1000=0.13% lat (msec) : 2=0.26%, 4=4.69%, 10=17.45%, 20=41.80%, 50=31.77% lat (msec) : 100=0.78% cpu : usr=0.12%, sys=25.05%, ctx=2442, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179341: Tue Sep 1 09:24:35 2026 read: IOPS=29, BW=473KiB/s (484kB/s)(6256KiB/13227msec) clat (usec): min=35, max=49988, avg=18018.03, stdev=9244.81 lat (usec): min=36, max=49989, avg=18018.94, stdev=9244.90 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 124], 10.00th=[ 8979], 20.00th=[11469], | 30.00th=[13042], 40.00th=[14615], 50.00th=[16712], 60.00th=[19006], | 70.00th=[22152], 80.00th=[25035], 90.00th=[29492], 95.00th=[34866], | 99.00th=[45876], 99.50th=[49546], 99.90th=[50070], 99.95th=[50070], | 99.99th=[50070] bw ( KiB/s): min= 286, max= 701, per=26.26%, avg=475.35, stdev=97.34, samples=26 iops : min= 17, max= 43, avg=29.27, stdev= 6.23, samples=26 write: IOPS=28, BW=456KiB/s (467kB/s)(6032KiB/13227msec); 0 zone resets clat (usec): min=1426, max=78133, avg=16203.67, stdev=11671.12 lat (usec): min=1427, max=78134, avg=16206.51, stdev=11673.61 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 3097], 10.00th=[ 4080], 20.00th=[ 5211], | 30.00th=[ 8291], 40.00th=[10814], 50.00th=[13698], 60.00th=[16450], | 70.00th=[21627], 80.00th=[25035], 90.00th=[31327], 95.00th=[39060], | 99.00th=[55313], 99.50th=[61080], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 224, max= 640, per=23.56%, avg=448.73, stdev=104.09, samples=26 iops : min= 14, max= 40, avg=27.62, stdev= 6.46, samples=26 lat (usec) : 50=0.13%, 100=1.30%, 250=1.82% lat (msec) : 2=0.52%, 4=3.65%, 10=17.45%, 20=40.89%, 50=33.72% lat (msec) : 100=0.52% cpu : usr=0.08%, sys=24.66%, ctx=2391, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179342: Tue Sep 1 09:24:35 2026 read: IOPS=29, BW=478KiB/s (489kB/s)(6032KiB/12627msec) clat (usec): min=60, max=65386, avg=16875.14, stdev=8884.91 lat (usec): min=61, max=65387, avg=16877.20, stdev=8884.93 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 117], 10.00th=[ 8291], 20.00th=[10552], | 30.00th=[12518], 40.00th=[14222], 50.00th=[15664], 60.00th=[17695], | 70.00th=[19530], 80.00th=[22676], 90.00th=[28705], 95.00th=[33162], | 99.00th=[43779], 99.50th=[54789], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 286, max= 672, per=26.40%, avg=477.76, stdev=94.49, samples=25 iops : min= 17, max= 42, avg=29.40, stdev= 5.97, samples=25 write: IOPS=30, BW=495KiB/s (507kB/s)(6256KiB/12627msec); 0 zone resets clat (usec): min=1212, max=61909, avg=15804.13, stdev=11355.70 lat (usec): min=1213, max=61911, avg=15805.62, stdev=11355.79 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2900], 10.00th=[ 3818], 20.00th=[ 5080], | 30.00th=[ 7046], 40.00th=[10159], 50.00th=[13566], 60.00th=[16319], | 70.00th=[21365], 80.00th=[25297], 90.00th=[31851], 95.00th=[37487], | 99.00th=[46924], 99.50th=[56886], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 256, max= 796, per=26.05%, avg=496.24, stdev=119.15, samples=25 iops : min= 16, max= 49, avg=30.56, stdev= 7.30, samples=25 lat (usec) : 100=1.30%, 250=1.95% lat (msec) : 2=1.17%, 4=4.56%, 10=19.01%, 20=40.89%, 50=30.60% lat (msec) : 100=0.52% cpu : usr=0.10%, sys=25.07%, ctx=2441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1811KiB/s (1854kB/s), 437KiB/s-478KiB/s (447kB/s-489kB/s), io=23.4MiB (24.5MB), run=12627-13227msec WRITE: bw=1905KiB/s (1951kB/s), 456KiB/s-498KiB/s (467kB/s-510kB/s), io=24.6MiB (25.8MB), run=12627-13227msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179343: Tue Sep 1 09:24:37 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(5920KiB/15332msec) clat (usec): min=3281, max=79810, avg=17594.56, stdev=14503.89 lat (usec): min=3282, max=79811, avg=17595.23, stdev=14503.86 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 5014], 10.00th=[ 5604], 20.00th=[ 6718], | 30.00th=[ 7898], 40.00th=[ 9765], 50.00th=[12387], 60.00th=[14877], | 70.00th=[19268], 80.00th=[26084], 90.00th=[38011], 95.00th=[50070], | 99.00th=[66323], 99.50th=[76022], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 127, max= 896, per=24.15%, avg=373.13, stdev=218.19, samples=30 iops : min= 7, max= 56, avg=23.03, stdev=13.76, samples=30 write: IOPS=25, BW=415KiB/s (425kB/s)(6368KiB/15332msec); 0 zone resets clat (usec): min=5319, max=78641, avg=22083.03, stdev=13601.73 lat (usec): min=5320, max=78641, avg=22086.09, stdev=13600.27 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 7898], 10.00th=[ 8717], 20.00th=[10290], | 30.00th=[12649], 40.00th=[15139], 50.00th=[17433], 60.00th=[21890], | 70.00th=[26608], 80.00th=[33162], 90.00th=[41157], 95.00th=[49546], | 99.00th=[64750], 99.50th=[72877], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 1056, per=25.08%, avg=407.57, stdev=211.99, samples=30 iops : min= 10, max= 66, avg=25.20, stdev=13.36, samples=30 lat (msec) : 4=0.39%, 10=27.99%, 20=34.51%, 50=32.29%, 100=4.82% cpu : usr=0.10%, sys=9.96%, ctx=1318, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179344: Tue Sep 1 09:24:37 2026 read: IOPS=23, BW=371KiB/s (379kB/s)(5744KiB/15499msec) clat (msec): min=2, max=103, avg=17.03, stdev=14.93 lat (msec): min=2, max=103, avg=17.03, stdev=14.93 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 71], 99.50th=[ 75], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 110, max= 1056, per=22.92%, avg=354.10, stdev=226.68, samples=30 iops : min= 6, max= 66, avg=21.83, stdev=14.30, samples=30 write: IOPS=26, BW=422KiB/s (432kB/s)(6544KiB/15499msec); 0 zone resets clat (usec): min=4674, max=75742, avg=22693.81, stdev=15937.92 lat (usec): min=4675, max=75743, avg=22702.89, stdev=15937.44 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 6587], 10.00th=[ 7635], 20.00th=[ 9372], | 30.00th=[11338], 40.00th=[13173], 50.00th=[16319], 60.00th=[21103], | 70.00th=[28967], 80.00th=[36439], 90.00th=[45876], 95.00th=[56886], | 99.00th=[70779], 99.50th=[71828], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 157, max= 1152, per=24.35%, avg=395.77, stdev=231.90, samples=30 iops : min= 9, max= 72, avg=24.47, stdev=14.62, samples=30 lat (msec) : 4=1.43%, 10=30.60%, 20=32.68%, 50=29.17%, 100=5.99% lat (msec) : 250=0.13% cpu : usr=0.10%, sys=9.83%, ctx=1326, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179345: Tue Sep 1 09:24:37 2026 read: IOPS=25, BW=408KiB/s (418kB/s)(6256KiB/15321msec) clat (usec): min=4048, max=78626, avg=17210.81, stdev=14064.62 lat (usec): min=4049, max=78626, avg=17211.91, stdev=14064.51 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5145], 10.00th=[ 5538], 20.00th=[ 6849], | 30.00th=[ 8094], 40.00th=[ 9896], 50.00th=[11731], 60.00th=[14222], | 70.00th=[18220], 80.00th=[26608], 90.00th=[39060], 95.00th=[45876], | 99.00th=[71828], 99.50th=[74974], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 192, max= 1280, per=26.13%, avg=403.77, stdev=244.62, samples=30 iops : min= 12, max= 80, avg=24.97, stdev=15.39, samples=30 write: IOPS=24, BW=394KiB/s (403kB/s)(6032KiB/15321msec); 0 zone resets clat (usec): min=5292, max=81303, avg=22588.24, stdev=14685.61 lat (usec): min=5293, max=81304, avg=22589.83, stdev=14685.69 clat percentiles (usec): | 1.00th=[ 6259], 5.00th=[ 7504], 10.00th=[ 8848], 20.00th=[10159], | 30.00th=[11731], 40.00th=[14222], 50.00th=[18482], 60.00th=[22152], | 70.00th=[27657], 80.00th=[35390], 90.00th=[43254], 95.00th=[53216], | 99.00th=[65799], 99.50th=[70779], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 160, max= 1152, per=23.58%, avg=383.10, stdev=218.00, samples=30 iops : min= 10, max= 72, avg=23.67, stdev=13.77, samples=30 lat (msec) : 10=30.60%, 20=33.85%, 50=31.12%, 100=4.43% cpu : usr=0.08%, sys=10.00%, ctx=1306, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179346: Tue Sep 1 09:24:37 2026 read: IOPS=24, BW=392KiB/s (401kB/s)(6032KiB/15389msec) clat (usec): min=3530, max=69992, avg=17577.60, stdev=13817.57 lat (usec): min=3530, max=69993, avg=17578.35, stdev=13817.54 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 4752], 10.00th=[ 5669], 20.00th=[ 6652], | 30.00th=[ 8029], 40.00th=[ 9896], 50.00th=[12387], 60.00th=[15401], | 70.00th=[20317], 80.00th=[27395], 90.00th=[39584], 95.00th=[46400], | 99.00th=[64750], 99.50th=[69731], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 160, max= 1088, per=24.48%, avg=378.17, stdev=219.78, samples=30 iops : min= 10, max= 68, avg=23.37, stdev=13.83, samples=30 write: IOPS=25, BW=407KiB/s (416kB/s)(6256KiB/15389msec); 0 zone resets clat (usec): min=5441, max=89476, avg=22184.94, stdev=14345.57 lat (usec): min=5443, max=89477, avg=22186.42, stdev=14345.53 clat percentiles (usec): | 1.00th=[ 6390], 5.00th=[ 7308], 10.00th=[ 8225], 20.00th=[10159], | 30.00th=[12387], 40.00th=[14877], 50.00th=[17695], 60.00th=[21890], | 70.00th=[26084], 80.00th=[32113], 90.00th=[42206], 95.00th=[51119], | 99.00th=[68682], 99.50th=[78119], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 160, max= 1056, per=24.30%, avg=394.83, stdev=218.99, samples=30 iops : min= 10, max= 66, avg=24.40, stdev=13.79, samples=30 lat (msec) : 4=0.39%, 10=29.82%, 20=32.03%, 50=33.59%, 100=4.17% cpu : usr=0.07%, sys=9.98%, ctx=1268, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1545KiB/s (1582kB/s), 371KiB/s-408KiB/s (379kB/s-418kB/s), io=23.4MiB (24.5MB), run=15321-15499msec WRITE: bw=1626KiB/s (1665kB/s), 394KiB/s-422KiB/s (403kB/s-432kB/s), io=24.6MiB (25.8MB), run=15321-15499msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179354: Tue Sep 1 09:24:46 2026 read: IOPS=1, BW=1950KiB/s (1997kB/s)(7168KiB/3676msec) clat (msec): min=72, max=871, avg=272.42, stdev=312.79 lat (msec): min=72, max=871, avg=272.43, stdev=312.79 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 75], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 111], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 542], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1835, max= 3984, per=44.24%, avg=2361.60, stdev=910.24, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1393KiB/s (1426kB/s)(5120KiB/3676msec); 0 zone resets clat (msec): min=138, max=622, avg=346.38, stdev=201.22 lat (msec): min=138, max=622, avg=346.45, stdev=201.22 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1924, max= 4071, per=44.20%, avg=3303.33, stdev=1197.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=14.01%, ctx=249, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179355: Tue Sep 1 09:24:46 2026 read: IOPS=0, BW=555KiB/s (568kB/s)(2048KiB/3691msec) clat (msec): min=52, max=179, avg=115.91, stdev=90.03 lat (msec): min=52, max=179, avg=115.91, stdev=90.03 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 53], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1759, max= 1992, per=35.13%, avg=1875.50, stdev=164.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2774KiB/s (2841kB/s)(10.0MiB/3691msec); 0 zone resets clat (msec): min=67, max=1095, avg=343.84, stdev=322.64 lat (msec): min=67, max=1095, avg=343.94, stdev=322.71 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 73], 40.00th=[ 188], 50.00th=[ 205], 60.00th=[ 296], | 70.00th=[ 317], 80.00th=[ 558], 90.00th=[ 575], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1924, max= 5953, per=47.57%, avg=3555.40, stdev=2152.73, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.08%, sys=13.04%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179356: Tue Sep 1 09:24:46 2026 read: IOPS=1, BW=1637KiB/s (1676kB/s)(6144KiB/3753msec) clat (msec): min=37, max=544, avg=190.99, stdev=197.52 lat (msec): min=37, max=544, avg=190.99, stdev=197.52 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 54], | 30.00th=[ 54], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 115], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1924, max= 3915, per=46.21%, avg=2466.50, stdev=966.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1637KiB/s (1676kB/s)(6144KiB/3753msec); 0 zone resets clat (msec): min=107, max=1106, avg=423.06, stdev=395.42 lat (msec): min=107, max=1106, avg=423.13, stdev=395.42 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 232], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1957, max= 3524, per=31.78%, avg=2375.00, stdev=766.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=8.33%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=15.19%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179357: Tue Sep 1 09:24:46 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3836msec) clat (msec): min=17, max=484, avg=256.11, stdev=180.71 lat (msec): min=17, max=484, avg=256.12, stdev=180.71 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 18], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1992, max= 3915, per=49.59%, avg=2647.33, stdev=1098.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1869KiB/s (1913kB/s)(7168KiB/3836msec); 0 zone resets clat (msec): min=61, max=1083, avg=358.18, stdev=376.14 lat (msec): min=61, max=1083, avg=358.25, stdev=376.14 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 66], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 207], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 575], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1768, max= 1992, per=25.76%, avg=1925.00, stdev=91.71, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 20=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=15.15%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5339KiB/s (5467kB/s), 555KiB/s-1950KiB/s (568kB/s-1997kB/s), io=20.0MiB (20.0MB), run=3676-3836msec WRITE: bw=7474KiB/s (7654kB/s), 1393KiB/s-2774KiB/s (1426kB/s-2841kB/s), io=28.0MiB (29.4MB), run=3676-3836msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179358: Tue Sep 1 09:24:46 2026 read: IOPS=2, BW=2765KiB/s (2832kB/s)(7168KiB/2592msec) clat (msec): min=101, max=872, avg=234.27, stdev=282.27 lat (msec): min=101, max=872, avg=234.27, stdev=282.27 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 103], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 153], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1738, max= 6144, per=61.18%, avg=3310.00, stdev=2459.21, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=1, BW=1975KiB/s (2023kB/s)(5120KiB/2592msec); 0 zone resets clat (msec): min=158, max=250, avg=187.02, stdev=37.37 lat (msec): min=158, max=250, avg=187.10, stdev=37.41 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 2048, max= 4096, per=40.55%, avg=3072.00, stdev=1448.15, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 lat (msec) : 250=83.33%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=51.64%, ctx=1737, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Tue Sep 1 09:24:46 2026 read: IOPS=0, BW=541KiB/s (554kB/s)(2048KiB/3785msec) clat (msec): min=109, max=216, avg=163.05, stdev=76.13 lat (msec): min=109, max=216, avg=163.05, stdev=76.13 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1768, max= 1935, per=34.22%, avg=1851.50, stdev=118.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2705KiB/s (2770kB/s)(10.0MiB/3785msec); 0 zone resets clat (msec): min=92, max=1109, avg=338.51, stdev=316.60 lat (msec): min=92, max=1109, avg=338.58, stdev=316.60 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 146], | 30.00th=[ 159], 40.00th=[ 167], 50.00th=[ 171], 60.00th=[ 180], | 70.00th=[ 271], 80.00th=[ 506], 90.00th=[ 592], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 2031, max= 4096, per=42.03%, avg=3183.40, stdev=1048.28, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.14, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.05%, sys=37.92%, ctx=470, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179360: Tue Sep 1 09:24:46 2026 read: IOPS=1, BW=1814KiB/s (1858kB/s)(6144KiB/3387msec) clat (usec): min=347, max=372069, avg=82581.78, stdev=149885.71 lat (usec): min=348, max=372070, avg=82582.69, stdev=149885.81 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 429], | 30.00th=[ 429], 40.00th=[ 469], 50.00th=[ 469], 60.00th=[ 478], | 70.00th=[122160], 80.00th=[122160], 90.00th=[371196], 95.00th=[371196], | 99.00th=[371196], 99.50th=[371196], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 2031, max= 4096, per=61.60%, avg=3332.67, stdev=1132.88, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1814KiB/s (1858kB/s)(6144KiB/3387msec); 0 zone resets clat (msec): min=123, max=1195, avg=470.06, stdev=437.26 lat (msec): min=123, max=1195, avg=470.12, stdev=437.26 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 309], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1935, max= 4063, per=38.13%, avg=2888.00, stdev=1060.87, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 500=33.33% lat (msec) : 250=33.33%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=27.05%, ctx=542, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179361: Tue Sep 1 09:24:46 2026 read: IOPS=1, BW=1582KiB/s (1620kB/s)(5120KiB/3237msec) clat (usec): min=418, max=161384, avg=32679.45, stdev=71948.58 lat (usec): min=419, max=161385, avg=32680.28, stdev=71948.68 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 424], 40.00th=[ 424], 50.00th=[ 570], 60.00th=[ 570], | 70.00th=[ 594], 80.00th=[ 594], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 7742, max= 7742, per=100.00%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2214KiB/s (2268kB/s)(7168KiB/3237msec); 0 zone resets clat (msec): min=141, max=982, avg=426.99, stdev=328.48 lat (msec): min=141, max=982, avg=427.05, stdev=328.48 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 144], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 313], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 785], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1771, max= 4063, per=38.79%, avg=2938.25, stdev=1195.84, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 500=16.67%, 750=16.67% lat (msec) : 250=33.33%, 500=16.67%, 1000=16.67% cpu : usr=0.00%, sys=30.41%, ctx=171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5411KiB/s (5541kB/s), 541KiB/s-2765KiB/s (554kB/s-2832kB/s), io=20.0MiB (20.0MB), run=2592-3785msec WRITE: bw=7575KiB/s (7757kB/s), 1814KiB/s-2705KiB/s (1858kB/s-2770kB/s), io=28.0MiB (29.4MB), run=2592-3785msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179372: Tue Sep 1 09:24:55 2026 read: IOPS=1, BW=8016KiB/s (8208kB/s)(12.0MiB/1533msec) clat (msec): min=167, max=780, avg=502.06, stdev=309.96 lat (msec): min=167, max=780, avg=502.06, stdev=309.96 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 5657, max= 5657, per=60.60%, avg=5657.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.91%, ctx=289, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179373: Tue Sep 1 09:24:55 2026 read: IOPS=0, BW=2334KiB/s (2390kB/s)(4096KiB/1755msec) clat (nsec): min=392292k, max=392292k, avg=392292036.00, stdev= 0.00 lat (nsec): min=392294k, max=392294k, avg=392294394.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 5557, max= 5557, per=59.53%, avg=5557.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4668KiB/s (4780kB/s)(8192KiB/1755msec); 0 zone resets clat (msec): min=562, max=760, avg=661.57, stdev=139.42 lat (msec): min=563, max=760, avg=661.84, stdev=139.41 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=44.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.02%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179374: Tue Sep 1 09:24:55 2026 write: IOPS=1, BW=6950KiB/s (7117kB/s)(12.0MiB/1768msec); 0 zone resets clat (msec): min=138, max=820, avg=576.25, stdev=379.95 lat (msec): min=138, max=820, avg=576.53, stdev=379.96 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7984, max= 8192, per=43.64%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.34%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179375: Tue Sep 1 09:24:55 2026 write: IOPS=1, BW=8165KiB/s (8361kB/s)(12.0MiB/1505msec); 0 zone resets clat (msec): min=439, max=586, avg=495.04, stdev=79.54 lat (msec): min=439, max=586, avg=495.37, stdev=79.54 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 5417, max= 8192, per=36.72%, avg=6804.50, stdev=1962.22, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=25.93%, ctx=103, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9336KiB/s (9560kB/s), 2334KiB/s-8016KiB/s (2390kB/s-8208kB/s), io=16.0MiB (16.8MB), run=1533-1755msec WRITE: bw=18.1MiB/s (18.0MB/s), 4668KiB/s-8165KiB/s (4780kB/s-8361kB/s), io=32.0MiB (33.6MB), run=1505-1768msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179367: Tue Sep 1 09:24:55 2026 read: IOPS=2, BW=8611KiB/s (8818kB/s)(12.0MiB/1427msec) clat (msec): min=373, max=591, avg=447.59, stdev=124.50 lat (msec): min=373, max=591, avg=447.59, stdev=124.50 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8078, max= 8078, per=80.76%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=52.10%, ctx=2659, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Tue Sep 1 09:24:55 2026 read: IOPS=0, BW=2501KiB/s (2561kB/s)(4096KiB/1638msec) clat (nsec): min=364199k, max=364199k, avg=364199191.00, stdev= 0.00 lat (nsec): min=364202k, max=364202k, avg=364201582.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 5512, max= 5512, per=55.11%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5001KiB/s (5121kB/s)(8192KiB/1638msec); 0 zone resets clat (msec): min=416, max=777, avg=596.90, stdev=255.43 lat (msec): min=416, max=778, avg=597.48, stdev=255.91 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=49.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=21.01%, ctx=1015, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Tue Sep 1 09:24:55 2026 write: IOPS=1, BW=6153KiB/s (6301kB/s)(12.0MiB/1997msec); 0 zone resets clat (msec): min=70, max=1047, avg=633.27, stdev=505.37 lat (msec): min=70, max=1048, avg=633.53, stdev=505.46 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8126, per=49.52%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.07%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179371: Tue Sep 1 09:24:55 2026 write: IOPS=2, BW=9122KiB/s (9341kB/s)(12.0MiB/1347msec); 0 zone resets clat (msec): min=279, max=709, avg=424.98, stdev=246.00 lat (msec): min=279, max=709, avg=425.32, stdev=245.99 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min=10995, max=10995, per=67.01%, avg=10995.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.15%, sys=21.77%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.77MiB/s (10.2MB/s), 2501KiB/s-8611KiB/s (2561kB/s-8818kB/s), io=16.0MiB (16.8MB), run=1427-1638msec WRITE: bw=16.0MiB/s (16.8MB/s), 5001KiB/s-9122KiB/s (5121kB/s-9341kB/s), io=32.0MiB (33.6MB), run=1347-1997msec