== sanity test 398b: DIO and buffer IO race ============== 02:14:23 (1790662463) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.46493 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=175403: Tue Sep 29 02:17:05 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5992KiB/140963msec) clat (usec): min=35, max=889381, avg=42813.46, stdev=41276.09 lat (usec): min=35, max=889383, avg=42822.31, stdev=41276.83 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 80], 20.00th=[ 17433], | 30.00th=[ 23200], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 52167], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[162530], 99.50th=[212861], 99.90th=[333448], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 120, per=25.30%, avg=42.50, stdev=20.60, samples=275 iops : min= 1, max= 30, avg= 9.98, stdev= 5.21, samples=275 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6296KiB/140963msec); 0 zone resets clat (usec): min=987, max=480547, avg=48688.86, stdev=54857.21 lat (usec): min=988, max=480547, avg=48692.48, stdev=54856.00 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1369], 10.00th=[ 2057], 20.00th=[ 4948], | 30.00th=[ 10290], 40.00th=[ 20579], 50.00th=[ 33162], 60.00th=[ 45351], | 70.00th=[ 61604], 80.00th=[ 84411], 90.00th=[116917], 95.00th=[147850], | 99.00th=[248513], 99.50th=[320865], 99.90th=[425722], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 126, per=25.46%, avg=44.82, stdev=20.60, samples=274 iops : min= 1, max= 31, avg=10.56, stdev= 5.19, samples=274 lat (usec) : 50=0.62%, 100=5.21%, 250=0.49%, 500=0.07%, 750=0.23% lat (usec) : 1000=0.13% lat (msec) : 2=4.92%, 4=3.91%, 10=6.54%, 20=9.67%, 50=33.82% lat (msec) : 100=24.32%, 250=9.51%, 500=0.55%, 1000=0.03% cpu : usr=0.09%, sys=5.21%, ctx=6447, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175404: Tue Sep 29 02:17:05 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(5940KiB/141923msec) clat (usec): min=30, max=793995, avg=45375.28, stdev=40808.67 lat (usec): min=31, max=793999, avg=45377.33, stdev=40808.47 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 76], 20.00th=[ 18220], | 30.00th=[ 25035], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[154141], 99.50th=[185598], 99.90th=[316670], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 117, per=25.06%, avg=42.11, stdev=19.48, samples=275 iops : min= 1, max= 29, avg= 9.88, stdev= 4.91, samples=275 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6348KiB/141923msec); 0 zone resets clat (usec): min=1007, max=481192, avg=46849.45, stdev=50751.63 lat (usec): min=1008, max=481194, avg=46851.55, stdev=50751.77 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1631], 20.00th=[ 4490], | 30.00th=[ 8979], 40.00th=[ 19530], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 60031], 80.00th=[ 82314], 90.00th=[116917], 95.00th=[145753], | 99.00th=[208667], 99.50th=[270533], 99.90th=[367002], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=44.56, stdev=20.72, samples=278 iops : min= 1, max= 29, avg=10.50, stdev= 5.23, samples=278 lat (usec) : 50=0.62%, 100=5.27%, 250=0.68%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.25%, 4=3.52%, 10=7.19%, 20=7.94%, 50=32.68% lat (msec) : 100=24.51%, 250=10.90%, 500=0.29%, 1000=0.03% cpu : usr=0.09%, sys=5.40%, ctx=6439, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175405: Tue Sep 29 02:17:05 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6028KiB/142408msec) clat (usec): min=34, max=289998, avg=43547.25, stdev=35867.02 lat (usec): min=35, max=290000, avg=43551.42, stdev=35871.11 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 88], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 53740], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[168821], 99.50th=[202376], 99.90th=[283116], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 111, per=25.48%, avg=42.80, stdev=19.12, samples=275 iops : min= 1, max= 27, avg=10.05, stdev= 4.83, samples=275 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6260KiB/142408msec); 0 zone resets clat (usec): min=1014, max=958132, avg=48915.71, stdev=54384.50 lat (usec): min=1014, max=958134, avg=48920.71, stdev=54382.65 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 2147], 20.00th=[ 5080], | 30.00th=[ 10159], 40.00th=[ 23987], 50.00th=[ 35914], 60.00th=[ 49546], | 70.00th=[ 64226], 80.00th=[ 83362], 90.00th=[109577], 95.00th=[143655], | 99.00th=[214959], 99.50th=[261096], 99.90th=[392168], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 103, per=24.77%, avg=43.60, stdev=19.81, samples=280 iops : min= 1, max= 25, avg=10.26, stdev= 4.97, samples=280 lat (usec) : 50=0.72%, 100=4.62%, 250=0.52%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=4.95%, 4=3.42%, 10=7.23%, 20=8.69%, 50=32.78% lat (msec) : 100=26.73%, 250=9.60%, 500=0.39%, 1000=0.03% cpu : usr=0.09%, sys=5.24%, ctx=6552, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175406: Tue Sep 29 02:17:05 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6052KiB/141180msec) clat (usec): min=33, max=288336, avg=42234.19, stdev=35211.62 lat (usec): min=33, max=288337, avg=42236.08, stdev=35211.64 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 73], 20.00th=[ 16909], | 30.00th=[ 22938], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 52167], 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[164627], 99.50th=[196084], 99.90th=[235930], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 111, per=25.54%, avg=42.91, stdev=19.88, samples=274 iops : min= 1, max= 27, avg=10.08, stdev= 5.02, samples=274 write: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6236KiB/141180msec); 0 zone resets clat (usec): min=977, max=871529, avg=49434.62, stdev=56888.35 lat (usec): min=979, max=871532, avg=49436.70, stdev=56888.31 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 2057], 20.00th=[ 5014], | 30.00th=[ 9765], 40.00th=[ 22414], 50.00th=[ 35914], 60.00th=[ 49546], | 70.00th=[ 63701], 80.00th=[ 82314], 90.00th=[112722], 95.00th=[145753], | 99.00th=[250610], 99.50th=[308282], 99.90th=[497026], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 111, per=24.91%, avg=43.84, stdev=19.73, samples=276 iops : min= 1, max= 27, avg=10.32, stdev= 4.99, samples=276 lat (usec) : 50=0.91%, 100=5.11%, 250=0.29%, 500=0.29%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=4.92%, 4=3.74%, 10=7.10%, 20=8.92%, 50=32.45% lat (msec) : 100=25.98%, 250=9.47%, 500=0.49%, 1000=0.03% cpu : usr=0.07%, sys=5.31%, ctx=6517, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (173kB/s), 41.9KiB/s-42.9KiB/s (42.9kB/s-43.9kB/s), io=23.4MiB (24.6MB), run=140963-142408msec WRITE: bw=177KiB/s (181kB/s), 43.0KiB/s-44.7KiB/s (45.0kB/s-45.8kB/s), io=24.6MiB (25.7MB), run=140963-142408msec rand-rw: (groupid=0, jobs=1): err= 0: pid=175398: Tue Sep 29 02:19:45 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(5992KiB/302789msec) clat (msec): min=4, max=1003, avg=42.39, stdev=47.96 lat (msec): min=4, max=1003, avg=42.40, stdev=47.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 426], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 95, per=29.11%, avg=23.00, stdev=15.22, samples=501 iops : min= 1, max= 23, avg= 5.11, stdev= 3.85, samples=501 write: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6296KiB/302789msec); 0 zone resets clat (msec): min=40, max=747, avg=151.73, stdev=84.68 lat (msec): min=40, max=747, avg=151.74, stdev=84.68 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 171], 80.00th=[ 207], 90.00th=[ 255], 95.00th=[ 313], | 99.00th=[ 464], 99.50th=[ 527], 99.90th=[ 684], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 48, per=25.02%, avg=20.77, stdev=10.28, samples=580 iops : min= 1, max= 12, avg= 4.55, stdev= 2.64, samples=580 lat (msec) : 10=2.38%, 20=12.34%, 50=22.66%, 100=23.21%, 250=33.59% lat (msec) : 500=5.50%, 750=0.29%, 2000=0.03% cpu : usr=0.05%, sys=1.21%, ctx=5581, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175399: Tue Sep 29 02:19:45 2026 read: IOPS=4, BW=19.7KiB/s (20.1kB/s)(5940KiB/301856msec) clat (msec): min=5, max=894, avg=41.69, stdev=45.64 lat (msec): min=5, max=894, avg=41.70, stdev=45.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 205], 99.50th=[ 253], 99.90th=[ 414], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 96, per=29.34%, avg=23.18, stdev=15.72, samples=493 iops : min= 1, max= 24, avg= 5.16, stdev= 3.98, samples=493 write: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6348KiB/301856msec); 0 zone resets clat (msec): min=39, max=682, avg=150.92, stdev=80.72 lat (msec): min=39, max=682, avg=150.93, stdev=80.72 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 174], 80.00th=[ 207], 90.00th=[ 259], 95.00th=[ 313], | 99.00th=[ 426], 99.50th=[ 489], 99.90th=[ 634], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 47, per=25.05%, avg=20.79, stdev=10.39, samples=585 iops : min= 1, max= 11, avg= 4.55, stdev= 2.65, samples=585 lat (msec) : 10=2.25%, 20=13.41%, 50=21.81%, 100=22.59%, 250=33.95% lat (msec) : 500=5.76%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5547, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175400: Tue Sep 29 02:19:45 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6028KiB/302626msec) clat (msec): min=5, max=565, avg=42.43, stdev=41.88 lat (msec): min=5, max=565, avg=42.43, stdev=41.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 184], 99.50th=[ 251], 99.90th=[ 435], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 95, per=28.95%, avg=22.87, stdev=15.36, samples=507 iops : min= 1, max= 23, avg= 5.08, stdev= 3.89, samples=507 write: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6260KiB/302626msec); 0 zone resets clat (msec): min=35, max=1066, avg=152.23, stdev=84.89 lat (msec): min=35, max=1066, avg=152.24, stdev=84.89 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 268], 95.00th=[ 313], | 99.00th=[ 439], 99.50th=[ 477], 99.90th=[ 558], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 56, per=24.69%, avg=20.50, stdev=10.46, samples=585 iops : min= 1, max= 14, avg= 4.48, stdev= 2.67, samples=585 lat (msec) : 10=2.54%, 20=12.11%, 50=22.17%, 100=23.80%, 250=32.71% lat (msec) : 500=6.48%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5501, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175401: Tue Sep 29 02:19:45 2026 read: IOPS=5, BW=20.0KiB/s (20.5kB/s)(6052KiB/302389msec) clat (msec): min=5, max=437, avg=41.82, stdev=39.59 lat (msec): min=5, max=437, avg=41.82, stdev=39.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 120], | 99.00th=[ 199], 99.50th=[ 209], 99.90th=[ 422], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 111, per=29.38%, avg=23.21, stdev=16.60, samples=502 iops : min= 1, max= 27, avg= 5.17, stdev= 4.18, samples=502 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6236KiB/302389msec); 0 zone resets clat (msec): min=35, max=973, avg=153.11, stdev=86.26 lat (msec): min=35, max=973, avg=153.11, stdev=86.26 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 264], 95.00th=[ 321], | 99.00th=[ 456], 99.50th=[ 498], 99.90th=[ 751], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 55, per=24.69%, avg=20.49, stdev=10.14, samples=582 iops : min= 1, max= 13, avg= 4.48, stdev= 2.60, samples=582 lat (msec) : 10=1.99%, 20=12.70%, 50=22.88%, 100=22.33%, 250=34.21% lat (msec) : 500=5.66%, 750=0.16%, 1000=0.07% cpu : usr=0.05%, sys=1.19%, ctx=5564, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=79.3KiB/s (81.2kB/s), 19.7KiB/s-20.0KiB/s (20.1kB/s-20.5kB/s), io=23.4MiB (24.6MB), run=301856-302789msec WRITE: bw=83.0KiB/s (85.0kB/s), 20.6KiB/s-21.0KiB/s (21.1kB/s-21.5kB/s), io=24.6MiB (25.7MB), run=301856-302789msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=175467: Tue Sep 29 02:20:25 2026 read: IOPS=12, BW=205KiB/s (209kB/s)(5920KiB/28948msec) clat (usec): min=37, max=217141, avg=38880.59, stdev=32594.05 lat (usec): min=38, max=217142, avg=38882.35, stdev=32593.83 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 110], | 30.00th=[ 21627], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 66323], 90.00th=[ 79168], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[160433], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 440, per=25.98%, avg=207.55, stdev=87.21, samples=55 iops : min= 1, max= 27, avg=12.25, stdev= 5.51, samples=55 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28948msec); 0 zone resets clat (usec): min=1442, max=339845, avg=35988.40, stdev=39800.66 lat (usec): min=1444, max=339848, avg=35993.28, stdev=39799.35 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2474], 10.00th=[ 3294], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[ 12125], 50.00th=[ 18220], 60.00th=[ 29754], | 70.00th=[ 46400], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[158335], 99.50th=[164627], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 62, max= 565, per=26.21%, avg=220.39, stdev=99.96, samples=56 iops : min= 3, max= 35, avg=13.05, stdev= 6.32, samples=56 lat (usec) : 50=1.30%, 100=7.94%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=1.82%, 4=5.21%, 10=12.11%, 20=10.42%, 50=30.21% lat (msec) : 100=23.57%, 250=5.60%, 500=0.13% cpu : usr=0.06%, sys=6.63%, ctx=1526, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175468: Tue Sep 29 02:20:25 2026 read: IOPS=11, BW=192KiB/s (196kB/s)(5744KiB/29945msec) clat (usec): min=38, max=253200, avg=43276.25, stdev=36837.20 lat (usec): min=39, max=253201, avg=43278.30, stdev=36837.32 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 78], 20.00th=[ 12649], | 30.00th=[ 25035], 40.00th=[ 31065], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[115868], | 99.00th=[189793], 99.50th=[214959], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 352, per=23.94%, avg=191.28, stdev=73.51, samples=58 iops : min= 1, max= 22, avg=11.21, stdev= 4.69, samples=58 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29945msec); 0 zone resets clat (usec): min=1610, max=233296, avg=34979.84, stdev=36989.28 lat (usec): min=1613, max=233297, avg=34983.50, stdev=36989.51 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2900], 10.00th=[ 4883], 20.00th=[ 6783], | 30.00th=[ 9765], 40.00th=[ 15401], 50.00th=[ 20841], 60.00th=[ 32375], | 70.00th=[ 44827], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[181404], 99.50th=[204473], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 440, per=25.60%, avg=215.33, stdev=94.22, samples=58 iops : min= 3, max= 27, avg=12.72, stdev= 5.95, samples=58 lat (usec) : 50=1.04%, 100=5.47%, 250=1.69%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=2.34%, 10=12.63%, 20=11.98%, 50=32.68% lat (msec) : 100=23.96%, 250=5.86%, 500=0.13% cpu : usr=0.10%, sys=6.47%, ctx=1563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175469: Tue Sep 29 02:20:25 2026 read: IOPS=13, BW=216KiB/s (222kB/s)(6256KiB/28913msec) clat (usec): min=37, max=211591, avg=38307.37, stdev=33033.38 lat (usec): min=37, max=211593, avg=38309.35, stdev=33033.69 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 106], | 30.00th=[ 21103], 40.00th=[ 27657], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[175113], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 63, max= 510, per=27.33%, avg=218.39, stdev=92.39, samples=56 iops : min= 3, max= 31, avg=12.93, stdev= 5.83, samples=56 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28913msec); 0 zone resets clat (usec): min=1462, max=297246, avg=36411.49, stdev=40505.56 lat (usec): min=1465, max=297248, avg=36427.84, stdev=40502.32 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2089], 10.00th=[ 3621], 20.00th=[ 6259], | 30.00th=[ 8455], 40.00th=[ 12649], 50.00th=[ 22152], 60.00th=[ 32637], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[154141], 99.50th=[270533], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 63, max= 443, per=25.08%, avg=210.91, stdev=80.21, samples=55 iops : min= 3, max= 27, avg=12.45, stdev= 5.07, samples=55 lat (usec) : 50=0.91%, 100=8.98%, 250=1.95%, 500=0.52%, 750=0.13% lat (msec) : 2=2.34%, 4=3.78%, 10=11.59%, 20=8.46%, 50=31.51% lat (msec) : 100=24.35%, 250=5.21%, 500=0.26% cpu : usr=0.11%, sys=6.49%, ctx=1508, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175470: Tue Sep 29 02:20:25 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27958msec) clat (usec): min=35, max=184064, avg=37584.54, stdev=32487.69 lat (usec): min=35, max=184065, avg=37586.06, stdev=32487.66 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 87], | 30.00th=[ 19006], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[126354], 99.50th=[147850], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 416, per=26.92%, avg=215.09, stdev=86.37, samples=54 iops : min= 1, max= 26, avg=12.70, stdev= 5.50, samples=54 write: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27958msec); 0 zone resets clat (usec): min=1403, max=217560, avg=34808.97, stdev=36236.11 lat (usec): min=1405, max=217564, avg=34820.48, stdev=36229.92 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2606], 10.00th=[ 4146], 20.00th=[ 7046], | 30.00th=[ 10159], 40.00th=[ 14877], 50.00th=[ 21365], 60.00th=[ 30540], | 70.00th=[ 40633], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[173016], 99.50th=[200279], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 92, max= 410, per=26.61%, avg=223.78, stdev=75.35, samples=54 iops : min= 5, max= 25, avg=13.28, stdev= 4.74, samples=54 lat (usec) : 50=1.30%, 100=9.38%, 250=1.69%, 500=0.39% lat (msec) : 2=1.82%, 4=3.52%, 10=10.42%, 20=11.85%, 50=32.42% lat (msec) : 100=21.61%, 250=5.60% cpu : usr=0.11%, sys=6.57%, ctx=1500, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=800KiB/s (819kB/s), 192KiB/s-216KiB/s (196kB/s-222kB/s), io=23.4MiB (24.5MB), run=27958-29945msec WRITE: bw=842KiB/s (862kB/s), 209KiB/s-224KiB/s (214kB/s-229kB/s), io=24.6MiB (25.8MB), run=27958-29945msec rand-rw: (groupid=0, jobs=1): err= 0: pid=175472: Tue Sep 29 02:21:09 2026 read: IOPS=5, BW=80.0KiB/s (82.9kB/s)(5920KiB/73109msec) clat (msec): min=6, max=327, avg=38.06, stdev=36.79 lat (msec): min=6, max=327, avg=38.06, stdev=36.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 161], 99.50th=[ 271], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 319, per=28.19%, avg=92.18, stdev=62.85, samples=125 iops : min= 1, max= 19, avg= 4.96, stdev= 3.99, samples=125 write: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6368KiB/73109msec); 0 zone resets clat (msec): min=40, max=421, avg=148.02, stdev=66.50 lat (msec): min=40, max=421, avg=148.02, stdev=66.50 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 243], 95.00th=[ 292], | 99.00th=[ 372], 99.50th=[ 388], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 160, per=25.45%, avg=87.54, stdev=36.60, samples=142 iops : min= 1, max= 10, avg= 4.65, stdev= 2.34, samples=142 lat (msec) : 10=1.56%, 20=14.58%, 50=22.40%, 100=20.44%, 250=36.07% lat (msec) : 500=4.95% cpu : usr=0.03%, sys=1.21%, ctx=1285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175473: Tue Sep 29 02:21:09 2026 read: IOPS=4, BW=78.6KiB/s (80.5kB/s)(5744KiB/73097msec) clat (msec): min=6, max=330, avg=39.64, stdev=41.21 lat (msec): min=6, max=330, avg=39.65, stdev=41.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 116], | 99.00th=[ 255], 99.50th=[ 321], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 319, per=27.20%, avg=88.94, stdev=59.12, samples=126 iops : min= 1, max= 19, avg= 4.75, stdev= 3.73, samples=126 write: IOPS=5, BW=89.5KiB/s (91.7kB/s)(6544KiB/73097msec); 0 zone resets clat (msec): min=36, max=442, avg=143.68, stdev=66.59 lat (msec): min=36, max=442, avg=143.69, stdev=66.59 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 192, per=26.61%, avg=91.54, stdev=38.71, samples=140 iops : min= 1, max= 12, avg= 4.91, stdev= 2.49, samples=140 lat (msec) : 10=1.04%, 20=12.89%, 50=24.35%, 100=20.18%, 250=37.11% lat (msec) : 500=4.43% cpu : usr=0.05%, sys=1.31%, ctx=1372, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175474: Tue Sep 29 02:21:09 2026 read: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6256KiB/70340msec) clat (msec): min=7, max=305, avg=36.77, stdev=38.44 lat (msec): min=7, max=305, avg=36.77, stdev=38.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 71], 95.00th=[ 116], | 99.00th=[ 247], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 382, per=29.26%, avg=95.69, stdev=67.62, samples=129 iops : min= 1, max= 23, avg= 5.16, stdev= 4.29, samples=129 write: IOPS=5, BW=85.8KiB/s (87.8kB/s)(6032KiB/70340msec); 0 zone resets clat (msec): min=48, max=504, avg=148.12, stdev=67.20 lat (msec): min=49, max=504, avg=148.12, stdev=67.19 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 241], 95.00th=[ 275], | 99.00th=[ 380], 99.50th=[ 451], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 30, max= 189, per=24.92%, avg=85.73, stdev=35.97, samples=138 iops : min= 1, max= 11, avg= 4.54, stdev= 2.28, samples=138 lat (msec) : 10=1.56%, 20=15.76%, 50=25.13%, 100=17.19%, 250=35.94% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.06%, sys=1.42%, ctx=1388, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175475: Tue Sep 29 02:21:09 2026 read: IOPS=5, BW=83.3KiB/s (85.3kB/s)(6032KiB/72414msec) clat (msec): min=7, max=390, avg=36.85, stdev=40.17 lat (msec): min=7, max=390, avg=36.85, stdev=40.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 321], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 318, per=30.64%, avg=100.21, stdev=60.45, samples=117 iops : min= 1, max= 19, avg= 5.49, stdev= 3.79, samples=117 write: IOPS=5, BW=86.4KiB/s (88.5kB/s)(6256KiB/72414msec); 0 zone resets clat (msec): min=35, max=447, avg=149.41, stdev=66.51 lat (msec): min=35, max=447, avg=149.42, stdev=66.51 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 83], 20.00th=[ 100], | 30.00th=[ 111], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 284], | 99.00th=[ 355], 99.50th=[ 388], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 188, per=25.39%, avg=87.35, stdev=35.48, samples=140 iops : min= 1, max= 11, avg= 4.67, stdev= 2.24, samples=140 lat (msec) : 10=1.56%, 20=15.23%, 50=23.70%, 100=16.15%, 250=38.54% lat (msec) : 500=4.82% cpu : usr=0.05%, sys=1.34%, ctx=1362, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=328KiB/s (335kB/s), 78.6KiB/s-88.9KiB/s (80.5kB/s-91.1kB/s), io=23.4MiB (24.5MB), run=70340-73109msec WRITE: bw=345KiB/s (353kB/s), 85.8KiB/s-89.5KiB/s (87.8kB/s-91.7kB/s), io=24.6MiB (25.8MB), run=70340-73109msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=175492: Tue Sep 29 02:21:25 2026 read: IOPS=2, BW=2542KiB/s (2603kB/s)(7168KiB/2820msec) clat (msec): min=76, max=240, avg=127.56, stdev=54.40 lat (msec): min=76, max=240, avg=127.56, stdev=54.40 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 142], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 2039, max= 4156, per=100.00%, avg=3406.00, stdev=1185.72, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1816KiB/s (1859kB/s)(5120KiB/2820msec); 0 zone resets clat (msec): min=218, max=514, avg=377.04, stdev=131.77 lat (msec): min=218, max=515, avg=377.20, stdev=131.82 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1385, max= 4079, per=50.36%, avg=2360.00, stdev=1180.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=7.24%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175493: Tue Sep 29 02:21:25 2026 read: IOPS=0, BW=335KiB/s (343kB/s)(2048KiB/6118msec) clat (msec): min=83, max=196, avg=140.15, stdev=79.59 lat (msec): min=83, max=196, avg=140.15, stdev=79.59 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1389, max= 1996, per=50.57%, avg=1692.50, stdev=429.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1674KiB/s (1714kB/s)(10.0MiB/6118msec); 0 zone resets clat (msec): min=243, max=1986, avg=574.95, stdev=520.10 lat (msec): min=243, max=1986, avg=575.06, stdev=520.11 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 264], | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 418], 60.00th=[ 502], | 70.00th=[ 510], 80.00th=[ 558], 90.00th=[ 718], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1389, max= 4063, per=46.80%, avg=2193.00, stdev=787.01, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=4.77%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175494: Tue Sep 29 02:21:25 2026 read: IOPS=0, BW=1018KiB/s (1043kB/s)(6144KiB/6033msec) clat (msec): min=96, max=606, avg=238.90, stdev=196.13 lat (msec): min=96, max=606, avg=238.90, stdev=196.13 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 190], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1996, max= 4079, per=75.66%, avg=2532.25, stdev=1031.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1018KiB/s (1043kB/s)(6144KiB/6033msec); 0 zone resets clat (msec): min=250, max=2266, avg=757.38, stdev=782.78 lat (msec): min=250, max=2266, avg=757.54, stdev=782.73 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 372], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1456, max= 2043, per=40.96%, avg=1919.50, stdev=228.21, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.86%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175495: Tue Sep 29 02:21:25 2026 read: IOPS=0, BW=961KiB/s (984kB/s)(5120KiB/5326msec) clat (msec): min=97, max=224, avg=180.46, stdev=51.47 lat (msec): min=97, max=224, avg=180.47, stdev=51.47 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 3961, max= 4079, per=100.00%, avg=4020.00, stdev=83.44, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1346KiB/s (1378kB/s)(7168KiB/5326msec); 0 zone resets clat (msec): min=133, max=2509, avg=620.72, stdev=843.31 lat (msec): min=133, max=2509, avg=620.82, stdev=843.31 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 142], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 405], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 468], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1980, max= 4063, per=55.00%, avg=2577.20, stdev=899.92, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.15%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3347KiB/s (3428kB/s), 335KiB/s-2542KiB/s (343kB/s-2603kB/s), io=20.0MiB (20.0MB), run=2820-6118msec WRITE: bw=4686KiB/s (4799kB/s), 1018KiB/s-1816KiB/s (1043kB/s-1859kB/s), io=28.0MiB (29.4MB), run=2820-6118msec rand-rw: (groupid=0, jobs=1): err= 0: pid=175497: Tue Sep 29 02:21:25 2026 read: IOPS=1, BW=1336KiB/s (1368kB/s)(7168KiB/5365msec) clat (usec): min=994, max=3370.5k, avg=613642.51, stdev=1229719.26 lat (usec): min=995, max=3370.5k, avg=613643.77, stdev=1229719.28 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 996], 10.00th=[ 996], | 20.00th=[ 1336], 30.00th=[ 2008], 40.00th=[ 2008], | 50.00th=[ 175113], 60.00th=[ 231736], 70.00th=[ 231736], | 80.00th=[ 513803], 90.00th=[3372221], 95.00th=[3372221], | 99.00th=[3372221], 99.50th=[3372221], 99.90th=[3372221], | 99.95th=[3372221], 99.99th=[3372221] bw ( KiB/s): min= 1706, max= 4087, per=68.69%, avg=2384.40, stdev=962.90, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=954KiB/s (977kB/s)(5120KiB/5365msec); 0 zone resets clat (msec): min=83, max=453, avg=212.75, stdev=145.19 lat (msec): min=84, max=453, avg=213.19, stdev=145.01 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2043, max= 6131, per=84.09%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=41.67%, 500=8.33% lat (msec) : 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.94%, ctx=422, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175498: Tue Sep 29 02:21:25 2026 read: IOPS=0, BW=347KiB/s (356kB/s)(2048KiB/5899msec) clat (usec): min=834, max=221950, avg=111392.73, stdev=156352.85 lat (usec): min=835, max=221953, avg=111394.60, stdev=156354.34 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], 20.00th=[ 832], | 30.00th=[ 832], 40.00th=[ 832], 50.00th=[ 832], 60.00th=[221250], | 70.00th=[221250], 80.00th=[221250], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 1651, max= 2015, per=52.81%, avg=1833.00, stdev=257.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1736KiB/s (1778kB/s)(10.0MiB/5899msec); 0 zone resets clat (msec): min=192, max=2065, avg=567.10, stdev=555.88 lat (msec): min=192, max=2065, avg=567.18, stdev=555.88 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 215], | 30.00th=[ 266], 40.00th=[ 309], 50.00th=[ 321], 60.00th=[ 401], | 70.00th=[ 550], 80.00th=[ 651], 90.00th=[ 709], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1651, max= 4087, per=45.94%, avg=2232.62, stdev=760.63, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=10.94%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175499: Tue Sep 29 02:21:25 2026 read: IOPS=1, BW=1116KiB/s (1142kB/s)(6144KiB/5507msec) clat (msec): min=101, max=316, avg=182.73, stdev=86.01 lat (msec): min=101, max=316, avg=182.73, stdev=86.01 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 171], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2015, max= 4087, per=73.29%, avg=2544.00, stdev=1028.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1116KiB/s (1142kB/s)(6144KiB/5507msec); 0 zone resets clat (msec): min=234, max=2191, avg=734.76, stdev=783.43 lat (msec): min=234, max=2191, avg=734.86, stdev=783.41 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 355], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1787, max= 2043, per=40.82%, avg=1983.80, stdev=110.61, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.55%, ctx=231, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175500: Tue Sep 29 02:21:25 2026 read: IOPS=0, BW=953KiB/s (976kB/s)(5120KiB/5371msec) clat (usec): min=571, max=337588, avg=181336.01, stdev=166398.68 lat (usec): min=573, max=337590, avg=181337.30, stdev=166398.77 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 775], 40.00th=[ 775], 50.00th=[278922], 60.00th=[278922], | 70.00th=[287310], 80.00th=[287310], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 4031, max= 4063, per=100.00%, avg=4047.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1335KiB/s (1367kB/s)(7168KiB/5371msec); 0 zone resets clat (msec): min=134, max=2214, avg=636.53, stdev=721.30 lat (msec): min=134, max=2214, avg=636.73, stdev=721.26 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 184], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 460], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 642], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1726, max= 5941, per=60.46%, avg=2938.25, stdev=2007.40, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.34%, ctx=236, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3472KiB/s (3555kB/s), 347KiB/s-1336KiB/s (356kB/s-1368kB/s), io=20.0MiB (20.0MB), run=5365-5899msec WRITE: bw=4860KiB/s (4977kB/s), 954KiB/s-1736KiB/s (977kB/s-1778kB/s), io=28.0MiB (29.4MB), run=5365-5899msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=175506: Tue Sep 29 02:21:36 2026 read: IOPS=3, BW=13.7MiB/s (14.3MB/s)(12.0MiB/877msec) clat (msec): min=213, max=354, avg=266.80, stdev=76.34 lat (msec): min=213, max=354, avg=266.80, stdev=76.34 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min=11361, max=11361, per=100.00%, avg=11361.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=17.92%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175507: Tue Sep 29 02:21:36 2026 read: IOPS=0, BW=1311KiB/s (1342kB/s)(4096KiB/3125msec) clat (nsec): min=942938k, max=942938k, avg=942938219.00, stdev= 0.00 lat (nsec): min=942940k, max=942940k, avg=942939791.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2621KiB/s (2684kB/s)(8192KiB/3125msec); 0 zone resets clat (msec): min=715, max=1275, avg=995.26, stdev=395.83 lat (msec): min=717, max=1276, avg=997.07, stdev=394.78 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8000, max= 8000, per=76.30%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175508: Tue Sep 29 02:21:36 2026 write: IOPS=1, BW=5980KiB/s (6123kB/s)(12.0MiB/2055msec); 0 zone resets clat (msec): min=592, max=715, avg=638.82, stdev=66.48 lat (msec): min=593, max=716, avg=639.54, stdev=67.03 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8126, max= 8175, per=77.73%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.10%, sys=8.52%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175509: Tue Sep 29 02:21:36 2026 write: IOPS=1, BW=5493KiB/s (5625kB/s)(12.0MiB/2237msec); 0 zone resets clat (msec): min=354, max=1350, avg=709.40, stdev=556.46 lat (msec): min=354, max=1351, avg=710.07, stdev=556.36 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8126, max= 8159, per=77.66%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.84%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5243KiB/s (5369kB/s), 1311KiB/s-13.7MiB/s (1342kB/s-14.3MB/s), io=16.0MiB (16.8MB), run=877-3125msec WRITE: bw=10.2MiB/s (10.7MB/s), 2621KiB/s-5980KiB/s (2684kB/s-6123kB/s), io=32.0MiB (33.6MB), run=2055-3125msec rand-rw: (groupid=0, jobs=1): err= 0: pid=175511: Tue Sep 29 02:21:36 2026 read: IOPS=1, BW=6785KiB/s (6948kB/s)(12.0MiB/1811msec) clat (msec): min=542, max=714, avg=602.72, stdev=96.64 lat (msec): min=542, max=714, avg=602.72, stdev=96.64 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7288, max= 7984, per=100.00%, avg=7636.00, stdev=492.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.11%, sys=18.56%, ctx=466, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175512: Tue Sep 29 02:21:36 2026 read: IOPS=0, BW=1678KiB/s (1718kB/s)(4096KiB/2441msec) clat (nsec): min=635319k, max=635319k, avg=635318695.00, stdev= 0.00 lat (nsec): min=635321k, max=635321k, avg=635320749.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6224, max= 6224, per=92.73%, avg=6224.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3356KiB/s (3437kB/s)(8192KiB/2441msec); 0 zone resets clat (msec): min=871, max=931, avg=901.54, stdev=41.88 lat (msec): min=872, max=932, avg=902.28, stdev=42.29 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7984, max= 7984, per=59.48%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.52%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175513: Tue Sep 29 02:21:36 2026 write: IOPS=1, BW=5459KiB/s (5590kB/s)(12.0MiB/2251msec); 0 zone resets clat (msec): min=414, max=1046, avg=747.20, stdev=317.38 lat (msec): min=417, max=1049, avg=749.72, stdev=317.23 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8110, max= 8175, per=60.66%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.27%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=175514: Tue Sep 29 02:21:36 2026 write: IOPS=1, BW=6657KiB/s (6816kB/s)(12.0MiB/1846msec); 0 zone resets clat (msec): min=290, max=816, avg=614.45, stdev=283.19 lat (msec): min=291, max=816, avg=614.91, stdev=283.16 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7984, max= 8110, per=59.94%, avg=8047.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=9.76%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6712KiB/s (6873kB/s), 1678KiB/s-6785KiB/s (1718kB/s-6948kB/s), io=16.0MiB (16.8MB), run=1811-2441msec WRITE: bw=13.1MiB/s (13.7MB/s), 3356KiB/s-6657KiB/s (3437kB/s-6816kB/s), io=32.0MiB (33.6MB), run=1846-2441msec