== sanity test 398b: DIO and buffer IO race ============== 00:00:11 (1789358411) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.95194 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159556: Mon Sep 14 00:01:09 2026 read: IOPS=30, BW=121KiB/s (123kB/s)(5992KiB/49717msec) clat (usec): min=28, max=696603, avg=16976.78, stdev=20479.81 lat (usec): min=29, max=696604, avg=16978.41, stdev=20479.73 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 5473], 10.00th=[ 7177], 20.00th=[ 8848], | 30.00th=[ 10290], 40.00th=[ 12125], 50.00th=[ 14353], 60.00th=[ 16909], | 70.00th=[ 19792], 80.00th=[ 23200], 90.00th=[ 28443], 95.00th=[ 33817], | 99.00th=[ 54264], 99.50th=[ 67634], 99.90th=[119014], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 13, max= 224, per=24.95%, avg=120.02, stdev=34.24, samples=98 iops : min= 3, max= 56, avg=29.67, stdev= 8.57, samples=98 write: IOPS=31, BW=127KiB/s (130kB/s)(6296KiB/49717msec); 0 zone resets clat (usec): min=662, max=139281, avg=15298.67, stdev=13833.40 lat (usec): min=662, max=139282, avg=15300.34, stdev=13833.75 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1729], 10.00th=[ 2343], 20.00th=[ 3195], | 30.00th=[ 5014], 40.00th=[ 8979], 50.00th=[ 12256], 60.00th=[ 15795], | 70.00th=[ 19530], 80.00th=[ 24773], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 63701], 99.50th=[ 73925], 99.90th=[112722], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 47, max= 213, per=25.24%, avg=126.98, stdev=31.36, samples=97 iops : min= 11, max= 53, avg=31.41, stdev= 7.84, samples=97 lat (usec) : 50=0.23%, 100=0.55%, 250=1.11%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.55% lat (msec) : 2=2.70%, 4=9.47%, 10=20.80%, 20=35.29%, 50=27.38% lat (msec) : 100=1.56%, 250=0.13%, 750=0.03% cpu : usr=0.14%, sys=22.03%, ctx=8213, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159557: Mon Sep 14 00:01:09 2026 read: IOPS=30, BW=121KiB/s (123kB/s)(5940KiB/49285msec) clat (usec): min=32, max=135411, avg=16257.89, stdev=10159.38 lat (usec): min=32, max=135412, avg=16259.52, stdev=10159.59 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 2409], 10.00th=[ 7242], 20.00th=[ 8979], | 30.00th=[ 10290], 40.00th=[ 12256], 50.00th=[ 14353], 60.00th=[ 16712], | 70.00th=[ 19268], 80.00th=[ 22676], 90.00th=[ 28181], 95.00th=[ 32900], | 99.00th=[ 51643], 99.50th=[ 56361], 99.90th=[ 83362], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 6, max= 215, per=25.06%, avg=120.52, stdev=34.88, samples=98 iops : min= 1, max= 53, avg=29.80, stdev= 8.70, samples=98 write: IOPS=32, BW=129KiB/s (132kB/s)(6348KiB/49285msec); 0 zone resets clat (usec): min=631, max=732282, avg=15710.96, stdev=22693.82 lat (usec): min=632, max=732283, avg=15712.27, stdev=22693.88 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 1565], 10.00th=[ 2311], 20.00th=[ 3195], | 30.00th=[ 5276], 40.00th=[ 9110], 50.00th=[ 12125], 60.00th=[ 15795], | 70.00th=[ 19792], 80.00th=[ 25035], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 57410], 99.50th=[ 77071], 99.90th=[152044], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 6, max= 223, per=25.62%, avg=128.85, stdev=35.82, samples=98 iops : min= 1, max= 55, avg=31.88, stdev= 8.93, samples=98 lat (usec) : 50=0.23%, 100=0.62%, 250=1.50%, 500=0.03%, 750=0.23% lat (usec) : 1000=0.68% lat (msec) : 2=2.93%, 4=9.18%, 10=20.21%, 20=35.94%, 50=26.82% lat (msec) : 100=1.46%, 250=0.13%, 750=0.03% cpu : usr=0.13%, sys=22.10%, ctx=8008, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159558: Mon Sep 14 00:01:09 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6028KiB/49762msec) clat (usec): min=40, max=119968, avg=16003.09, stdev=10080.54 lat (usec): min=41, max=119969, avg=16008.48, stdev=10085.79 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 157], 10.00th=[ 6783], 20.00th=[ 8455], | 30.00th=[ 10159], 40.00th=[ 11994], 50.00th=[ 13829], 60.00th=[ 16581], | 70.00th=[ 19530], 80.00th=[ 22938], 90.00th=[ 28443], 95.00th=[ 32637], | 99.00th=[ 46400], 99.50th=[ 56886], 99.90th=[ 95945], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 16, max= 223, per=25.44%, avg=122.35, stdev=36.19, samples=98 iops : min= 4, max= 55, avg=30.24, stdev= 9.03, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6260KiB/49762msec); 0 zone resets clat (usec): min=667, max=769690, avg=16255.81, stdev=24009.23 lat (usec): min=668, max=769691, avg=16257.07, stdev=24009.42 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 1516], 10.00th=[ 2278], 20.00th=[ 3130], | 30.00th=[ 5276], 40.00th=[ 8979], 50.00th=[ 12518], 60.00th=[ 16057], | 70.00th=[ 20317], 80.00th=[ 25035], 90.00th=[ 34341], 95.00th=[ 43779], | 99.00th=[ 63701], 99.50th=[ 78119], 99.90th=[149947], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 32, max= 239, per=25.21%, avg=126.80, stdev=34.29, samples=98 iops : min= 8, max= 59, avg=31.37, stdev= 8.51, samples=98 lat (usec) : 50=0.07%, 100=1.20%, 250=1.50%, 750=0.13%, 1000=0.75% lat (msec) : 2=3.09%, 4=9.11%, 10=20.02%, 20=34.54%, 50=27.83% lat (msec) : 100=1.56%, 250=0.16%, 1000=0.03% cpu : usr=0.12%, sys=21.92%, ctx=8139, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159559: Mon Sep 14 00:01:09 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/49904msec) clat (usec): min=34, max=128701, avg=16375.40, stdev=10475.96 lat (usec): min=34, max=128702, avg=16376.40, stdev=10475.97 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 184], 10.00th=[ 6980], 20.00th=[ 8848], | 30.00th=[ 10552], 40.00th=[ 12256], 50.00th=[ 14222], 60.00th=[ 16909], | 70.00th=[ 19792], 80.00th=[ 23200], 90.00th=[ 28443], 95.00th=[ 34866], | 99.00th=[ 51643], 99.50th=[ 58983], 99.90th=[102237], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 39, max= 215, per=25.30%, avg=121.69, stdev=29.78, samples=98 iops : min= 9, max= 53, avg=30.08, stdev= 7.48, samples=98 write: IOPS=31, BW=125KiB/s (128kB/s)(6236KiB/49904msec); 0 zone resets clat (usec): min=686, max=739924, avg=15989.72, stdev=23320.42 lat (usec): min=686, max=739925, avg=15991.74, stdev=23321.16 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 1450], 10.00th=[ 2278], 20.00th=[ 3228], | 30.00th=[ 5342], 40.00th=[ 8848], 50.00th=[ 12256], 60.00th=[ 15533], | 70.00th=[ 20055], 80.00th=[ 25297], 90.00th=[ 33162], 95.00th=[ 41157], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[141558], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 13, max= 255, per=24.71%, avg=124.27, stdev=37.00, samples=99 iops : min= 3, max= 63, avg=30.74, stdev= 9.19, samples=99 lat (usec) : 50=0.16%, 100=1.01%, 250=1.40%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.91% lat (msec) : 2=3.12%, 4=8.76%, 10=19.82%, 20=35.19%, 50=27.67% lat (msec) : 100=1.56%, 250=0.23%, 750=0.03% cpu : usr=0.13%, sys=22.02%, ctx=8193, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=481KiB/s (493kB/s), 121KiB/s-121KiB/s (123kB/s-124kB/s), io=23.4MiB (24.6MB), run=49285-49904msec WRITE: bw=504KiB/s (516kB/s), 125KiB/s-129KiB/s (128kB/s-132kB/s), io=24.6MiB (25.7MB), run=49285-49904msec fio: pid=159562, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=159560: Mon Sep 14 00:01:41 2026 read: IOPS=18, BW=73.6KiB/s (75.4kB/s)(5992KiB/81358msec) clat (msec): min=2, max=707, avg=13.71, stdev=22.27 lat (msec): min=2, max=707, avg=13.71, stdev=22.27 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 30], 95.00th=[ 40], | 99.00th=[ 67], 99.50th=[ 81], 99.90th=[ 144], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8, max= 200, per=28.70%, avg=74.04, stdev=42.09, samples=161 iops : min= 2, max= 50, avg=18.21, stdev=10.60, samples=161 write: IOPS=19, BW=77.4KiB/s (79.2kB/s)(6296KiB/81358msec); 0 zone resets clat (msec): min=14, max=185, avg=38.52, stdev=19.08 lat (msec): min=14, max=185, avg=38.52, stdev=19.08 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 65], 95.00th=[ 74], | 99.00th=[ 100], 99.50th=[ 113], 99.90th=[ 178], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 23, max= 144, per=28.87%, avg=77.66, stdev=34.58, samples=161 iops : min= 5, max= 36, avg=19.12, stdev= 8.73, samples=161 lat (msec) : 4=3.12%, 10=25.49%, 20=14.97%, 50=44.30%, 100=11.46% lat (msec) : 250=0.62%, 750=0.03% cpu : usr=0.11%, sys=5.84%, ctx=5565, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159561: Mon Sep 14 00:01:41 2026 read: IOPS=18, BW=73.3KiB/s (75.1kB/s)(5940KiB/81025msec) clat (msec): min=2, max=743, avg=13.66, stdev=22.94 lat (msec): min=2, max=743, avg=13.66, stdev=22.94 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 30], 95.00th=[ 39], | 99.00th=[ 67], 99.50th=[ 82], 99.90th=[ 128], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 192, per=28.57%, avg=73.70, stdev=41.23, samples=160 iops : min= 1, max= 48, avg=18.13, stdev=10.38, samples=160 write: IOPS=19, BW=78.3KiB/s (80.2kB/s)(6348KiB/81025msec); 0 zone resets clat (msec): min=14, max=199, avg=38.15, stdev=19.19 lat (msec): min=14, max=199, avg=38.15, stdev=19.19 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 101], 99.50th=[ 136], 99.90th=[ 165], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 24, max= 152, per=29.20%, avg=78.56, stdev=34.66, samples=160 iops : min= 6, max= 38, avg=19.34, stdev= 8.75, samples=160 lat (msec) : 4=2.38%, 10=26.66%, 20=14.71%, 50=43.91%, 100=11.72% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.13%, sys=5.82%, ctx=5545, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=159562: Mon Sep 14 00:01:41 2026 read: IOPS=14, BW=57.7KiB/s (59.1kB/s)(3132KiB/54277msec) clat (msec): min=3, max=155, avg=20.00, stdev=16.71 lat (msec): min=3, max=155, avg=20.00, stdev=16.71 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 83], 99.50th=[ 123], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 15, max= 216, per=22.50%, avg=58.05, stdev=32.79, samples=107 iops : min= 3, max= 54, avg=14.20, stdev= 8.32, samples=107 write: IOPS=14, BW=58.1KiB/s (59.5kB/s)(3152KiB/54277msec); 0 zone resets clat (msec): min=16, max=764, avg=48.80, stdev=33.12 lat (msec): min=16, max=764, avg=48.80, stdev=33.12 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 56], 80.00th=[ 63], 90.00th=[ 75], 95.00th=[ 84], | 99.00th=[ 117], 99.50th=[ 144], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 23, max= 144, per=21.69%, avg=58.35, stdev=24.27, samples=107 iops : min= 5, max= 36, avg=14.27, stdev= 6.17, samples=107 lat (msec) : 4=1.53%, 10=12.60%, 20=18.83%, 50=44.85%, 100=20.67% lat (msec) : 250=1.40%, 1000=0.06% cpu : usr=0.07%, sys=6.18%, ctx=2370, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=784,788,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159563: Mon Sep 14 00:01:41 2026 read: IOPS=18, BW=74.1KiB/s (75.9kB/s)(6052KiB/81696msec) clat (msec): min=2, max=124, avg=13.55, stdev=13.25 lat (msec): min=2, max=124, avg=13.55, stdev=13.25 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 40], | 99.00th=[ 63], 99.50th=[ 88], 99.90th=[ 124], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 8, max= 192, per=28.58%, avg=73.74, stdev=41.33, samples=161 iops : min= 2, max= 48, avg=18.14, stdev=10.41, samples=161 write: IOPS=19, BW=76.3KiB/s (78.2kB/s)(6236KiB/81696msec); 0 zone resets clat (msec): min=13, max=786, avg=39.13, stdev=27.48 lat (msec): min=13, max=786, avg=39.13, stdev=27.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 66], 95.00th=[ 78], | 99.00th=[ 103], 99.50th=[ 129], 99.90th=[ 201], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 31, max= 152, per=28.30%, avg=76.12, stdev=34.08, samples=161 iops : min= 7, max= 38, avg=18.73, stdev= 8.60, samples=161 lat (msec) : 4=3.19%, 10=25.16%, 20=15.49%, 50=43.65%, 100=11.75% lat (msec) : 250=0.72%, 1000=0.03% cpu : usr=0.09%, sys=5.72%, ctx=5548, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=258KiB/s (265kB/s), 57.7KiB/s-74.1KiB/s (59.1kB/s-75.9kB/s), io=20.6MiB (21.6MB), run=54277-81696msec WRITE: bw=270KiB/s (276kB/s), 58.1KiB/s-78.3KiB/s (59.5kB/s-80.2kB/s), io=21.5MiB (22.6MB), run=54277-81696msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159609: Mon Sep 14 00:01:59 2026 read: IOPS=29, BW=472KiB/s (483kB/s)(5920KiB/12538msec) clat (usec): min=35, max=71021, avg=16361.76, stdev=11067.89 lat (usec): min=36, max=71022, avg=16362.88, stdev=11067.93 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 86], 10.00th=[ 113], 20.00th=[ 8160], | 30.00th=[11076], 40.00th=[13435], 50.00th=[15401], 60.00th=[17957], | 70.00th=[21103], 80.00th=[24773], 90.00th=[30016], 95.00th=[34341], | 99.00th=[43779], 99.50th=[60031], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 286, max= 736, per=25.49%, avg=466.25, stdev=119.57, samples=24 iops : min= 17, max= 46, avg=28.79, stdev= 7.71, samples=24 write: IOPS=31, BW=508KiB/s (520kB/s)(6368KiB/12538msec); 0 zone resets clat (usec): min=1072, max=105135, avg=15944.67, stdev=14719.84 lat (usec): min=1074, max=105136, avg=15946.46, stdev=14719.83 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2212], 10.00th=[ 2999], 20.00th=[ 4113], | 30.00th=[ 5604], 40.00th=[ 8225], 50.00th=[ 12256], 60.00th=[ 15664], | 70.00th=[ 19792], 80.00th=[ 25822], 90.00th=[ 36439], 95.00th=[ 41681], | 99.00th=[ 80217], 99.50th=[ 88605], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 222, max= 704, per=26.61%, avg=512.04, stdev=125.96, samples=24 iops : min= 13, max= 44, avg=31.67, stdev= 7.86, samples=24 lat (usec) : 50=0.26%, 100=3.52%, 250=3.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=7.81%, 10=17.32%, 20=32.81%, 50=30.21% lat (msec) : 100=1.69%, 250=0.13% cpu : usr=0.13%, sys=20.38%, ctx=2002, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159610: Mon Sep 14 00:01:59 2026 read: IOPS=28, BW=454KiB/s (465kB/s)(5744KiB/12642msec) clat (usec): min=29, max=85059, avg=17896.72, stdev=12475.14 lat (usec): min=30, max=85060, avg=17897.73, stdev=12475.16 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 87], 10.00th=[ 115], 20.00th=[ 9372], | 30.00th=[12256], 40.00th=[14484], 50.00th=[17433], 60.00th=[19792], | 70.00th=[22152], 80.00th=[25297], 90.00th=[31851], 95.00th=[36439], | 99.00th=[64226], 99.50th=[82314], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 167, max= 768, per=25.01%, avg=457.44, stdev=145.45, samples=25 iops : min= 10, max= 48, avg=28.24, stdev= 9.21, samples=25 write: IOPS=32, BW=518KiB/s (530kB/s)(6544KiB/12642msec); 0 zone resets clat (usec): min=840, max=157451, avg=15114.10, stdev=15675.62 lat (usec): min=841, max=157452, avg=15116.28, stdev=15676.16 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2114], 10.00th=[ 2933], 20.00th=[ 3982], | 30.00th=[ 5145], 40.00th=[ 6783], 50.00th=[ 9896], 60.00th=[ 14091], | 70.00th=[ 19006], 80.00th=[ 23987], 90.00th=[ 32375], 95.00th=[ 40633], | 99.00th=[ 70779], 99.50th=[ 86508], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 256, max= 736, per=26.89%, avg=517.44, stdev=105.54, samples=25 iops : min= 16, max= 46, avg=32.00, stdev= 6.59, samples=25 lat (usec) : 50=0.52%, 100=3.26%, 250=2.73%, 500=0.13%, 1000=0.39% lat (msec) : 2=2.21%, 4=8.46%, 10=19.40%, 20=30.99%, 50=29.56% lat (msec) : 100=2.21%, 250=0.13% cpu : usr=0.09%, sys=20.65%, ctx=1903, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159611: Mon Sep 14 00:01:59 2026 read: IOPS=29, BW=478KiB/s (489kB/s)(6256KiB/13092msec) clat (usec): min=41, max=94107, avg=17774.36, stdev=12632.37 lat (usec): min=42, max=94109, avg=17775.40, stdev=12632.38 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 80], 10.00th=[ 121], 20.00th=[ 9110], | 30.00th=[12125], 40.00th=[14091], 50.00th=[16581], 60.00th=[19006], | 70.00th=[22414], 80.00th=[26084], 90.00th=[31589], 95.00th=[36439], | 99.00th=[66847], 99.50th=[74974], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 254, max= 704, per=25.81%, avg=472.00, stdev=120.60, samples=25 iops : min= 15, max= 44, avg=29.16, stdev= 7.62, samples=25 write: IOPS=28, BW=461KiB/s (472kB/s)(6032KiB/13092msec); 0 zone resets clat (usec): min=886, max=152582, avg=15941.00, stdev=14763.24 lat (usec): min=886, max=152584, avg=15942.58, stdev=14763.24 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1713], 10.00th=[ 2606], 20.00th=[ 3916], | 30.00th=[ 5211], 40.00th=[ 9372], 50.00th=[ 12911], 60.00th=[ 16319], | 70.00th=[ 20055], 80.00th=[ 26084], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 60556], 99.50th=[ 69731], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 222, max= 669, per=23.07%, avg=443.88, stdev=127.99, samples=25 iops : min= 13, max= 41, avg=27.40, stdev= 8.08, samples=25 lat (usec) : 50=0.26%, 100=3.39%, 250=2.99%, 500=0.52%, 1000=0.26% lat (msec) : 2=3.12%, 4=7.42%, 10=14.58%, 20=34.11%, 50=31.12% lat (msec) : 100=2.08%, 250=0.13% cpu : usr=0.11%, sys=19.41%, ctx=2066, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159612: Mon Sep 14 00:01:59 2026 read: IOPS=29, BW=473KiB/s (484kB/s)(6032KiB/12759msec) clat (usec): min=24, max=81068, avg=17461.20, stdev=13126.48 lat (usec): min=24, max=81070, avg=17462.23, stdev=13126.53 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 67], 10.00th=[ 91], 20.00th=[ 7832], | 30.00th=[11600], 40.00th=[13829], 50.00th=[16319], 60.00th=[18744], | 70.00th=[21890], 80.00th=[25297], 90.00th=[33817], 95.00th=[41157], | 99.00th=[65274], 99.50th=[70779], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 111, max= 672, per=25.65%, avg=469.20, stdev=144.05, samples=25 iops : min= 6, max= 42, avg=28.96, stdev= 9.04, samples=25 write: IOPS=30, BW=490KiB/s (502kB/s)(6256KiB/12759msec); 0 zone resets clat (usec): min=1039, max=118657, avg=15480.36, stdev=15990.07 lat (usec): min=1041, max=118658, avg=15482.27, stdev=15990.03 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2057], 10.00th=[ 2769], 20.00th=[ 3851], | 30.00th=[ 4948], 40.00th=[ 7111], 50.00th=[ 10290], 60.00th=[ 13304], | 70.00th=[ 17957], 80.00th=[ 26346], 90.00th=[ 34866], 95.00th=[ 47449], | 99.00th=[ 73925], 99.50th=[109577], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 167, max= 736, per=25.30%, avg=486.80, stdev=119.12, samples=25 iops : min= 10, max= 46, avg=30.08, stdev= 7.49, samples=25 lat (usec) : 50=0.78%, 100=4.56%, 250=2.99%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=9.11%, 10=17.32%, 20=31.12%, 50=28.52% lat (msec) : 100=2.73%, 250=0.26% cpu : usr=0.13%, sys=19.77%, ctx=1975, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1830KiB/s (1873kB/s), 454KiB/s-478KiB/s (465kB/s-489kB/s), io=23.4MiB (24.5MB), run=12538-13092msec WRITE: bw=1925KiB/s (1971kB/s), 461KiB/s-518KiB/s (472kB/s-530kB/s), io=24.6MiB (25.8MB), run=12538-13092msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159605: Mon Sep 14 00:02:09 2026 read: IOPS=15, BW=256KiB/s (262kB/s)(5920KiB/23147msec) clat (msec): min=3, max=122, avg=16.81, stdev=15.47 lat (msec): min=3, max=122, avg=16.81, stdev=15.47 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 67], 99.50th=[ 86], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 480, per=23.93%, avg=247.47, stdev=124.12, samples=45 iops : min= 3, max= 30, avg=14.96, stdev= 7.98, samples=45 write: IOPS=17, BW=275KiB/s (282kB/s)(6368KiB/23147msec); 0 zone resets clat (msec): min=14, max=174, avg=42.29, stdev=23.87 lat (msec): min=14, max=174, avg=42.30, stdev=23.87 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 75], 95.00th=[ 91], | 99.00th=[ 118], 99.50th=[ 134], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 63, max= 544, per=24.90%, avg=270.96, stdev=142.64, samples=45 iops : min= 3, max= 34, avg=16.42, stdev= 9.05, samples=45 lat (msec) : 4=0.91%, 10=20.05%, 20=17.32%, 50=44.92%, 100=15.10% lat (msec) : 250=1.69% cpu : usr=0.09%, sys=5.29%, ctx=1494, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159606: Mon Sep 14 00:02:09 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5744KiB/22938msec) clat (msec): min=3, max=137, avg=14.96, stdev=14.10 lat (msec): min=3, max=137, avg=14.96, stdev=14.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 72], 99.50th=[ 81], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 606, per=24.10%, avg=249.24, stdev=161.41, samples=45 iops : min= 1, max= 37, avg=15.07, stdev=10.18, samples=45 write: IOPS=17, BW=285KiB/s (292kB/s)(6544KiB/22938msec); 0 zone resets clat (msec): min=15, max=166, avg=42.89, stdev=25.39 lat (msec): min=15, max=166, avg=42.89, stdev=25.39 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 82], 95.00th=[ 97], | 99.00th=[ 129], 99.50th=[ 157], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 95, max= 512, per=25.86%, avg=281.38, stdev=138.30, samples=45 iops : min= 5, max= 32, avg=17.09, stdev= 8.77, samples=45 lat (msec) : 4=0.78%, 10=21.74%, 20=18.62%, 50=43.23%, 100=13.28% lat (msec) : 250=2.34% cpu : usr=0.08%, sys=5.35%, ctx=1534, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159607: Mon Sep 14 00:02:09 2026 read: IOPS=17, BW=274KiB/s (280kB/s)(6256KiB/22867msec) clat (msec): min=3, max=154, avg=16.10, stdev=16.44 lat (msec): min=3, max=154, avg=16.10, stdev=16.44 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 122], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 32, max= 672, per=27.23%, avg=281.55, stdev=174.93, samples=44 iops : min= 2, max= 42, avg=17.09, stdev=11.15, samples=44 write: IOPS=16, BW=264KiB/s (270kB/s)(6032KiB/22867msec); 0 zone resets clat (msec): min=16, max=140, avg=43.65, stdev=25.22 lat (msec): min=16, max=140, avg=43.65, stdev=25.22 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 83], 95.00th=[ 101], | 99.00th=[ 126], 99.50th=[ 134], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 95, max= 544, per=23.99%, avg=261.02, stdev=134.97, samples=45 iops : min= 5, max= 34, avg=15.80, stdev= 8.51, samples=45 lat (msec) : 4=0.65%, 10=21.09%, 20=19.92%, 50=42.06%, 100=13.41% lat (msec) : 250=2.86% cpu : usr=0.11%, sys=5.51%, ctx=1601, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159608: Mon Sep 14 00:02:09 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23098msec) clat (msec): min=3, max=152, avg=15.64, stdev=15.98 lat (msec): min=3, max=152, avg=15.64, stdev=15.98 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 51], | 99.00th=[ 89], 99.50th=[ 96], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 32, max= 608, per=24.64%, avg=254.76, stdev=150.99, samples=45 iops : min= 2, max= 38, avg=15.40, stdev= 9.55, samples=45 write: IOPS=16, BW=271KiB/s (277kB/s)(6256KiB/23098msec); 0 zone resets clat (msec): min=14, max=168, avg=43.77, stdev=26.62 lat (msec): min=14, max=168, avg=43.77, stdev=26.62 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 82], 95.00th=[ 100], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 95, max= 510, per=24.44%, avg=265.87, stdev=133.22, samples=45 iops : min= 5, max= 31, avg=16.11, stdev= 8.45, samples=45 lat (msec) : 4=1.17%, 10=21.22%, 20=20.18%, 50=41.41%, 100=13.41% lat (msec) : 250=2.60% cpu : usr=0.10%, sys=5.40%, ctx=1559, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1035KiB/s (1060kB/s), 250KiB/s-274KiB/s (256kB/s-280kB/s), io=23.4MiB (24.5MB), run=22867-23147msec WRITE: bw=1089KiB/s (1115kB/s), 264KiB/s-285KiB/s (270kB/s-292kB/s), io=24.6MiB (25.8MB), run=22867-23147msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159622: Mon Sep 14 00:02:19 2026 read: IOPS=2, BW=2324KiB/s (2380kB/s)(7168KiB/3084msec) clat (msec): min=48, max=876, avg=293.60, stdev=289.28 lat (msec): min=48, max=876, avg=293.60, stdev=289.28 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 70], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 163], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 397], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1703, max= 4087, per=42.18%, avg=2366.00, stdev=972.03, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1660KiB/s (1700kB/s)(5120KiB/3084msec); 0 zone resets clat (msec): min=103, max=459, avg=196.57, stdev=151.15 lat (msec): min=103, max=459, avg=196.64, stdev=151.15 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2035, max= 5873, per=50.35%, avg=3954.00, stdev=2713.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=10.67%, ctx=107, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159623: Mon Sep 14 00:02:19 2026 read: IOPS=0, BW=561KiB/s (574kB/s)(2048KiB/3651msec) clat (usec): min=67375, max=67756, avg=67565.95, stdev=269.64 lat (usec): min=67376, max=67759, avg=67567.90, stdev=270.43 clat percentiles (usec): | 1.00th=[67634], 5.00th=[67634], 10.00th=[67634], 20.00th=[67634], | 30.00th=[67634], 40.00th=[67634], 50.00th=[67634], 60.00th=[67634], | 70.00th=[67634], 80.00th=[67634], 90.00th=[67634], 95.00th=[67634], | 99.00th=[67634], 99.50th=[67634], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 1703, max= 2048, per=33.44%, avg=1875.50, stdev=243.95, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2805KiB/s (2872kB/s)(10.0MiB/3651msec); 0 zone resets clat (msec): min=86, max=1044, avg=348.91, stdev=313.97 lat (msec): min=86, max=1044, avg=349.02, stdev=313.94 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 91], | 30.00th=[ 146], 40.00th=[ 167], 50.00th=[ 186], 60.00th=[ 197], | 70.00th=[ 401], 80.00th=[ 472], 90.00th=[ 701], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 2048, max= 6144, per=46.42%, avg=3645.20, stdev=1702.95, samples=5 iops : min= 2, max= 6, avg= 3.20, stdev= 1.64, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.34%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159624: Mon Sep 14 00:02:19 2026 read: IOPS=1, BW=1839KiB/s (1883kB/s)(6144KiB/3341msec) clat (msec): min=62, max=218, avg=123.59, stdev=53.66 lat (msec): min=62, max=218, avg=123.59, stdev=53.66 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 112], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 2048, max= 4096, per=60.71%, avg=3405.00, stdev=1175.26, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1839KiB/s (1883kB/s)(6144KiB/3341msec); 0 zone resets clat (msec): min=59, max=996, avg=431.40, stdev=345.25 lat (msec): min=59, max=996, avg=431.46, stdev=345.24 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 493], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1957, max= 3401, per=30.06%, avg=2360.25, stdev=695.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.69%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159625: Mon Sep 14 00:02:19 2026 read: IOPS=1, BW=1453KiB/s (1488kB/s)(5120KiB/3524msec) clat (msec): min=57, max=503, avg=183.74, stdev=180.66 lat (msec): min=57, max=503, avg=183.74, stdev=180.66 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 123], 60.00th=[ 123], | 70.00th=[ 126], 80.00th=[ 126], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 4096, max= 4096, per=73.03%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2034KiB/s (2083kB/s)(7168KiB/3524msec); 0 zone resets clat (msec): min=72, max=1704, avg=363.38, stdev=593.70 lat (msec): min=74, max=1704, avg=363.71, stdev=593.56 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 79], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1703, max= 3915, per=32.54%, avg=2555.33, stdev=1190.07, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=58.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.71%, ctx=264, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5609KiB/s (5744kB/s), 561KiB/s-2324KiB/s (574kB/s-2380kB/s), io=20.0MiB (20.0MB), run=3084-3651msec WRITE: bw=7853KiB/s (8042kB/s), 1660KiB/s-2805KiB/s (1700kB/s-2872kB/s), io=28.0MiB (29.4MB), run=3084-3651msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159627: Mon Sep 14 00:02:19 2026 read: IOPS=2, BW=2369KiB/s (2426kB/s)(7168KiB/3026msec) clat (usec): min=572, max=857449, avg=242056.95, stdev=304330.79 lat (usec): min=573, max=857451, avg=242058.32, stdev=304330.89 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 49021], | 30.00th=[ 66323], 40.00th=[ 66323], 50.00th=[108528], 60.00th=[193987], | 70.00th=[193987], 80.00th=[417334], 90.00th=[859833], 95.00th=[859833], | 99.00th=[859833], 99.50th=[859833], 99.90th=[859833], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 1950, max= 6144, per=73.47%, avg=4049.67, stdev=2097.01, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 write: IOPS=1, BW=1692KiB/s (1733kB/s)(5120KiB/3026msec); 0 zone resets clat (msec): min=135, max=550, avg=261.64, stdev=164.94 lat (msec): min=135, max=550, avg=261.69, stdev=164.94 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1950, max= 4055, per=34.64%, avg=2673.33, stdev=1197.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=34.08%, ctx=1216, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159628: Mon Sep 14 00:02:19 2026 read: IOPS=0, BW=551KiB/s (565kB/s)(2048KiB/3715msec) clat (usec): min=577, max=319806, avg=160192.29, stdev=225729.01 lat (usec): min=579, max=319808, avg=160193.74, stdev=225729.08 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[320865], | 70.00th=[320865], 80.00th=[320865], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1659, max= 1950, per=32.74%, avg=1804.50, stdev=205.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2756KiB/s (2823kB/s)(10.0MiB/3715msec); 0 zone resets clat (msec): min=66, max=802, avg=326.07, stdev=271.52 lat (msec): min=67, max=802, avg=326.12, stdev=271.52 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 72], | 30.00th=[ 106], 40.00th=[ 144], 50.00th=[ 218], 60.00th=[ 232], | 70.00th=[ 426], 80.00th=[ 451], 90.00th=[ 751], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2048, max= 6131, per=58.51%, avg=4515.25, stdev=1890.03, samples=4 iops : min= 2, max= 5, avg= 3.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=30.45%, ctx=388, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159629: Mon Sep 14 00:02:19 2026 read: IOPS=1, BW=1812KiB/s (1856kB/s)(6144KiB/3390msec) clat (usec): min=511, max=266315, avg=108492.89, stdev=101108.41 lat (usec): min=513, max=266316, avg=108493.86, stdev=101108.10 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 94897], 50.00th=[ 94897], 60.00th=[137364], | 70.00th=[152044], 80.00th=[152044], 90.00th=[265290], 95.00th=[265290], | 99.00th=[265290], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 1950, max= 4096, per=61.08%, avg=3367.00, stdev=1227.33, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1812KiB/s (1856kB/s)(6144KiB/3390msec); 0 zone resets clat (msec): min=97, max=1182, avg=434.18, stdev=422.65 lat (msec): min=97, max=1182, avg=434.24, stdev=422.66 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 384], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1950, max= 3313, per=30.21%, avg=2331.50, stdev=655.60, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=29.54%, ctx=320, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159630: Mon Sep 14 00:02:19 2026 read: IOPS=1, BW=1869KiB/s (1914kB/s)(5120KiB/2739msec) clat (usec): min=516, max=316868, avg=123840.69, stdev=131886.20 lat (usec): min=517, max=316869, avg=123842.02, stdev=131886.32 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[135267], 60.00th=[135267], | 70.00th=[166724], 80.00th=[166724], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 3900, max= 4055, per=72.16%, avg=3977.50, stdev=109.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2617KiB/s (2680kB/s)(7168KiB/2739msec); 0 zone resets clat (msec): min=113, max=1060, avg=290.55, stdev=343.10 lat (msec): min=113, max=1060, avg=290.61, stdev=343.10 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 121], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 255], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1654, max= 6047, per=50.11%, avg=3867.00, stdev=2196.69, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.04%, sys=37.98%, ctx=453, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5513KiB/s (5645kB/s), 551KiB/s-2369KiB/s (565kB/s-2426kB/s), io=20.0MiB (20.0MB), run=2739-3715msec WRITE: bw=7718KiB/s (7903kB/s), 1692KiB/s-2756KiB/s (1733kB/s-2823kB/s), io=28.0MiB (29.4MB), run=2739-3715msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159635: Mon Sep 14 00:02:27 2026 read: IOPS=1, BW=7367KiB/s (7544kB/s)(12.0MiB/1668msec) clat (msec): min=386, max=606, avg=520.98, stdev=117.92 lat (msec): min=386, max=606, avg=520.98, stdev=117.92 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8015, max= 8062, per=81.84%, avg=8038.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=16.44%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159636: Mon Sep 14 00:02:27 2026 read: IOPS=0, BW=2679KiB/s (2743kB/s)(4096KiB/1529msec) clat (nsec): min=154899k, max=154899k, avg=154899270.00, stdev= 0.00 lat (nsec): min=154902k, max=154902k, avg=154901654.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 155], 95.00th=[ 155], | 99.00th=[ 155], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 5483, max= 5483, per=55.82%, avg=5483.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5358KiB/s (5486kB/s)(8192KiB/1529msec); 0 zone resets clat (msec): min=602, max=687, avg=644.97, stdev=60.15 lat (msec): min=602, max=687, avg=645.18, stdev=60.24 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8015, max= 8015, per=47.01%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.68%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159637: Mon Sep 14 00:02:27 2026 write: IOPS=1, BW=6393KiB/s (6547kB/s)(12.0MiB/1922msec); 0 zone resets clat (msec): min=170, max=869, avg=606.09, stdev=380.19 lat (msec): min=170, max=869, avg=606.39, stdev=380.23 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8062, max= 8062, per=47.29%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.81%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159638: Mon Sep 14 00:02:27 2026 write: IOPS=1, BW=7907KiB/s (8097kB/s)(12.0MiB/1554msec); 0 zone resets clat (msec): min=152, max=1001, avg=483.19, stdev=454.22 lat (msec): min=152, max=1001, avg=483.45, stdev=454.21 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8047, max= 8062, per=47.25%, avg=8054.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.19%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9823KiB/s (10.1MB/s), 2679KiB/s-7367KiB/s (2743kB/s-7544kB/s), io=16.0MiB (16.8MB), run=1529-1668msec WRITE: bw=16.6MiB/s (17.5MB/s), 5358KiB/s-7907KiB/s (5486kB/s-8097kB/s), io=32.0MiB (33.6MB), run=1529-1922msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159640: Mon Sep 14 00:02:27 2026 read: IOPS=2, BW=8197KiB/s (8394kB/s)(12.0MiB/1499msec) clat (msec): min=448, max=533, avg=482.37, stdev=44.80 lat (msec): min=448, max=533, avg=482.37, stdev=44.80 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 5542, max= 8192, per=74.23%, avg=6867.00, stdev=1873.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=54.54%, ctx=2667, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159641: Mon Sep 14 00:02:27 2026 read: IOPS=0, BW=2313KiB/s (2368kB/s)(4096KiB/1771msec) clat (nsec): min=360660k, max=360660k, avg=360659912.00, stdev= 0.00 lat (nsec): min=360661k, max=360661k, avg=360660821.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 5565, max= 5565, per=60.16%, avg=5565.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4626KiB/s (4737kB/s)(8192KiB/1771msec); 0 zone resets clat (msec): min=631, max=641, avg=636.47, stdev= 6.99 lat (msec): min=631, max=641, avg=636.74, stdev= 6.99 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=47.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.92%, ctx=1019, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159642: Mon Sep 14 00:02:27 2026 write: IOPS=1, BW=6423KiB/s (6578kB/s)(12.0MiB/1913msec); 0 zone resets clat (msec): min=75, max=1132, avg=611.57, stdev=528.49 lat (msec): min=76, max=1132, avg=611.88, stdev=528.52 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8192, max= 8192, per=47.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.10%, sys=10.36%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159643: Mon Sep 14 00:02:27 2026 write: IOPS=1, BW=7520KiB/s (7701kB/s)(12.0MiB/1634msec); 0 zone resets clat (msec): min=300, max=782, avg=511.11, stdev=246.76 lat (msec): min=301, max=783, avg=511.43, stdev=246.74 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 5704, max= 8192, per=40.56%, avg=6948.00, stdev=1759.28, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=17.02%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9251KiB/s (9473kB/s), 2313KiB/s-8197KiB/s (2368kB/s-8394kB/s), io=16.0MiB (16.8MB), run=1499-1771msec WRITE: bw=16.7MiB/s (17.5MB/s), 4626KiB/s-7520KiB/s (4737kB/s-7701kB/s), io=32.0MiB (33.6MB), run=1634-1913msec