== sanity test 398b: DIO and buffer IO race ============== 13:10:07 (1788801007) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.20078 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144764: Mon Sep 7 13:13:48 2026 read: IOPS=7, BW=30.2KiB/s (30.9kB/s)(5992KiB/198296msec) clat (usec): min=33, max=822720, avg=50034.19, stdev=44374.34 lat (usec): min=33, max=822721, avg=50037.27, stdev=44374.12 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 12911], 20.00th=[ 22676], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[200279], 99.50th=[256902], 99.90th=[557843], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 111, per=34.57%, avg=41.14, stdev=19.08, samples=284 iops : min= 1, max= 27, avg= 9.63, stdev= 4.80, samples=284 write: IOPS=7, BW=31.8KiB/s (32.5kB/s)(6296KiB/198296msec); 0 zone resets clat (usec): min=1093, max=51705k, avg=77976.57, stdev=1303035.10 lat (usec): min=1094, max=51705k, avg=77989.15, stdev=1303034.86 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 2147], | 20.00th=[ 5473], 30.00th=[ 10683], 40.00th=[ 21890], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 57934], | 80.00th=[ 77071], 90.00th=[ 105382], 95.00th=[ 135267], | 99.00th=[ 219153], 99.50th=[ 261096], 99.90th=[ 557843], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 128, per=34.06%, avg=42.23, stdev=19.55, samples=290 iops : min= 1, max= 32, avg= 9.92, stdev= 4.92, samples=290 lat (usec) : 50=0.13%, 100=3.12%, 250=0.49%, 500=0.13%, 1000=0.07% lat (msec) : 2=4.95%, 4=3.35%, 10=6.84%, 20=8.56%, 50=35.19% lat (msec) : 100=27.44%, 250=9.21%, 500=0.39%, 750=0.07%, 1000=0.03% lat (msec) : >=2000=0.03% cpu : usr=0.07%, sys=3.59%, ctx=6749, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144765: Mon Sep 7 13:13:48 2026 read: IOPS=7, BW=29.6KiB/s (30.3kB/s)(5940KiB/200448msec) clat (usec): min=34, max=832186, avg=49757.95, stdev=44284.89 lat (usec): min=34, max=832187, avg=49760.08, stdev=44285.02 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 3621], 20.00th=[ 21103], | 30.00th=[ 28181], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[113771], | 99.00th=[191890], 99.50th=[256902], 99.90th=[337642], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 96, per=33.22%, avg=39.53, stdev=19.50, samples=292 iops : min= 1, max= 24, avg= 9.24, stdev= 4.93, samples=292 write: IOPS=7, BW=31.7KiB/s (32.4kB/s)(6348KiB/200448msec); 0 zone resets clat (usec): min=952, max=51661k, avg=79398.80, stdev=1296470.77 lat (usec): min=952, max=51661k, avg=79401.74, stdev=1296470.76 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 2114], | 20.00th=[ 5866], 30.00th=[ 11600], 40.00th=[ 23987], | 50.00th=[ 34866], 60.00th=[ 47449], 70.00th=[ 61604], | 80.00th=[ 78119], 90.00th=[ 108528], 95.00th=[ 137364], | 99.00th=[ 206570], 99.50th=[ 235930], 99.90th=[ 408945], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 119, per=34.26%, avg=42.48, stdev=20.08, samples=291 iops : min= 1, max= 29, avg= 9.97, stdev= 5.05, samples=291 lat (usec) : 50=0.16%, 100=3.91%, 250=0.39%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.85%, 4=3.09%, 10=6.97%, 20=8.43%, 50=33.46% lat (msec) : 100=27.60%, 250=10.45%, 500=0.39%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.53%, ctx=6537, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144766: Mon Sep 7 13:13:48 2026 read: IOPS=7, BW=30.5KiB/s (31.2kB/s)(6028KiB/197889msec) clat (usec): min=30, max=856879, avg=49011.24, stdev=45360.20 lat (usec): min=30, max=856880, avg=49019.62, stdev=45358.66 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 603], 20.00th=[ 21365], | 30.00th=[ 27919], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[187696], 99.50th=[274727], 99.90th=[484443], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 119, per=34.22%, avg=40.72, stdev=19.40, samples=288 iops : min= 1, max= 29, avg= 9.53, stdev= 4.89, samples=288 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6260KiB/197889msec); 0 zone resets clat (usec): min=996, max=51697k, avg=78852.83, stdev=1306453.92 lat (usec): min=996, max=51697k, avg=78860.39, stdev=1306453.63 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1401], 10.00th=[ 2343], | 20.00th=[ 5538], 30.00th=[ 11600], 40.00th=[ 22414], | 50.00th=[ 34341], 60.00th=[ 45351], 70.00th=[ 58459], | 80.00th=[ 79168], 90.00th=[ 108528], 95.00th=[ 135267], | 99.00th=[ 200279], 99.50th=[ 235930], 99.90th=[ 325059], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 111, per=33.98%, avg=42.13, stdev=19.94, samples=289 iops : min= 1, max= 27, avg= 9.89, stdev= 5.02, samples=289 lat (usec) : 50=0.52%, 100=3.74%, 250=0.49%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=4.46%, 4=3.61%, 10=6.74%, 20=8.50%, 50=34.86% lat (msec) : 100=26.73%, 250=9.64%, 500=0.39%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.52%, ctx=6551, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144767: Mon Sep 7 13:13:48 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(6052KiB/201195msec) clat (usec): min=36, max=366889, avg=48823.45, stdev=38834.64 lat (usec): min=36, max=366890, avg=48827.83, stdev=38839.11 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 742], 20.00th=[ 20841], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[173016], 99.50th=[254804], 99.90th=[333448], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 95, per=33.89%, avg=40.33, stdev=18.80, samples=290 iops : min= 1, max= 23, avg= 9.43, stdev= 4.74, samples=290 write: IOPS=7, BW=30.0KiB/s (31.7kB/s)(6236KiB/201195msec); 0 zone resets clat (usec): min=1007, max=51773k, avg=81282.93, stdev=1311148.52 lat (usec): min=1008, max=51773k, avg=81289.26, stdev=1311148.52 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1369], 10.00th=[ 1713], | 20.00th=[ 5473], 30.00th=[ 10945], 40.00th=[ 22414], | 50.00th=[ 34866], 60.00th=[ 45876], 70.00th=[ 60556], | 80.00th=[ 79168], 90.00th=[ 109577], 95.00th=[ 145753], | 99.00th=[ 270533], 99.50th=[ 278922], 99.90th=[ 851444], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 119, per=33.18%, avg=41.14, stdev=19.57, samples=293 iops : min= 1, max= 29, avg= 9.65, stdev= 4.94, samples=293 lat (usec) : 50=0.42%, 100=3.84%, 250=0.42%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=5.50%, 4=2.60%, 10=6.74%, 20=8.63%, 50=33.24% lat (msec) : 100=27.67%, 250=9.80%, 500=0.75%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.56%, ctx=6624, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=119KiB/s (122kB/s), 29.6KiB/s-30.5KiB/s (30.3kB/s-31.2kB/s), io=23.4MiB (24.6MB), run=197889-201195msec WRITE: bw=125KiB/s (128kB/s), 30.0KiB/s-31.8KiB/s (31.7kB/s-32.5kB/s), io=24.6MiB (25.7MB), run=197889-201195msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144769: Mon Sep 7 13:16:06 2026 read: IOPS=4, BW=17.7KiB/s (18.1kB/s)(5992KiB/339102msec) clat (msec): min=5, max=1084, avg=40.00, stdev=49.85 lat (msec): min=5, max=1084, avg=40.00, stdev=49.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 112], | 99.00th=[ 207], 99.50th=[ 268], 99.90th=[ 567], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 95, per=34.20%, avg=23.94, stdev=16.42, samples=483 iops : min= 1, max= 23, avg= 5.36, stdev= 4.16, samples=483 write: IOPS=4, BW=18.6KiB/s (19.0kB/s)(6296KiB/339102msec); 0 zone resets clat (msec): min=39, max=51926, avg=177.23, stdev=1307.62 lat (msec): min=39, max=51926, avg=177.23, stdev=1307.62 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 418], 99.50th=[ 477], 99.90th=[ 600], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 6, max= 48, per=29.45%, avg=21.79, stdev=10.94, samples=555 iops : min= 1, max= 12, avg= 4.81, stdev= 2.80, samples=555 lat (msec) : 10=2.80%, 20=14.91%, 50=20.61%, 100=24.74%, 250=31.22% lat (msec) : 500=5.44%, 750=0.23%, 2000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.99%, ctx=5483, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144770: Mon Sep 7 13:16:06 2026 read: IOPS=4, BW=17.5KiB/s (17.0kB/s)(5940KiB/338829msec) clat (msec): min=5, max=958, avg=40.09, stdev=48.27 lat (msec): min=5, max=958, avg=40.09, stdev=48.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 120], | 99.00th=[ 203], 99.50th=[ 275], 99.90th=[ 558], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 95, per=34.64%, avg=24.25, stdev=16.37, samples=472 iops : min= 1, max= 23, avg= 5.44, stdev= 4.13, samples=472 write: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6348KiB/338829msec); 0 zone resets clat (msec): min=34, max=51810, avg=175.88, stdev=1299.37 lat (msec): min=34, max=51810, avg=175.88, stdev=1299.37 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 197], 90.00th=[ 253], 95.00th=[ 305], | 99.00th=[ 426], 99.50th=[ 477], 99.90th=[ 600], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 6, max= 55, per=29.91%, avg=22.13, stdev=10.99, samples=551 iops : min= 1, max= 13, avg= 4.90, stdev= 2.83, samples=551 lat (msec) : 10=3.35%, 20=14.36%, 50=20.83%, 100=24.38%, 250=31.51% lat (msec) : 500=5.31%, 750=0.20%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.94%, ctx=5214, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144771: Mon Sep 7 13:16:06 2026 read: IOPS=4, BW=17.8KiB/s (18.2kB/s)(6028KiB/339018msec) clat (msec): min=5, max=392, avg=41.86, stdev=42.26 lat (msec): min=5, max=392, avg=41.86, stdev=42.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 127], | 99.00th=[ 211], 99.50th=[ 259], 99.90th=[ 363], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 6, max= 103, per=33.40%, avg=23.38, stdev=16.26, samples=497 iops : min= 1, max= 25, avg= 5.22, stdev= 4.10, samples=497 write: IOPS=4, BW=18.5KiB/s (18.9kB/s)(6260KiB/339018msec); 0 zone resets clat (msec): min=37, max=51931, avg=176.21, stdev=1311.63 lat (msec): min=37, max=51931, avg=176.22, stdev=1311.63 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 192], 90.00th=[ 249], 95.00th=[ 296], | 99.00th=[ 439], 99.50th=[ 506], 99.90th=[ 1020], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 6, max= 55, per=29.46%, avg=21.80, stdev=11.08, samples=552 iops : min= 1, max= 13, avg= 4.82, stdev= 2.84, samples=552 lat (msec) : 10=2.77%, 20=13.54%, 50=21.71%, 100=24.06%, 250=32.75% lat (msec) : 500=4.92%, 750=0.20%, 2000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.00%, ctx=5355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144772: Mon Sep 7 13:16:06 2026 read: IOPS=4, BW=17.9KiB/s (18.3kB/s)(6052KiB/338256msec) clat (msec): min=5, max=51838, avg=74.34, stdev=1332.32 lat (msec): min=5, max=51838, avg=74.35, stdev=1332.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 121], | 99.00th=[ 232], 99.50th=[ 275], 99.90th=[ 372], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 102, per=34.76%, avg=24.34, stdev=17.26, samples=480 iops : min= 1, max= 25, avg= 5.45, stdev= 4.37, samples=480 write: IOPS=4, BW=18.4KiB/s (18.9kB/s)(6236KiB/338256msec); 0 zone resets clat (msec): min=37, max=1183, avg=144.72, stdev=84.52 lat (msec): min=37, max=1183, avg=144.72, stdev=84.52 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 190], 90.00th=[ 247], 95.00th=[ 309], | 99.00th=[ 418], 99.50th=[ 535], 99.90th=[ 726], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 6, max= 63, per=29.30%, avg=21.68, stdev=10.91, samples=552 iops : min= 1, max= 15, avg= 4.79, stdev= 2.80, samples=552 lat (msec) : 10=3.22%, 20=14.81%, 50=20.51%, 100=24.06%, 250=32.03% lat (msec) : 500=5.05%, 750=0.26%, 2000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.01%, ctx=5384, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=70.8KiB/s (72.5kB/s), 17.5KiB/s-17.9KiB/s (17.0kB/s-18.3kB/s), io=23.4MiB (24.6MB), run=338256-339102msec WRITE: bw=74.1KiB/s (75.9kB/s), 18.4KiB/s-18.7KiB/s (18.9kB/s-19.2kB/s), io=24.6MiB (25.7MB), run=338256-339102msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Mon Sep 7 13:16:53 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(5920KiB/31264msec) clat (usec): min=36, max=229795, avg=43291.20, stdev=35360.89 lat (usec): min=36, max=229796, avg=43334.98, stdev=35346.94 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 955], | 30.00th=[ 25822], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[166724], 99.50th=[217056], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 377, per=25.85%, avg=187.70, stdev=64.17, samples=61 iops : min= 3, max= 23, avg=10.95, stdev= 4.05, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31264msec); 0 zone resets clat (usec): min=1357, max=210314, avg=38048.14, stdev=38559.50 lat (usec): min=1359, max=210316, avg=38050.36, stdev=38559.84 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1745], 10.00th=[ 2311], 20.00th=[ 6915], | 30.00th=[ 10421], 40.00th=[ 16319], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 49021], 80.00th=[ 66847], 90.00th=[ 88605], 95.00th=[115868], | 99.00th=[173016], 99.50th=[189793], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 63, max= 479, per=27.06%, avg=206.72, stdev=83.98, samples=60 iops : min= 3, max= 29, avg=12.15, stdev= 5.31, samples=60 lat (usec) : 50=0.78%, 100=7.94%, 250=0.78%, 1000=0.13% lat (msec) : 2=4.82%, 4=2.60%, 10=8.07%, 20=10.03%, 50=31.51% lat (msec) : 100=26.56%, 250=6.77% cpu : usr=0.08%, sys=5.38%, ctx=1423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Mon Sep 7 13:16:53 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5744KiB/32973msec) clat (usec): min=37, max=213238, avg=43527.68, stdev=36069.05 lat (usec): min=37, max=213240, avg=43566.83, stdev=36030.30 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 231], | 30.00th=[ 21890], 40.00th=[ 32375], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[162530], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 28, max= 416, per=24.96%, avg=181.18, stdev=83.99, samples=61 iops : min= 1, max= 26, avg=10.54, stdev= 5.34, samples=61 write: IOPS=12, BW=198KiB/s (203kB/s)(6544KiB/32973msec); 0 zone resets clat (usec): min=1265, max=291794, avg=41319.48, stdev=49348.25 lat (usec): min=1267, max=291796, avg=41324.13, stdev=49346.42 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1745], 10.00th=[ 2900], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 15008], 50.00th=[ 23725], 60.00th=[ 34341], | 70.00th=[ 48497], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[128451], | 99.00th=[261096], 99.50th=[270533], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 29, max= 479, per=25.99%, avg=198.57, stdev=87.98, samples=63 iops : min= 1, max= 29, avg=11.63, stdev= 5.58, samples=63 lat (usec) : 50=0.91%, 100=7.81%, 250=0.65%, 500=0.13%, 750=0.39% lat (msec) : 2=3.65%, 4=4.43%, 10=10.29%, 20=8.72%, 50=29.69% lat (msec) : 100=25.00%, 250=7.68%, 500=0.65% cpu : usr=0.09%, sys=5.64%, ctx=1479, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Mon Sep 7 13:16:53 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31064msec) clat (usec): min=36, max=245389, avg=45193.99, stdev=36990.37 lat (usec): min=36, max=245390, avg=45195.15, stdev=36990.34 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 78], 20.00th=[ 19268], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 52691], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[208667], 99.50th=[233833], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 30, max= 433, per=27.81%, avg=201.90, stdev=80.94, samples=61 iops : min= 1, max= 27, avg=11.85, stdev= 5.13, samples=61 write: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31064msec); 0 zone resets clat (usec): min=1371, max=241090, avg=34687.32, stdev=38958.25 lat (usec): min=1372, max=241091, avg=34726.23, stdev=39014.38 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 2409], 20.00th=[ 4948], | 30.00th=[ 7832], 40.00th=[ 12649], 50.00th=[ 20841], 60.00th=[ 31851], | 70.00th=[ 43254], 80.00th=[ 60556], 90.00th=[ 82314], 95.00th=[113771], | 99.00th=[179307], 99.50th=[229639], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 380, per=25.34%, avg=193.59, stdev=83.67, samples=61 iops : min= 1, max= 23, avg=11.31, stdev= 5.27, samples=61 lat (usec) : 50=0.78%, 100=6.25%, 250=0.65%, 500=0.52% lat (msec) : 2=4.43%, 4=4.56%, 10=8.72%, 20=8.72%, 50=34.77% lat (msec) : 100=23.96%, 250=6.64% cpu : usr=0.07%, sys=5.69%, ctx=1493, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Mon Sep 7 13:16:53 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(6032KiB/30976msec) clat (usec): min=34, max=169908, avg=44271.52, stdev=32724.14 lat (usec): min=34, max=169910, avg=44273.64, stdev=32724.44 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 15008], | 30.00th=[ 27919], 40.00th=[ 34866], 50.00th=[ 43779], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[154141], 99.50th=[156238], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 29, max= 407, per=27.76%, avg=201.57, stdev=72.26, samples=58 iops : min= 1, max= 25, avg=11.83, stdev= 4.60, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30976msec); 0 zone resets clat (usec): min=1511, max=315046, avg=35941.84, stdev=42070.93 lat (usec): min=1512, max=315048, avg=35944.00, stdev=42070.88 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1844], 10.00th=[ 2868], 20.00th=[ 5800], | 30.00th=[ 8356], 40.00th=[ 12649], 50.00th=[ 21365], 60.00th=[ 32375], | 70.00th=[ 42730], 80.00th=[ 58983], 90.00th=[ 87557], 95.00th=[114820], | 99.00th=[200279], 99.50th=[265290], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 63, max= 430, per=26.52%, avg=202.65, stdev=79.51, samples=60 iops : min= 3, max= 26, avg=11.92, stdev= 5.00, samples=60 lat (usec) : 50=1.17%, 100=6.64%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.52%, 4=4.30%, 10=9.90%, 20=8.85%, 50=32.68% lat (msec) : 100=25.39%, 250=6.12%, 500=0.26% cpu : usr=0.09%, sys=5.52%, ctx=1475, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=726KiB/s (744kB/s), 174KiB/s-201KiB/s (178kB/s-206kB/s), io=23.4MiB (24.5MB), run=30976-32973msec WRITE: bw=764KiB/s (783kB/s), 194KiB/s-204KiB/s (199kB/s-209kB/s), io=24.6MiB (25.8MB), run=30976-32973msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Mon Sep 7 13:17:36 2026 read: IOPS=4, BW=78.9KiB/s (80.8kB/s)(5920KiB/75051msec) clat (msec): min=6, max=534, avg=40.83, stdev=51.11 lat (msec): min=6, max=534, avg=40.83, stdev=51.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 93], 95.00th=[ 130], | 99.00th=[ 284], 99.50th=[ 330], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 29, max= 255, per=28.37%, avg=89.36, stdev=53.48, samples=130 iops : min= 1, max= 15, avg= 4.80, stdev= 3.44, samples=130 write: IOPS=5, BW=84.8KiB/s (86.9kB/s)(6368KiB/75051msec); 0 zone resets clat (msec): min=42, max=578, avg=150.27, stdev=70.75 lat (msec): min=42, max=578, avg=150.28, stdev=70.75 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 129], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 241], 95.00th=[ 300], | 99.00th=[ 384], 99.50th=[ 414], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 27, max= 160, per=26.07%, avg=86.28, stdev=38.57, samples=145 iops : min= 1, max= 10, avg= 4.60, stdev= 2.47, samples=145 lat (msec) : 10=2.60%, 20=15.89%, 50=20.44%, 100=17.58%, 250=38.41% lat (msec) : 500=4.82%, 750=0.26% cpu : usr=0.04%, sys=1.14%, ctx=1240, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Mon Sep 7 13:17:36 2026 read: IOPS=4, BW=75.6KiB/s (77.4kB/s)(5744KiB/76028msec) clat (msec): min=7, max=243, avg=41.56, stdev=43.12 lat (msec): min=7, max=243, avg=41.56, stdev=43.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 101], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 241], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 28, max= 383, per=30.02%, avg=94.57, stdev=65.90, samples=119 iops : min= 1, max= 23, avg= 5.14, stdev= 4.20, samples=119 write: IOPS=5, BW=86.1KiB/s (88.1kB/s)(6544KiB/76028msec); 0 zone resets clat (msec): min=45, max=721, avg=148.67, stdev=79.77 lat (msec): min=45, max=721, avg=148.68, stdev=79.77 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 115], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 249], 95.00th=[ 284], | 99.00th=[ 447], 99.50th=[ 567], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 28, max= 223, per=26.42%, avg=87.44, stdev=41.84, samples=147 iops : min= 1, max= 13, avg= 4.68, stdev= 2.62, samples=147 lat (msec) : 10=1.56%, 20=13.80%, 50=22.66%, 100=17.32%, 250=39.84% lat (msec) : 500=4.30%, 750=0.52% cpu : usr=0.04%, sys=1.15%, ctx=1317, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Mon Sep 7 13:17:36 2026 read: IOPS=5, BW=86.9KiB/s (89.0kB/s)(6256KiB/71951msec) clat (msec): min=6, max=325, avg=38.88, stdev=43.98 lat (msec): min=6, max=325, avg=38.89, stdev=43.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 80], 95.00th=[ 120], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 347, per=32.18%, avg=101.38, stdev=68.24, samples=122 iops : min= 1, max= 21, avg= 5.57, stdev= 4.30, samples=122 write: IOPS=5, BW=83.8KiB/s (85.8kB/s)(6032KiB/71951msec); 0 zone resets clat (msec): min=41, max=537, avg=149.42, stdev=70.95 lat (msec): min=41, max=537, avg=149.42, stdev=70.95 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 279], | 99.00th=[ 397], 99.50th=[ 405], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 29, max= 189, per=25.80%, avg=85.40, stdev=36.40, samples=139 iops : min= 1, max= 11, avg= 4.55, stdev= 2.33, samples=139 lat (msec) : 10=1.56%, 20=15.49%, 50=25.78%, 100=17.84%, 250=34.38% lat (msec) : 500=4.82%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1336, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Mon Sep 7 13:17:36 2026 read: IOPS=5, BW=81.9KiB/s (83.9kB/s)(6032KiB/73624msec) clat (msec): min=6, max=478, avg=42.88, stdev=54.13 lat (msec): min=6, max=478, avg=42.88, stdev=54.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 94], 95.00th=[ 142], | 99.00th=[ 300], 99.50th=[ 321], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 320, per=29.79%, avg=93.84, stdev=61.50, samples=125 iops : min= 1, max= 20, avg= 5.10, stdev= 3.92, samples=125 write: IOPS=5, BW=84.0KiB/s (87.0kB/s)(6256KiB/73624msec); 0 zone resets clat (msec): min=48, max=570, avg=146.42, stdev=68.09 lat (msec): min=48, max=570, avg=146.43, stdev=68.09 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 131], 60.00th=[ 153], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 243], 95.00th=[ 268], | 99.00th=[ 376], 99.50th=[ 464], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 29, max= 160, per=26.06%, avg=86.27, stdev=39.03, samples=142 iops : min= 1, max= 10, avg= 4.61, stdev= 2.49, samples=142 lat (msec) : 10=2.21%, 20=14.06%, 50=23.44%, 100=19.53%, 250=35.55% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1347, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=315KiB/s (323kB/s), 75.6KiB/s-86.9KiB/s (77.4kB/s-89.0kB/s), io=23.4MiB (24.5MB), run=71951-76028msec WRITE: bw=331KiB/s (339kB/s), 83.8KiB/s-86.1KiB/s (85.8kB/s-88.1kB/s), io=24.6MiB (25.8MB), run=71951-76028msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144860: Mon Sep 7 13:17:53 2026 read: IOPS=1, BW=1764KiB/s (1807kB/s)(7168KiB/4063msec) clat (msec): min=3, max=464, avg=255.93, stdev=138.36 lat (msec): min=3, max=464, avg=255.93, stdev=138.36 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 228], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 247], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 334], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1988, max= 2955, per=59.59%, avg=2213.00, stdev=415.46, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1260KiB/s (1290kB/s)(5120KiB/4063msec); 0 zone resets clat (msec): min=196, max=701, avg=442.20, stdev=193.15 lat (msec): min=196, max=701, avg=442.32, stdev=193.19 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1969, max= 2043, per=38.60%, avg=2006.75, stdev=34.16, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=18.34%, ctx=181, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144861: Mon Sep 7 13:17:53 2026 read: IOPS=0, BW=371KiB/s (380kB/s)(2048KiB/5514msec) clat (usec): min=1989, max=731172, avg=366581.19, stdev=515610.44 lat (usec): min=1990, max=731176, avg=366583.55, stdev=515612.17 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 1991], 10.00th=[ 1991], 20.00th=[ 1991], | 30.00th=[ 1991], 40.00th=[ 1991], 50.00th=[ 1991], 60.00th=[734004], | 70.00th=[734004], 80.00th=[734004], 90.00th=[734004], 95.00th=[734004], | 99.00th=[734004], 99.50th=[734004], 99.90th=[734004], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 1988, max= 2048, per=54.33%, avg=2018.00, stdev=42.43, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1857KiB/s (1902kB/s)(10.0MiB/5514msec); 0 zone resets clat (msec): min=132, max=987, avg=452.57, stdev=243.58 lat (msec): min=132, max=987, avg=452.93, stdev=243.53 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 266], | 30.00th=[ 317], 40.00th=[ 338], 50.00th=[ 363], 60.00th=[ 409], | 70.00th=[ 443], 80.00th=[ 600], 90.00th=[ 667], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1969, max= 4096, per=69.98%, avg=3638.20, stdev=934.32, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 250=8.33%, 500=50.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=13.99%, ctx=169, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144862: Mon Sep 7 13:17:53 2026 read: IOPS=1, BW=1384KiB/s (1417kB/s)(6144KiB/4439msec) clat (msec): min=23, max=450, avg=269.38, stdev=171.12 lat (msec): min=23, max=450, avg=269.38, stdev=171.12 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 384], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1969, max= 4055, per=67.60%, avg=2510.75, stdev=1029.83, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1384KiB/s (1417kB/s)(6144KiB/4439msec); 0 zone resets clat (msec): min=168, max=831, avg=448.33, stdev=221.25 lat (msec): min=168, max=832, avg=448.57, stdev=221.54 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 451], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1484, max= 2048, per=37.04%, avg=1925.83, stdev=218.56, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 50=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.62%, ctx=203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144863: Mon Sep 7 13:17:53 2026 read: IOPS=1, BW=1157KiB/s (1185kB/s)(5120KiB/4426msec) clat (msec): min=3, max=336, avg=238.60, stdev=136.93 lat (msec): min=3, max=336, avg=238.60, stdev=136.93 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 3938, max= 4055, per=100.00%, avg=3996.50, stdev=82.73, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1620KiB/s (1658kB/s)(7168KiB/4426msec); 0 zone resets clat (msec): min=118, max=707, avg=440.10, stdev=214.73 lat (msec): min=118, max=707, avg=440.22, stdev=214.72 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 284], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 397], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 684], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1988, max= 4071, per=54.68%, avg=2842.60, stdev=1117.97, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 4=8.33%, 250=16.67%, 500=50.00%, 750=25.00% cpu : usr=0.05%, sys=16.02%, ctx=211, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3714KiB/s (3803kB/s), 371KiB/s-1764KiB/s (380kB/s-1807kB/s), io=20.0MiB (20.0MB), run=4063-5514msec WRITE: bw=5200KiB/s (5325kB/s), 1260KiB/s-1857KiB/s (1290kB/s-1902kB/s), io=28.0MiB (29.4MB), run=4063-5514msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144865: Mon Sep 7 13:17:54 2026 read: IOPS=1, BW=1412KiB/s (1446kB/s)(7168KiB/5075msec) clat (msec): min=96, max=801, avg=355.06, stdev=248.81 lat (msec): min=96, max=801, avg=355.07, stdev=248.81 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 122], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 288], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 498], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1582, max= 2048, per=56.15%, avg=1935.50, stdev=176.23, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=1009KiB/s (1033kB/s)(5120KiB/5075msec); 0 zone resets clat (msec): min=395, max=596, avg=460.97, stdev=79.88 lat (msec): min=401, max=596, avg=462.18, stdev=78.78 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1899, max= 2023, per=40.99%, avg=1978.25, stdev=54.74, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144866: Mon Sep 7 13:17:54 2026 read: IOPS=0, BW=361KiB/s (369kB/s)(2048KiB/5679msec) clat (msec): min=141, max=669, avg=405.61, stdev=372.93 lat (msec): min=141, max=669, avg=405.61, stdev=372.93 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2035, max= 2048, per=59.23%, avg=2041.50, stdev= 9.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1803KiB/s (1846kB/s)(10.0MiB/5679msec); 0 zone resets clat (msec): min=178, max=1315, avg=453.68, stdev=370.84 lat (msec): min=178, max=1315, avg=453.81, stdev=370.86 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 230], | 30.00th=[ 234], 40.00th=[ 243], 50.00th=[ 305], 60.00th=[ 355], | 70.00th=[ 359], 80.00th=[ 388], 90.00th=[ 936], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1957, max= 4047, per=66.56%, avg=3212.20, stdev=1110.68, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.31%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144867: Mon Sep 7 13:17:54 2026 read: IOPS=1, BW=1185KiB/s (1214kB/s)(6144KiB/5184msec) clat (msec): min=76, max=253, avg=184.72, stdev=83.59 lat (msec): min=76, max=253, avg=184.73, stdev=83.59 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 230], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 2023, max= 3976, per=77.69%, avg=2678.00, stdev=1124.12, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1185KiB/s (1214kB/s)(6144KiB/5184msec); 0 zone resets clat (msec): min=307, max=1448, avg=635.71, stdev=434.07 lat (msec): min=307, max=1448, avg=635.99, stdev=434.06 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 518], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1921, max= 2048, per=41.57%, avg=2006.00, stdev=50.32, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.44%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144868: Mon Sep 7 13:17:54 2026 read: IOPS=0, BW=862KiB/s (882kB/s)(5120KiB/5941msec) clat (msec): min=111, max=601, avg=271.62, stdev=199.35 lat (msec): min=111, max=601, avg=271.62, stdev=199.34 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2035, max= 4015, per=78.22%, avg=2696.33, stdev=1142.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1207KiB/s (1235kB/s)(7168KiB/5941msec); 0 zone resets clat (msec): min=92, max=1239, avg=616.12, stdev=518.38 lat (msec): min=93, max=1239, avg=616.25, stdev=518.34 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 114], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 625], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1899, max= 4079, per=49.47%, avg=2387.40, stdev=947.30, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=3.54%, ctx=83, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3447KiB/s (3530kB/s), 361KiB/s-1412KiB/s (369kB/s-1446kB/s), io=20.0MiB (20.0MB), run=5075-5941msec WRITE: bw=4826KiB/s (4942kB/s), 1009KiB/s-1803KiB/s (1033kB/s-1846kB/s), io=28.0MiB (29.4MB), run=5075-5941msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144876: Mon Sep 7 13:18:10 2026 read: IOPS=1, BW=4452KiB/s (4559kB/s)(12.0MiB/2760msec) clat (msec): min=900, max=933, avg=919.64, stdev=17.37 lat (msec): min=900, max=933, avg=919.64, stdev=17.37 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.57%, ctx=247, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144877: Mon Sep 7 13:18:10 2026 read: IOPS=0, BW=1069KiB/s (1095kB/s)(4096KiB/3830msec) clat (nsec): min=911986k, max=911986k, avg=911985858.00, stdev= 0.00 lat (nsec): min=911987k, max=911987k, avg=911986621.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2139KiB/s (2190kB/s)(8192KiB/3830msec); 0 zone resets clat (msec): min=893, max=2022, avg=1458.00, stdev=799.02 lat (msec): min=893, max=2023, avg=1458.42, stdev=799.08 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 2022], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8192, max= 8192, per=95.76%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.48%, ctx=105, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Mon Sep 7 13:18:10 2026 write: IOPS=1, BW=4560KiB/s (4669kB/s)(12.0MiB/2695msec); 0 zone resets clat (msec): min=351, max=1568, avg=886.17, stdev=621.63 lat (msec): min=351, max=1568, avg=886.51, stdev=621.68 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8015, max= 8192, per=94.72%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.34%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Mon Sep 7 13:18:10 2026 write: IOPS=1, BW=4475KiB/s (4582kB/s)(12.0MiB/2746msec); 0 zone resets clat (msec): min=700, max=1288, avg=913.75, stdev=325.73 lat (msec): min=701, max=1289, avg=914.17, stdev=325.71 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8126, max= 8192, per=95.37%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.85%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4278KiB/s (4380kB/s), 1069KiB/s-4452KiB/s (1095kB/s-4559kB/s), io=16.0MiB (16.8MB), run=2760-3830msec WRITE: bw=8556KiB/s (8761kB/s), 2139KiB/s-4560KiB/s (2190kB/s-4669kB/s), io=32.0MiB (33.6MB), run=2695-3830msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Mon Sep 7 13:18:10 2026 read: IOPS=1, BW=4312KiB/s (4415kB/s)(12.0MiB/2850msec) clat (msec): min=690, max=1191, avg=940.43, stdev=250.93 lat (msec): min=690, max=1191, avg=940.43, stdev=250.93 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7787, max= 8175, per=100.00%, avg=7981.00, stdev=274.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.51%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144882: Mon Sep 7 13:18:10 2026 read: IOPS=0, BW=1110KiB/s (1136kB/s)(4096KiB/3691msec) clat (nsec): min=518928k, max=518928k, avg=518927670.00, stdev= 0.00 lat (nsec): min=518930k, max=518930k, avg=518930297.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 6122, max= 6122, per=100.00%, avg=6122.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2219KiB/s (2273kB/s)(8192KiB/3691msec); 0 zone resets clat (msec): min=1183, max=1974, avg=1579.33, stdev=559.18 lat (msec): min=1184, max=1975, avg=1579.75, stdev=559.20 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8062, max= 8062, per=90.82%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.82%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144883: Mon Sep 7 13:18:10 2026 write: IOPS=0, BW=3777KiB/s (3868kB/s)(12.0MiB/3253msec); 0 zone resets clat (msec): min=404, max=1851, avg=1083.24, stdev=727.69 lat (msec): min=405, max=1852, avg=1083.89, stdev=727.48 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 7787, max= 8159, per=89.82%, avg=7973.00, stdev=263.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.32%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144884: Mon Sep 7 13:18:10 2026 write: IOPS=1, BW=4097KiB/s (4196kB/s)(12.0MiB/2999msec); 0 zone resets clat (msec): min=433, max=1581, avg=980.07, stdev=575.96 lat (msec): min=434, max=1581, avg=981.24, stdev=575.61 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7787, max= 8062, per=89.27%, avg=7924.50, stdev=194.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.77%, ctx=39, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4439KiB/s (4545kB/s), 1110KiB/s-4312KiB/s (1136kB/s-4415kB/s), io=16.0MiB (16.8MB), run=2850-3691msec WRITE: bw=8878KiB/s (9091kB/s), 2219KiB/s-4097KiB/s (2273kB/s-4196kB/s), io=32.0MiB (33.6MB), run=2999-3691msec