== sanity test 398b: DIO and buffer IO race ============== 09:37:22 (1786023442) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.85114 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178478: Thu Aug 6 09:40:21 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(5992KiB/155638msec) clat (usec): min=38, max=347583, avg=58399.29, stdev=38335.99 lat (usec): min=38, max=347584, avg=58400.54, stdev=38336.02 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 13173], 10.00th=[ 20841], 20.00th=[ 29754], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 50594], 60.00th=[ 60031], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[104334], 95.00th=[126354], | 99.00th=[198181], 99.50th=[219153], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 80, per=24.93%, avg=38.14, stdev=14.59, samples=304 iops : min= 1, max= 20, avg= 8.88, stdev= 3.70, samples=304 write: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6296KiB/155638msec); 0 zone resets clat (usec): min=978, max=900776, avg=43055.80, stdev=48741.10 lat (usec): min=979, max=900778, avg=43056.96, stdev=48741.14 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1303], 20.00th=[ 4883], | 30.00th=[ 9241], 40.00th=[ 18744], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 54264], 80.00th=[ 73925], 90.00th=[105382], 95.00th=[130548], | 99.00th=[185598], 99.50th=[219153], 99.90th=[299893], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 119, per=24.97%, avg=40.20, stdev=18.74, samples=303 iops : min= 1, max= 29, avg= 9.40, stdev= 4.73, samples=303 lat (usec) : 50=0.88%, 100=1.04%, 250=0.07%, 750=0.07%, 1000=0.16% lat (msec) : 2=6.71%, 4=2.41%, 10=6.58%, 20=7.45%, 50=32.78% lat (msec) : 100=30.14%, 250=11.59%, 500=0.10%, 1000=0.03% cpu : usr=0.05%, sys=3.80%, ctx=5986, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178479: Thu Aug 6 09:40:21 2026 read: IOPS=9, BW=38.6KiB/s (39.5kB/s)(5940KiB/153867msec) clat (usec): min=40, max=374663, avg=56919.77, stdev=35495.69 lat (usec): min=40, max=374664, avg=56920.83, stdev=35495.87 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 15008], 10.00th=[ 21890], 20.00th=[ 30016], | 30.00th=[ 36963], 40.00th=[ 43254], 50.00th=[ 51643], 60.00th=[ 58983], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[181404], 99.50th=[212861], 99.90th=[312476], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 87, per=25.11%, avg=38.41, stdev=16.22, samples=300 iops : min= 1, max= 21, avg= 8.94, stdev= 4.11, samples=300 write: IOPS=10, BW=41.3KiB/s (42.2kB/s)(6348KiB/153867msec); 0 zone resets clat (usec): min=957, max=970361, avg=43441.14, stdev=50984.50 lat (usec): min=957, max=970361, avg=43443.16, stdev=50985.72 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1287], 20.00th=[ 3916], | 30.00th=[ 8717], 40.00th=[ 19006], 50.00th=[ 31327], 60.00th=[ 41157], | 70.00th=[ 55837], 80.00th=[ 71828], 90.00th=[107480], 95.00th=[137364], | 99.00th=[198181], 99.50th=[227541], 99.90th=[295699], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 99, per=25.53%, avg=41.11, stdev=18.57, samples=300 iops : min= 1, max= 24, avg= 9.61, stdev= 4.68, samples=300 lat (usec) : 50=0.55%, 100=0.78%, 1000=0.10% lat (msec) : 2=7.62%, 4=2.77%, 10=6.22%, 20=7.03%, 50=32.85% lat (msec) : 100=31.71%, 250=10.12%, 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=3.89%, ctx=5907, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178481: Thu Aug 6 09:40:21 2026 read: IOPS=9, BW=38.8KiB/s (39.8kB/s)(6028KiB/155258msec) clat (usec): min=35, max=309027, avg=56284.71, stdev=34152.04 lat (usec): min=36, max=309028, avg=56286.32, stdev=34151.99 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 13829], 10.00th=[ 21103], 20.00th=[ 28967], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 81265], 90.00th=[ 99091], 95.00th=[116917], | 99.00th=[164627], 99.50th=[187696], 99.90th=[219153], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 95, per=25.42%, avg=38.89, stdev=14.91, samples=300 iops : min= 1, max= 23, avg= 9.06, stdev= 3.76, samples=300 write: IOPS=10, BW=40.3KiB/s (41.3kB/s)(6260KiB/155258msec); 0 zone resets clat (usec): min=887, max=1021.8k, avg=44733.48, stdev=51991.75 lat (usec): min=888, max=1021.8k, avg=44739.71, stdev=51996.10 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1287], | 20.00th=[ 4080], 30.00th=[ 8356], 40.00th=[ 20055], | 50.00th=[ 31851], 60.00th=[ 43779], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 107480], 95.00th=[ 133694], | 99.00th=[ 187696], 99.50th=[ 229639], 99.90th=[ 367002], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 94, per=25.02%, avg=40.28, stdev=17.68, samples=300 iops : min= 1, max= 23, avg= 9.42, stdev= 4.46, samples=300 lat (usec) : 50=0.94%, 100=0.91%, 1000=0.07% lat (msec) : 2=7.32%, 4=2.57%, 10=6.38%, 20=6.45%, 50=32.52% lat (msec) : 100=31.84%, 250=10.77%, 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=3.95%, ctx=6092, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178482: Thu Aug 6 09:40:21 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6052KiB/155973msec) clat (usec): min=27, max=348023, avg=58075.89, stdev=35375.43 lat (usec): min=27, max=348024, avg=58078.20, stdev=35374.72 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 12911], 10.00th=[ 21365], 20.00th=[ 30540], | 30.00th=[ 36963], 40.00th=[ 44303], 50.00th=[ 51643], 60.00th=[ 60031], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[102237], 95.00th=[120062], | 99.00th=[181404], 99.50th=[196084], 99.90th=[256902], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 87, per=25.16%, avg=38.50, stdev=15.37, samples=305 iops : min= 1, max= 21, avg= 8.96, stdev= 3.86, samples=305 write: IOPS=9, BW=39.0KiB/s (40.9kB/s)(6236KiB/155973msec); 0 zone resets clat (usec): min=949, max=917991, avg=43416.07, stdev=49241.19 lat (usec): min=950, max=917992, avg=43417.18, stdev=49241.22 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1287], 20.00th=[ 3884], | 30.00th=[ 7898], 40.00th=[ 18482], 50.00th=[ 30278], 60.00th=[ 41681], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[135267], | 99.00th=[183501], 99.50th=[202376], 99.90th=[252707], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 125, per=24.62%, avg=39.64, stdev=17.88, samples=305 iops : min= 1, max= 31, avg= 9.25, stdev= 4.51, samples=305 lat (usec) : 50=0.88%, 100=0.85%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=7.62%, 4=2.64%, 10=5.99%, 20=7.03%, 50=31.64% lat (msec) : 100=31.90%, 250=11.10%, 500=0.10%, 1000=0.03% cpu : usr=0.05%, sys=4.03%, ctx=6111, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=154KiB/s (158kB/s), 38.5KiB/s-38.8KiB/s (39.4kB/s-39.8kB/s), io=23.4MiB (24.6MB), run=153867-155973msec WRITE: bw=161KiB/s (165kB/s), 39.0KiB/s-41.3KiB/s (40.9kB/s-42.2kB/s), io=24.6MiB (25.7MB), run=153867-155973msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178480: Thu Aug 6 09:41:23 2026 read: IOPS=6, BW=27.6KiB/s (28.2kB/s)(5992KiB/217387msec) clat (msec): min=5, max=1026, avg=58.12, stdev=55.03 lat (msec): min=5, max=1026, avg=58.12, stdev=55.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 234], 99.50th=[ 268], 99.90th=[ 542], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 110, per=25.76%, avg=28.34, stdev=17.98, samples=405 iops : min= 1, max= 27, avg= 6.42, stdev= 4.54, samples=405 write: IOPS=7, BW=28.0KiB/s (29.7kB/s)(6296KiB/217387msec); 0 zone resets clat (msec): min=6, max=447, avg=82.57, stdev=52.07 lat (msec): min=6, max=447, avg=82.58, stdev=52.06 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 69], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 116], 90.00th=[ 153], 95.00th=[ 184], | 99.00th=[ 262], 99.50th=[ 296], 99.90th=[ 426], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 87, per=25.22%, avg=29.00, stdev=15.35, samples=417 iops : min= 1, max= 21, avg= 6.59, stdev= 3.85, samples=417 lat (msec) : 10=0.78%, 20=7.26%, 50=37.14%, 100=33.24%, 250=20.51% lat (msec) : 500=1.01%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.49%, ctx=4552, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178483: Thu Aug 6 09:41:23 2026 read: IOPS=6, BW=27.3KiB/s (27.9kB/s)(5940KiB/217859msec) clat (msec): min=4, max=1007, avg=57.70, stdev=56.33 lat (msec): min=4, max=1007, avg=57.70, stdev=56.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 123], 95.00th=[ 163], | 99.00th=[ 271], 99.50th=[ 288], 99.90th=[ 542], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 95, per=25.51%, avg=28.06, stdev=17.77, samples=406 iops : min= 1, max= 23, avg= 6.34, stdev= 4.46, samples=406 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6348KiB/217859msec); 0 zone resets clat (msec): min=11, max=416, avg=83.07, stdev=55.51 lat (msec): min=11, max=416, avg=83.08, stdev=55.51 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 80], | 70.00th=[ 95], 80.00th=[ 121], 90.00th=[ 159], 95.00th=[ 194], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 397], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 103, per=25.37%, avg=29.18, stdev=15.97, samples=417 iops : min= 1, max= 25, avg= 6.63, stdev= 4.02, samples=417 lat (msec) : 10=0.75%, 20=6.80%, 50=39.29%, 100=32.23%, 250=19.60% lat (msec) : 500=1.27%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.51%, ctx=4640, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178484: Thu Aug 6 09:41:23 2026 read: IOPS=7, BW=28.2KiB/s (28.8kB/s)(6028KiB/214008msec) clat (msec): min=6, max=539, avg=56.77, stdev=48.19 lat (msec): min=6, max=539, avg=56.77, stdev=48.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 83], 90.00th=[ 127], 95.00th=[ 161], | 99.00th=[ 211], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 102, per=26.21%, avg=28.83, stdev=17.55, samples=403 iops : min= 1, max= 25, avg= 6.55, stdev= 4.43, samples=403 write: IOPS=7, BW=29.3KiB/s (29.0kB/s)(6260KiB/214008msec); 0 zone resets clat (msec): min=12, max=993, avg=81.91, stdev=58.80 lat (msec): min=12, max=993, avg=81.91, stdev=58.80 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 77], | 70.00th=[ 92], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 376], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 86, per=25.41%, avg=29.22, stdev=16.73, samples=413 iops : min= 1, max= 21, avg= 6.64, stdev= 4.23, samples=413 lat (msec) : 10=0.65%, 20=6.80%, 50=40.20%, 100=31.45%, 250=19.66% lat (msec) : 500=1.17%, 750=0.03%, 1000=0.03% cpu : usr=0.03%, sys=1.47%, ctx=4637, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178485: Thu Aug 6 09:41:23 2026 read: IOPS=6, BW=27.8KiB/s (28.4kB/s)(6052KiB/217889msec) clat (msec): min=5, max=545, avg=56.26, stdev=48.66 lat (msec): min=5, max=545, avg=56.26, stdev=48.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 82], 90.00th=[ 118], 95.00th=[ 157], | 99.00th=[ 224], 99.50th=[ 288], 99.90th=[ 342], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 103, per=26.10%, avg=28.71, stdev=18.16, samples=404 iops : min= 1, max= 25, avg= 6.51, stdev= 4.57, samples=404 write: IOPS=7, BW=28.6KiB/s (29.3kB/s)(6236KiB/217889msec); 0 zone resets clat (msec): min=13, max=984, avg=84.95, stdev=62.15 lat (msec): min=13, max=984, avg=84.95, stdev=62.15 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 42], | 30.00th=[ 49], 40.00th=[ 57], 50.00th=[ 68], 60.00th=[ 79], | 70.00th=[ 97], 80.00th=[ 121], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 300], 99.50th=[ 351], 99.90th=[ 472], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 95, per=24.80%, avg=28.52, stdev=15.92, samples=419 iops : min= 1, max= 23, avg= 6.47, stdev= 4.01, samples=419 lat (msec) : 10=1.01%, 20=7.19%, 50=38.61%, 100=32.03%, 250=19.86% lat (msec) : 500=1.24%, 750=0.03%, 1000=0.03% cpu : usr=0.03%, sys=1.49%, ctx=4533, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=110KiB/s (113kB/s), 27.3KiB/s-28.2KiB/s (27.9kB/s-28.8kB/s), io=23.4MiB (24.6MB), run=214008-217889msec WRITE: bw=115KiB/s (118kB/s), 28.6KiB/s-29.3KiB/s (29.3kB/s-29.0kB/s), io=24.6MiB (25.7MB), run=214008-217889msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178540: Thu Aug 6 09:42:31 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5920KiB/55192msec) clat (usec): min=45, max=486958, avg=77443.78, stdev=59178.13 lat (usec): min=46, max=486958, avg=77444.91, stdev=59178.15 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 20317], 20.00th=[ 34866], | 30.00th=[ 44303], 40.00th=[ 54789], 50.00th=[ 66323], 60.00th=[ 76022], | 70.00th=[ 98042], 80.00th=[114820], 90.00th=[141558], 95.00th=[185598], | 99.00th=[274727], 99.50th=[404751], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 29, max= 344, per=24.46%, avg=105.90, stdev=58.30, samples=107 iops : min= 1, max= 21, avg= 5.82, stdev= 3.71, samples=107 write: IOPS=7, BW=115KiB/s (118kB/s)(6368KiB/55192msec); 0 zone resets clat (usec): min=1469, max=464302, avg=66499.94, stdev=73304.35 lat (usec): min=1471, max=464305, avg=66523.32, stdev=73298.18 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1811], 10.00th=[ 3916], 20.00th=[ 8848], | 30.00th=[ 15664], 40.00th=[ 27657], 50.00th=[ 45351], 60.00th=[ 61080], | 70.00th=[ 84411], 80.00th=[114820], 90.00th=[154141], 95.00th=[214959], | 99.00th=[367002], 99.50th=[434111], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 29, max= 383, per=25.56%, avg=116.54, stdev=70.89, samples=105 iops : min= 1, max= 23, avg= 6.50, stdev= 4.48, samples=105 lat (usec) : 50=1.04%, 100=2.73%, 250=0.13%, 500=0.13% lat (msec) : 2=3.91%, 4=1.30%, 10=6.77%, 20=6.38%, 50=22.79% lat (msec) : 100=28.13%, 250=24.35%, 500=2.34% cpu : usr=0.04%, sys=3.51%, ctx=1548, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178541: Thu Aug 6 09:42:31 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5744KiB/53868msec) clat (usec): min=39, max=335264, avg=79551.49, stdev=51128.24 lat (usec): min=39, max=335265, avg=79552.64, stdev=51128.22 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 17695], 20.00th=[ 41157], | 30.00th=[ 51119], 40.00th=[ 62129], 50.00th=[ 71828], 60.00th=[ 88605], | 70.00th=[100140], 80.00th=[116917], 90.00th=[141558], 95.00th=[168821], | 99.00th=[256902], 99.50th=[274727], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 29, max= 249, per=25.25%, avg=109.31, stdev=50.11, samples=102 iops : min= 1, max= 15, avg= 6.03, stdev= 3.15, samples=102 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/53868msec); 0 zone resets clat (usec): min=1534, max=373964, avg=61697.95, stdev=63114.78 lat (usec): min=1535, max=373966, avg=61701.79, stdev=63113.05 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1811], 10.00th=[ 3359], 20.00th=[ 10028], | 30.00th=[ 16581], 40.00th=[ 26870], 50.00th=[ 40109], 60.00th=[ 60556], | 70.00th=[ 76022], 80.00th=[109577], 90.00th=[156238], 95.00th=[181404], | 99.00th=[278922], 99.50th=[299893], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 30, max= 347, per=26.51%, avg=120.89, stdev=67.70, samples=105 iops : min= 1, max= 21, avg= 6.78, stdev= 4.27, samples=105 lat (usec) : 50=0.78%, 100=2.99%, 250=0.26%, 1000=0.13% lat (msec) : 2=4.56%, 4=1.30%, 10=4.69%, 20=8.33%, 50=20.31% lat (msec) : 100=30.86%, 250=24.22%, 500=1.56% cpu : usr=0.05%, sys=4.00%, ctx=1610, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178542: Thu Aug 6 09:42:31 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53936msec) clat (usec): min=41, max=526175, avg=81100.94, stdev=59327.86 lat (usec): min=42, max=526176, avg=81118.17, stdev=59335.90 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 56], 10.00th=[ 5211], 20.00th=[ 37487], | 30.00th=[ 49546], 40.00th=[ 61604], 50.00th=[ 69731], 60.00th=[ 85459], | 70.00th=[100140], 80.00th=[119014], 90.00th=[147850], 95.00th=[177210], | 99.00th=[295699], 99.50th=[320865], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 28, max= 319, per=26.59%, avg=115.11, stdev=57.23, samples=105 iops : min= 1, max= 19, avg= 6.42, stdev= 3.63, samples=105 write: IOPS=6, BW=112KiB/s (115kB/s)(6032KiB/53936msec); 0 zone resets clat (usec): min=1453, max=325625, avg=58788.22, stdev=55427.33 lat (usec): min=1455, max=325628, avg=58797.47, stdev=55422.55 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1811], 10.00th=[ 3064], 20.00th=[ 11207], | 30.00th=[ 19268], 40.00th=[ 29492], 50.00th=[ 44827], 60.00th=[ 58983], | 70.00th=[ 77071], 80.00th=[102237], 90.00th=[135267], 95.00th=[168821], | 99.00th=[244319], 99.50th=[308282], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 347, per=25.16%, avg=114.71, stdev=51.44, samples=100 iops : min= 1, max= 21, avg= 6.39, stdev= 3.23, samples=100 lat (usec) : 50=1.17%, 100=3.39%, 250=0.13%, 500=0.13% lat (msec) : 2=4.17%, 4=1.30%, 10=4.04%, 20=6.90%, 50=21.22% lat (msec) : 100=32.16%, 250=24.22%, 500=1.04%, 750=0.13% cpu : usr=0.04%, sys=3.76%, ctx=1596, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178543: Thu Aug 6 09:42:31 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53177msec) clat (usec): min=31, max=330610, avg=78761.07, stdev=59951.25 lat (usec): min=31, max=330611, avg=78767.77, stdev=59949.30 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 33424], | 30.00th=[ 44827], 40.00th=[ 57934], 50.00th=[ 71828], 60.00th=[ 81265], | 70.00th=[ 99091], 80.00th=[121111], 90.00th=[160433], 95.00th=[189793], | 99.00th=[299893], 99.50th=[320865], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 29, max= 350, per=27.04%, avg=117.08, stdev=66.32, samples=99 iops : min= 1, max= 21, avg= 6.54, stdev= 4.17, samples=99 write: IOPS=7, BW=118KiB/s (120kB/s)(6256KiB/53177msec); 0 zone resets clat (usec): min=1453, max=386579, avg=59901.22, stdev=64701.46 lat (usec): min=1454, max=386580, avg=59903.35, stdev=64701.77 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1844], 10.00th=[ 5342], 20.00th=[ 9765], | 30.00th=[ 14484], 40.00th=[ 24249], 50.00th=[ 36963], 60.00th=[ 54789], | 70.00th=[ 78119], 80.00th=[104334], 90.00th=[147850], 95.00th=[181404], | 99.00th=[320865], 99.50th=[362808], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 29, max= 337, per=26.43%, avg=120.52, stdev=65.87, samples=100 iops : min= 1, max= 21, avg= 6.76, stdev= 4.18, samples=100 lat (usec) : 50=1.43%, 100=5.34% lat (msec) : 2=3.65%, 4=1.30%, 10=5.86%, 20=8.33%, 50=19.40% lat (msec) : 100=29.56%, 250=23.44%, 500=1.69% cpu : usr=0.04%, sys=3.74%, ctx=1530, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (444kB/s), 107KiB/s-116KiB/s (109kB/s-119kB/s), io=23.4MiB (24.5MB), run=53177-55192msec WRITE: bw=457KiB/s (468kB/s), 112KiB/s-121KiB/s (115kB/s-124kB/s), io=24.6MiB (25.8MB), run=53177-55192msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178535: Thu Aug 6 09:42:52 2026 read: IOPS=4, BW=78.4KiB/s (80.3kB/s)(5920KiB/75519msec) clat (msec): min=8, max=430, avg=81.29, stdev=67.14 lat (msec): min=8, max=430, avg=81.31, stdev=67.12 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 24], 20.00th=[ 32], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 73], | 70.00th=[ 92], 80.00th=[ 120], 90.00th=[ 169], 95.00th=[ 232], | 99.00th=[ 296], 99.50th=[ 388], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 29, max= 256, per=26.56%, avg=83.66, stdev=56.20, samples=138 iops : min= 1, max= 16, avg= 4.37, stdev= 3.57, samples=138 write: IOPS=5, BW=84.3KiB/s (86.3kB/s)(6368KiB/75519msec); 0 zone resets clat (msec): min=16, max=517, avg=113.67, stdev=81.14 lat (msec): min=16, max=517, avg=113.68, stdev=81.14 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 33], 10.00th=[ 42], 20.00th=[ 51], | 30.00th=[ 61], 40.00th=[ 71], 50.00th=[ 86], 60.00th=[ 107], | 70.00th=[ 131], 80.00th=[ 174], 90.00th=[ 224], 95.00th=[ 288], | 99.00th=[ 372], 99.50th=[ 498], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 255, per=26.19%, avg=86.69, stdev=50.59, samples=143 iops : min= 1, max= 15, avg= 4.56, stdev= 3.22, samples=143 lat (msec) : 10=0.13%, 20=3.65%, 50=25.65%, 100=35.29%, 250=29.56% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.04%, sys=1.38%, ctx=1252, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178536: Thu Aug 6 09:42:52 2026 read: IOPS=4, BW=75.6KiB/s (77.4kB/s)(5744KiB/75997msec) clat (msec): min=6, max=578, avg=78.96, stdev=68.07 lat (msec): min=6, max=578, avg=78.96, stdev=68.07 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 23], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 113], 90.00th=[ 161], 95.00th=[ 215], | 99.00th=[ 351], 99.50th=[ 468], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 30, max= 287, per=27.65%, avg=87.09, stdev=58.99, samples=129 iops : min= 1, max= 17, avg= 4.59, stdev= 3.75, samples=129 write: IOPS=5, BW=86.1KiB/s (88.2kB/s)(6544KiB/75997msec); 0 zone resets clat (msec): min=21, max=574, avg=116.06, stdev=86.78 lat (msec): min=21, max=574, avg=116.06, stdev=86.78 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 36], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 62], 40.00th=[ 73], 50.00th=[ 90], 60.00th=[ 108], | 70.00th=[ 128], 80.00th=[ 167], 90.00th=[ 220], 95.00th=[ 309], | 99.00th=[ 443], 99.50th=[ 464], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 31, max= 248, per=27.30%, avg=90.35, stdev=50.24, samples=141 iops : min= 1, max= 15, avg= 4.79, stdev= 3.20, samples=141 lat (msec) : 10=0.13%, 20=3.26%, 50=25.52%, 100=36.59%, 250=29.04% lat (msec) : 500=5.21%, 750=0.26% cpu : usr=0.02%, sys=1.32%, ctx=1198, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178538: Thu Aug 6 09:42:52 2026 read: IOPS=5, BW=83.4KiB/s (85.4kB/s)(6256KiB/75047msec) clat (msec): min=9, max=401, avg=82.03, stdev=71.54 lat (msec): min=9, max=401, avg=82.03, stdev=71.54 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 23], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 114], 90.00th=[ 190], 95.00th=[ 239], | 99.00th=[ 359], 99.50th=[ 380], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 284, per=28.09%, avg=88.49, stdev=63.26, samples=138 iops : min= 1, max= 17, avg= 4.67, stdev= 4.05, samples=138 write: IOPS=5, BW=80.4KiB/s (82.3kB/s)(6032KiB/75047msec); 0 zone resets clat (msec): min=19, max=534, avg=113.81, stdev=78.97 lat (msec): min=19, max=534, avg=113.81, stdev=78.97 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 34], 10.00th=[ 42], 20.00th=[ 53], | 30.00th=[ 64], 40.00th=[ 78], 50.00th=[ 89], 60.00th=[ 108], | 70.00th=[ 130], 80.00th=[ 167], 90.00th=[ 213], 95.00th=[ 284], | 99.00th=[ 368], 99.50th=[ 510], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 30, max= 223, per=25.80%, avg=85.39, stdev=48.43, samples=137 iops : min= 1, max= 13, avg= 4.48, stdev= 3.08, samples=137 lat (msec) : 10=0.13%, 20=3.91%, 50=25.91%, 100=35.94%, 250=28.39% lat (msec) : 500=5.47%, 750=0.26% cpu : usr=0.02%, sys=1.29%, ctx=1157, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178539: Thu Aug 6 09:42:52 2026 read: IOPS=5, BW=81.6KiB/s (83.5kB/s)(6032KiB/73933msec) clat (msec): min=7, max=580, avg=83.33, stdev=72.28 lat (msec): min=7, max=580, avg=83.33, stdev=72.28 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 74], | 70.00th=[ 94], 80.00th=[ 124], 90.00th=[ 174], 95.00th=[ 222], | 99.00th=[ 330], 99.50th=[ 464], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 31, max= 319, per=28.45%, avg=89.61, stdev=51.69, samples=129 iops : min= 1, max= 19, avg= 4.75, stdev= 3.29, samples=129 write: IOPS=5, BW=84.6KiB/s (86.6kB/s)(6256KiB/73933msec); 0 zone resets clat (msec): min=20, max=429, avg=108.23, stdev=71.26 lat (msec): min=21, max=429, avg=108.23, stdev=71.26 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 35], 10.00th=[ 42], 20.00th=[ 51], | 30.00th=[ 59], 40.00th=[ 71], 50.00th=[ 86], 60.00th=[ 107], | 70.00th=[ 131], 80.00th=[ 161], 90.00th=[ 209], 95.00th=[ 271], | 99.00th=[ 334], 99.50th=[ 372], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 255, per=27.04%, avg=89.49, stdev=55.09, samples=135 iops : min= 1, max= 15, avg= 4.74, stdev= 3.51, samples=135 lat (msec) : 10=0.13%, 20=2.47%, 50=26.95%, 100=34.90%, 250=31.25% lat (msec) : 500=4.17%, 750=0.13% cpu : usr=0.02%, sys=1.22%, ctx=1201, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=315KiB/s (323kB/s), 75.6KiB/s-83.4KiB/s (77.4kB/s-85.4kB/s), io=23.4MiB (24.5MB), run=73933-75997msec WRITE: bw=332KiB/s (340kB/s), 80.4KiB/s-86.1KiB/s (82.3kB/s-88.2kB/s), io=24.6MiB (25.8MB), run=73933-75997msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178561: Thu Aug 6 09:43:22 2026 read: IOPS=0, BW=784KiB/s (803kB/s)(7168KiB/9143msec) clat (usec): min=1882, max=4644.4k, avg=1001254.96, stdev=1631059.70 lat (usec): min=1883, max=4644.4k, avg=1001256.39, stdev=1631059.65 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 1876], 10.00th=[ 1876], | 20.00th=[ 158335], 30.00th=[ 223347], 40.00th=[ 223347], | 50.00th=[ 530580], 60.00th=[ 700449], 70.00th=[ 700449], | 80.00th=[ 750781], 90.00th=[4664067], 95.00th=[4664067], | 99.00th=[4664067], 99.50th=[4664067], 99.90th=[4664067], | 99.95th=[4664067], 99.99th=[4664067] bw ( KiB/s): min= 1996, max= 4087, per=100.00%, avg=2436.80, stdev=922.66, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=560KiB/s (573kB/s)(5120KiB/9143msec); 0 zone resets clat (msec): min=188, max=699, avg=382.75, stdev=211.12 lat (msec): min=188, max=699, avg=382.82, stdev=211.12 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2007, max= 4063, per=97.16%, avg=2703.00, stdev=1177.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.08%, sys=5.78%, ctx=500, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178562: Thu Aug 6 09:43:22 2026 read: IOPS=0, BW=200KiB/s (204kB/s)(2048KiB/10259msec) clat (usec): min=483, max=474995, avg=237739.59, stdev=335530.99 lat (usec): min=484, max=474998, avg=237741.42, stdev=335531.93 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 486], 60.00th=[476054], | 70.00th=[476054], 80.00th=[476054], 90.00th=[476054], 95.00th=[476054], | 99.00th=[476054], 99.50th=[476054], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 1396, max= 2023, per=86.03%, avg=1709.50, stdev=443.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=998KiB/s (1022kB/s)(10.0MiB/10259msec); 0 zone resets clat (msec): min=141, max=5346, avg=971.40, stdev=1606.12 lat (msec): min=141, max=5346, avg=971.47, stdev=1606.15 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 153], | 30.00th=[ 228], 40.00th=[ 239], 50.00th=[ 330], 60.00th=[ 380], | 70.00th=[ 414], 80.00th=[ 793], 90.00th=[ 1687], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 1980, max= 4079, per=97.02%, avg=2699.17, stdev=1062.78, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=4.91%, ctx=91, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178563: Thu Aug 6 09:43:22 2026 read: IOPS=0, BW=596KiB/s (611kB/s)(6144KiB/10304msec) clat (usec): min=393, max=872127, avg=200135.10, stdev=353497.32 lat (usec): min=394, max=872127, avg=200136.29, stdev=353496.99 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 396], 10.00th=[ 396], 20.00th=[ 832], | 30.00th=[ 832], 40.00th=[ 2024], 50.00th=[ 2024], 60.00th=[ 2147], | 70.00th=[325059], 80.00th=[325059], 90.00th=[868221], 95.00th=[868221], | 99.00th=[868221], 99.50th=[868221], 99.90th=[868221], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 2007, max= 4063, per=100.00%, avg=2530.00, stdev=1022.04, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=596KiB/s (611kB/s)(6144KiB/10304msec); 0 zone resets clat (msec): min=370, max=5864, avg=1507.12, stdev=2161.61 lat (msec): min=370, max=5864, avg=1507.19, stdev=2161.62 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 760], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 5873], 95.00th=[ 5873], | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 5873], | 99.99th=[ 5873] bw ( KiB/s): min= 1980, max= 2027, per=72.10%, avg=2005.80, stdev=18.62, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 4=16.67%, 500=33.33%, 1000=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.57%, ctx=110, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178564: Thu Aug 6 09:43:22 2026 read: IOPS=0, BW=528KiB/s (541kB/s)(5120KiB/9695msec) clat (msec): min=3, max=983, avg=413.01, stdev=357.78 lat (msec): min=3, max=983, avg=413.01, stdev=357.78 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2007, max= 4047, per=100.00%, avg=2695.00, stdev=1170.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=739KiB/s (757kB/s)(7168KiB/9695msec); 0 zone resets clat (msec): min=126, max=4829, avg=1073.19, stdev=1705.18 lat (msec): min=127, max=4829, avg=1073.24, stdev=1705.18 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 148], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 376], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 1318], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 1980, max= 6131, per=100.00%, avg=3032.50, stdev=2065.74, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 4=8.33%, 250=16.67%, 500=50.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.03%, ctx=122, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1988KiB/s (2035kB/s), 200KiB/s-784KiB/s (204kB/s-803kB/s), io=20.0MiB (20.0MB), run=9143-10304msec WRITE: bw=2783KiB/s (2849kB/s), 560KiB/s-998KiB/s (573kB/s-1022kB/s), io=28.0MiB (29.4MB), run=9143-10304msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Thu Aug 6 09:43:24 2026 read: IOPS=0, BW=649KiB/s (665kB/s)(7168KiB/11041msec) clat (msec): min=118, max=5314, avg=1279.38, stdev=1808.18 lat (msec): min=118, max=5314, avg=1279.39, stdev=1808.18 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 211], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 793], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 953], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 1935, max= 2039, per=100.00%, avg=1989.83, stdev=37.27, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=464KiB/s (475kB/s)(5120KiB/11041msec); 0 zone resets clat (msec): min=143, max=1090, avg=373.64, stdev=403.74 lat (msec): min=144, max=1091, avg=373.74, stdev=403.83 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2000, max= 4079, per=100.00%, avg=2707.33, stdev=1188.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 750=8.33%, 1000=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=1.79%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178567: Thu Aug 6 09:43:24 2026 read: IOPS=0, BW=186KiB/s (190kB/s)(2048KiB/11026msec) clat (msec): min=125, max=1231, avg=678.38, stdev=782.24 lat (msec): min=125, max=1231, avg=678.38, stdev=782.24 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1973, max= 2039, per=100.00%, avg=2006.00, stdev=46.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=929KiB/s (951kB/s)(10.0MiB/11026msec); 0 zone resets clat (msec): min=269, max=5642, avg=958.61, stdev=1656.99 lat (msec): min=269, max=5642, avg=958.72, stdev=1656.98 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 275], | 30.00th=[ 288], 40.00th=[ 342], 50.00th=[ 363], 60.00th=[ 380], | 70.00th=[ 460], 80.00th=[ 743], 90.00th=[ 818], 95.00th=[ 5671], | 99.00th=[ 5671], 99.50th=[ 5671], 99.90th=[ 5671], 99.95th=[ 5671], | 99.99th=[ 5671] bw ( KiB/s): min= 1917, max= 4079, per=100.00%, avg=3026.83, stdev=1124.53, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.89%, ctx=104, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178568: Thu Aug 6 09:43:24 2026 read: IOPS=0, BW=568KiB/s (581kB/s)(6144KiB/10824msec) clat (msec): min=107, max=615, avg=314.58, stdev=203.21 lat (msec): min=107, max=615, avg=314.58, stdev=203.21 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 259], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1917, max= 2048, per=100.00%, avg=1974.60, stdev=54.61, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=568KiB/s (581kB/s)(6144KiB/10824msec); 0 zone resets clat (msec): min=85, max=6592, avg=1488.63, stdev=2532.29 lat (msec): min=85, max=6592, avg=1488.69, stdev=2532.29 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 642], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 6611], 95.00th=[ 6611], | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], | 99.99th=[ 6611] bw ( KiB/s): min= 1917, max= 2039, per=76.42%, avg=1983.83, stdev=53.53, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=1.29%, ctx=70, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178569: Thu Aug 6 09:43:24 2026 read: IOPS=0, BW=466KiB/s (477kB/s)(5120KiB/10982msec) clat (msec): min=114, max=604, avg=243.35, stdev=206.21 lat (msec): min=114, max=604, avg=243.35, stdev=206.21 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2048, max= 6023, per=100.00%, avg=4035.50, stdev=2810.75, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=0, BW=653KiB/s (668kB/s)(7168KiB/10982msec); 0 zone resets clat (msec): min=199, max=7097, avg=1394.04, stdev=2545.49 lat (msec): min=199, max=7098, avg=1394.19, stdev=2545.71 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 203], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 230], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 1284], 90.00th=[ 7080], 95.00th=[ 7080], | 99.00th=[ 7080], 99.50th=[ 7080], 99.90th=[ 7080], 99.95th=[ 7080], | 99.99th=[ 7080] bw ( KiB/s): min= 1973, max= 5752, per=100.00%, avg=3465.00, stdev=1815.50, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 2.06, samples=4 lat (msec) : 250=66.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=0.96%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1855KiB/s (1899kB/s), 186KiB/s-649KiB/s (190kB/s-665kB/s), io=20.0MiB (20.0MB), run=10824-11041msec WRITE: bw=2597KiB/s (2659kB/s), 464KiB/s-929KiB/s (475kB/s-951kB/s), io=28.0MiB (29.4MB), run=10824-11041msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178577: Thu Aug 6 09:43:44 2026 read: IOPS=0, BW=1948KiB/s (1994kB/s)(12.0MiB/6309msec) clat (msec): min=859, max=4315, avg=2074.98, stdev=1942.86 lat (msec): min=859, max=4315, avg=2074.99, stdev=1942.86 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 8015, max= 8126, per=100.00%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.39%, ctx=523, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178579: Thu Aug 6 09:43:44 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(4096KiB/6969msec) clat (nsec): min=4031.6M, max=4031.6M, avg=4031596789.00, stdev= 0.00 lat (nsec): min=4031.6M, max=4031.6M, avg=4031599189.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1175KiB/s (1204kB/s)(8192KiB/6969msec); 0 zone resets clat (msec): min=1410, max=1416, avg=1413.37, stdev= 3.83 lat (msec): min=1410, max=1416, avg=1413.65, stdev= 3.81 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=2.67%, ctx=363, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178582: Thu Aug 6 09:43:44 2026 write: IOPS=0, BW=1776KiB/s (1819kB/s)(12.0MiB/6918msec); 0 zone resets clat (msec): min=649, max=4887, avg=2277.41, stdev=2283.63 lat (msec): min=651, max=4888, avg=2278.43, stdev=2282.95 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.23%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178584: Thu Aug 6 09:43:44 2026 write: IOPS=0, BW=1776KiB/s (1818kB/s)(12.0MiB/6920msec); 0 zone resets clat (msec): min=248, max=4896, avg=2218.94, stdev=2403.32 lat (msec): min=248, max=4896, avg=2219.34, stdev=2403.20 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=2.08%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2351KiB/s (2407kB/s), 588KiB/s-1948KiB/s (602kB/s-1994kB/s), io=16.0MiB (16.8MB), run=6309-6969msec WRITE: bw=4702KiB/s (4815kB/s), 1175KiB/s-1776KiB/s (1204kB/s-1819kB/s), io=32.0MiB (33.6MB), run=6918-6969msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178578: Thu Aug 6 09:43:44 2026 read: IOPS=0, BW=1818KiB/s (1861kB/s)(12.0MiB/6760msec) clat (msec): min=595, max=4339, avg=2196.08, stdev=1930.41 lat (msec): min=595, max=4339, avg=2196.09, stdev=1930.42 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.72%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Thu Aug 6 09:43:44 2026 read: IOPS=0, BW=574KiB/s (588kB/s)(4096KiB/7137msec) clat (nsec): min=4191.0M, max=4191.0M, avg=4191014831.00, stdev= 0.00 lat (nsec): min=4191.0M, max=4191.0M, avg=4191016616.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4178], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4178], | 30.00th=[ 4178], 40.00th=[ 4178], 50.00th=[ 4178], 60.00th=[ 4178], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1148KiB/s (1175kB/s)(8192KiB/7137msec); 0 zone resets clat (msec): min=907, max=1947, avg=1427.78, stdev=735.52 lat (msec): min=907, max=1948, avg=1428.05, stdev=735.51 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.44%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178581: Thu Aug 6 09:43:44 2026 write: IOPS=0, BW=1828KiB/s (1872kB/s)(12.0MiB/6721msec); 0 zone resets clat (msec): min=1232, max=4092, avg=2221.32, stdev=1621.52 lat (msec): min=1232, max=4093, avg=2221.82, stdev=1621.38 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 7937, max= 8047, per=100.00%, avg=7992.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.07%, ctx=34, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Thu Aug 6 09:43:44 2026 write: IOPS=0, BW=2069KiB/s (2119kB/s)(12.0MiB/5938msec); 0 zone resets clat (msec): min=230, max=4190, avg=1915.26, stdev=2044.63 lat (msec): min=230, max=4190, avg=1915.53, stdev=2044.61 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.53%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2296KiB/s (2351kB/s), 574KiB/s-1818KiB/s (588kB/s-1861kB/s), io=16.0MiB (16.8MB), run=6760-7137msec WRITE: bw=4591KiB/s (4701kB/s), 1148KiB/s-2069KiB/s (1175kB/s-2119kB/s), io=32.0MiB (33.6MB), run=5938-7137msec