== sanity test 398b: DIO and buffer IO race ============== 00:46:07 (1782362767) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.53782 s, 19.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154898: Thu Jun 25 00:47:14 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/57905msec) clat (usec): min=29, max=576098, avg=20416.34, stdev=19227.25 lat (usec): min=30, max=576099, avg=20417.13, stdev=19227.31 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 4686], 10.00th=[ 7832], 20.00th=[ 10421], | 30.00th=[ 12911], 40.00th=[ 15533], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 23987], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 41681], | 99.00th=[ 61080], 99.50th=[ 68682], 99.90th=[189793], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 6, max= 216, per=24.96%, avg=103.34, stdev=36.52, samples=115 iops : min= 1, max= 54, avg=25.43, stdev= 9.21, samples=115 write: IOPS=27, BW=109KiB/s (111kB/s)(6296KiB/57905msec); 0 zone resets clat (usec): min=671, max=139355, avg=17267.74, stdev=14243.67 lat (usec): min=671, max=139357, avg=17268.55, stdev=14243.69 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2737], 10.00th=[ 3556], 20.00th=[ 5473], | 30.00th=[ 7767], 40.00th=[ 10945], 50.00th=[ 13698], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 26870], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 66323], 99.50th=[ 77071], 99.90th=[124257], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 31, max= 240, per=25.23%, avg=109.52, stdev=42.40, samples=114 iops : min= 7, max= 60, avg=26.97, stdev=10.66, samples=114 lat (usec) : 50=0.10%, 100=0.42%, 250=1.56%, 500=0.16%, 750=0.20% lat (usec) : 1000=0.29% lat (msec) : 2=0.98%, 4=5.11%, 10=19.04%, 20=35.61%, 50=34.15% lat (msec) : 100=2.18%, 250=0.16%, 750=0.03% cpu : usr=0.08%, sys=28.64%, ctx=9764, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154899: Thu Jun 25 00:47:14 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(5940KiB/57189msec) clat (usec): min=26, max=647198, avg=20240.01, stdev=20214.15 lat (usec): min=27, max=647199, avg=20240.64, stdev=20214.20 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 5342], 10.00th=[ 7832], 20.00th=[ 10421], | 30.00th=[ 12649], 40.00th=[ 15008], 50.00th=[ 17433], 60.00th=[ 20579], | 70.00th=[ 23725], 80.00th=[ 28443], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 58983], 99.50th=[ 68682], 99.90th=[ 91751], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 32, max= 200, per=25.31%, avg=104.78, stdev=37.77, samples=112 iops : min= 8, max= 50, avg=25.78, stdev= 9.50, samples=112 write: IOPS=27, BW=111KiB/s (114kB/s)(6348KiB/57189msec); 0 zone resets clat (usec): min=671, max=125583, avg=17014.65, stdev=14192.76 lat (usec): min=671, max=125584, avg=17015.51, stdev=14192.73 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2507], 10.00th=[ 3130], 20.00th=[ 4817], | 30.00th=[ 7504], 40.00th=[ 10683], 50.00th=[ 13698], 60.00th=[ 17171], | 70.00th=[ 21627], 80.00th=[ 26608], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 63701], 99.50th=[ 68682], 99.90th=[123208], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 39, max= 223, per=25.75%, avg=111.75, stdev=41.96, samples=112 iops : min= 9, max= 55, avg=27.53, stdev=10.53, samples=112 lat (usec) : 50=0.13%, 100=0.52%, 250=1.27%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.20% lat (msec) : 2=1.30%, 4=7.13%, 10=17.61%, 20=34.11%, 50=34.83% lat (msec) : 100=2.44%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=28.56%, ctx=9565, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154900: Thu Jun 25 00:47:14 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6028KiB/57214msec) clat (usec): min=38, max=165545, avg=19426.79, stdev=12662.81 lat (usec): min=39, max=165546, avg=19427.50, stdev=12662.88 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 227], 10.00th=[ 7832], 20.00th=[ 10421], | 30.00th=[ 12911], 40.00th=[ 15401], 50.00th=[ 17695], 60.00th=[ 20055], | 70.00th=[ 22676], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 54264], 99.50th=[ 71828], 99.90th=[147850], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 40, max= 232, per=25.72%, avg=106.46, stdev=38.67, samples=112 iops : min= 10, max= 58, avg=26.21, stdev= 9.73, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6260KiB/57214msec); 0 zone resets clat (usec): min=699, max=638204, avg=17769.63, stdev=20952.01 lat (usec): min=699, max=638204, avg=17770.61, stdev=20951.99 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2802], 10.00th=[ 3687], 20.00th=[ 5669], | 30.00th=[ 7898], 40.00th=[ 10945], 50.00th=[ 14222], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27132], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 62653], 99.50th=[ 71828], 99.90th=[145753], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 191, per=25.19%, avg=109.32, stdev=36.83, samples=113 iops : min= 1, max= 47, avg=26.92, stdev= 9.25, samples=113 lat (usec) : 50=0.07%, 100=0.88%, 250=1.66%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=0.88%, 4=4.79%, 10=18.95%, 20=35.29%, 50=35.03% lat (msec) : 100=1.82%, 250=0.20%, 750=0.03% cpu : usr=0.10%, sys=28.60%, ctx=9592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154901: Thu Jun 25 00:47:14 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57349msec) clat (usec): min=25, max=105772, avg=19487.27, stdev=12111.97 lat (usec): min=26, max=105773, avg=19487.94, stdev=12112.01 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 302], 10.00th=[ 7635], 20.00th=[ 10028], | 30.00th=[ 12518], 40.00th=[ 14877], 50.00th=[ 17433], 60.00th=[ 20055], | 70.00th=[ 23725], 80.00th=[ 28443], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 56886], 99.50th=[ 71828], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 47, max= 207, per=25.72%, avg=106.47, stdev=36.70, samples=113 iops : min= 11, max= 51, avg=26.20, stdev= 9.24, samples=113 write: IOPS=27, BW=109KiB/s (111kB/s)(6236KiB/57349msec); 0 zone resets clat (usec): min=676, max=636385, avg=17783.38, stdev=20876.89 lat (usec): min=676, max=636386, avg=17784.20, stdev=20876.92 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2737], 10.00th=[ 3326], 20.00th=[ 5473], | 30.00th=[ 7701], 40.00th=[ 10945], 50.00th=[ 14353], 60.00th=[ 17957], | 70.00th=[ 22152], 80.00th=[ 27657], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 64750], 99.50th=[ 71828], 99.90th=[112722], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 13, max= 232, per=25.01%, avg=108.55, stdev=40.42, samples=114 iops : min= 3, max= 58, avg=26.74, stdev=10.17, samples=114 lat (usec) : 50=0.26%, 100=0.42%, 250=1.63%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=0.98%, 4=6.02%, 10=18.82%, 20=34.02%, 50=35.19% lat (msec) : 100=1.95%, 250=0.10%, 750=0.03% cpu : usr=0.08%, sys=28.72%, ctx=9719, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=415KiB/s (425kB/s), 103KiB/s-106KiB/s (106kB/s-108kB/s), io=23.4MiB (24.6MB), run=57189-57905msec WRITE: bw=434KiB/s (445kB/s), 109KiB/s-111KiB/s (111kB/s-114kB/s), io=24.6MiB (25.7MB), run=57189-57905msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154893: Thu Jun 25 00:47:35 2026 read: IOPS=18, BW=75.1KiB/s (76.9kB/s)(5992KiB/79809msec) clat (msec): min=2, max=583, avg=17.29, stdev=22.00 lat (msec): min=2, max=583, avg=17.29, stdev=22.00 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 51], | 99.00th=[ 84], 99.50th=[ 102], 99.90th=[ 138], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 200, per=25.02%, avg=75.07, stdev=43.05, samples=157 iops : min= 1, max= 50, avg=18.44, stdev=10.94, samples=157 write: IOPS=19, BW=78.9KiB/s (80.8kB/s)(6296KiB/79809msec); 0 zone resets clat (msec): min=11, max=184, avg=34.13, stdev=18.36 lat (msec): min=11, max=184, avg=34.13, stdev=18.36 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 101], 99.50th=[ 118], 99.90th=[ 180], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 16, max= 176, per=25.03%, avg=78.85, stdev=40.70, samples=157 iops : min= 4, max= 44, avg=19.38, stdev=10.35, samples=157 lat (msec) : 4=3.35%, 10=18.75%, 20=21.68%, 50=45.51%, 100=9.96% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.08%, sys=11.43%, ctx=6358, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154894: Thu Jun 25 00:47:35 2026 read: IOPS=18, BW=74.5KiB/s (76.3kB/s)(5940KiB/79706msec) clat (msec): min=2, max=644, avg=17.03, stdev=22.85 lat (msec): min=2, max=644, avg=17.03, stdev=22.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 37], 95.00th=[ 51], | 99.00th=[ 79], 99.50th=[ 95], 99.90th=[ 144], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 248, per=24.92%, avg=74.76, stdev=45.50, samples=157 iops : min= 1, max= 62, avg=18.36, stdev=11.54, samples=157 write: IOPS=19, BW=79.6KiB/s (81.6kB/s)(6348KiB/79706msec); 0 zone resets clat (msec): min=12, max=185, avg=34.17, stdev=18.74 lat (msec): min=12, max=185, avg=34.17, stdev=18.74 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 96], 99.50th=[ 116], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 23, max= 176, per=25.31%, avg=79.71, stdev=41.45, samples=157 iops : min= 5, max= 44, avg=19.60, stdev=10.54, samples=157 lat (msec) : 4=3.52%, 10=18.75%, 20=22.75%, 50=44.37%, 100=9.99% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.09%, sys=11.25%, ctx=6319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154895: Thu Jun 25 00:47:35 2026 read: IOPS=18, BW=75.5KiB/s (77.4kB/s)(6028KiB/79790msec) clat (msec): min=2, max=128, avg=17.04, stdev=15.99 lat (msec): min=2, max=128, avg=17.04, stdev=15.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 89], 99.90th=[ 110], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 7, max= 240, per=25.21%, avg=75.63, stdev=44.48, samples=157 iops : min= 1, max= 60, avg=18.58, stdev=11.28, samples=157 write: IOPS=19, BW=78.5KiB/s (80.3kB/s)(6260KiB/79790msec); 0 zone resets clat (msec): min=11, max=658, avg=34.45, stdev=23.78 lat (msec): min=11, max=658, avg=34.46, stdev=23.78 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 97], 99.50th=[ 112], 99.90th=[ 161], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 168, per=24.85%, avg=78.29, stdev=41.42, samples=157 iops : min= 3, max= 42, avg=19.24, stdev=10.53, samples=157 lat (msec) : 4=3.45%, 10=18.20%, 20=22.92%, 50=44.50%, 100=10.32% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.07%, sys=11.45%, ctx=6448, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154896: Thu Jun 25 00:47:35 2026 read: IOPS=19, BW=76.7KiB/s (78.5kB/s)(6052KiB/78937msec) clat (msec): min=2, max=143, avg=16.73, stdev=15.75 lat (msec): min=2, max=143, avg=16.73, stdev=15.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 72], 99.50th=[ 81], 99.90th=[ 138], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 7, max= 240, per=25.85%, avg=77.54, stdev=47.60, samples=155 iops : min= 1, max= 60, avg=19.05, stdev=12.06, samples=155 write: IOPS=19, BW=78.0KiB/s (80.9kB/s)(6236KiB/78937msec); 0 zone resets clat (msec): min=13, max=651, avg=34.27, stdev=24.16 lat (msec): min=13, max=651, avg=34.27, stdev=24.16 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 101], 99.50th=[ 126], 99.90th=[ 188], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 23, max= 176, per=25.19%, avg=79.35, stdev=41.09, samples=156 iops : min= 5, max= 44, avg=19.51, stdev=10.46, samples=156 lat (msec) : 4=3.55%, 10=19.04%, 20=22.72%, 50=44.37%, 100=9.73% lat (msec) : 250=0.55%, 750=0.03% cpu : usr=0.07%, sys=11.54%, ctx=6320, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=301KiB/s (308kB/s), 74.5KiB/s-76.7KiB/s (76.3kB/s-78.5kB/s), io=23.4MiB (24.6MB), run=78937-79809msec WRITE: bw=315KiB/s (323kB/s), 78.5KiB/s-79.6KiB/s (80.3kB/s-81.6kB/s), io=24.6MiB (25.7MB), run=78937-79809msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154931: Thu Jun 25 00:47:59 2026 read: IOPS=20, BW=335KiB/s (343kB/s)(5920KiB/17668msec) clat (usec): min=55, max=85744, avg=23280.34, stdev=14748.83 lat (usec): min=56, max=85745, avg=23281.23, stdev=14749.02 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 155], 10.00th=[ 204], 20.00th=[11731], | 30.00th=[16319], 40.00th=[19268], 50.00th=[22414], 60.00th=[25822], | 70.00th=[29230], 80.00th=[34866], 90.00th=[41681], 95.00th=[46400], | 99.00th=[74974], 99.50th=[82314], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 188, max= 640, per=25.03%, avg=332.09, stdev=110.82, samples=34 iops : min= 11, max= 40, avg=20.12, stdev= 7.12, samples=34 write: IOPS=22, BW=360KiB/s (369kB/s)(6368KiB/17668msec); 0 zone resets clat (usec): min=1262, max=104236, avg=22493.05, stdev=14740.24 lat (usec): min=1263, max=104238, avg=22494.66, stdev=14740.24 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 50], | 99.00th=[ 69], 99.50th=[ 78], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 191, max= 640, per=25.78%, avg=359.88, stdev=101.59, samples=34 iops : min= 11, max= 40, avg=21.85, stdev= 6.50, samples=34 lat (usec) : 100=0.26%, 250=5.47%, 500=0.39%, 750=0.26% lat (msec) : 2=0.39%, 4=0.39%, 10=13.02%, 20=26.04%, 50=49.87% lat (msec) : 100=3.78%, 250=0.13% cpu : usr=0.14%, sys=31.58%, ctx=2843, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154932: Thu Jun 25 00:47:59 2026 read: IOPS=19, BW=318KiB/s (326kB/s)(5744KiB/18039msec) clat (usec): min=41, max=88138, avg=23879.03, stdev=14559.26 lat (usec): min=42, max=88140, avg=23879.82, stdev=14559.31 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 178], 10.00th=[ 5538], 20.00th=[13829], | 30.00th=[16057], 40.00th=[18482], 50.00th=[21890], 60.00th=[25035], | 70.00th=[29754], 80.00th=[34341], 90.00th=[43254], 95.00th=[49021], | 99.00th=[66847], 99.50th=[72877], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 127, max= 544, per=23.76%, avg=315.26, stdev=97.27, samples=35 iops : min= 7, max= 34, avg=19.09, stdev= 6.33, samples=35 write: IOPS=22, BW=363KiB/s (371kB/s)(6544KiB/18039msec); 0 zone resets clat (usec): min=1212, max=67491, avg=22899.23, stdev=15016.88 lat (usec): min=1213, max=67492, avg=22901.71, stdev=15017.32 clat percentiles (usec): | 1.00th=[ 2540], 5.00th=[ 5145], 10.00th=[ 6390], 20.00th=[ 8586], | 30.00th=[11600], 40.00th=[15008], 50.00th=[19006], 60.00th=[24773], | 70.00th=[29230], 80.00th=[37487], 90.00th=[44827], 95.00th=[51643], | 99.00th=[62129], 99.50th=[63701], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 63, max= 608, per=25.28%, avg=352.97, stdev=104.85, samples=35 iops : min= 3, max= 38, avg=21.46, stdev= 6.71, samples=35 lat (usec) : 50=0.26%, 250=3.91%, 500=0.39% lat (msec) : 2=0.26%, 4=1.43%, 10=12.63%, 20=29.30%, 50=46.35% lat (msec) : 100=5.47% cpu : usr=0.14%, sys=30.92%, ctx=2873, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154933: Thu Jun 25 00:47:59 2026 read: IOPS=21, BW=351KiB/s (360kB/s)(6256KiB/17802msec) clat (usec): min=71, max=101105, avg=23783.20, stdev=14822.18 lat (usec): min=72, max=101106, avg=23784.04, stdev=14822.22 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 163], 10.00th=[ 243], 20.00th=[ 12649], | 30.00th=[ 16057], 40.00th=[ 19268], 50.00th=[ 22938], 60.00th=[ 25822], | 70.00th=[ 30016], 80.00th=[ 34866], 90.00th=[ 41681], 95.00th=[ 47973], | 99.00th=[ 66847], 99.50th=[ 96994], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 191, max= 608, per=26.49%, avg=351.49, stdev=98.61, samples=35 iops : min= 11, max= 38, avg=21.34, stdev= 6.28, samples=35 write: IOPS=21, BW=339KiB/s (347kB/s)(6032KiB/17802msec); 0 zone resets clat (usec): min=1022, max=94866, avg=22473.42, stdev=15951.43 lat (usec): min=1023, max=94866, avg=22475.68, stdev=15951.04 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 5407], 10.00th=[ 6587], 20.00th=[ 8848], | 30.00th=[11994], 40.00th=[15270], 50.00th=[19006], 60.00th=[22676], | 70.00th=[25560], 80.00th=[35914], 90.00th=[43779], 95.00th=[51643], | 99.00th=[80217], 99.50th=[83362], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 126, max= 576, per=23.87%, avg=333.29, stdev=123.80, samples=35 iops : min= 7, max= 36, avg=20.20, stdev= 7.94, samples=35 lat (usec) : 100=0.65%, 250=4.56%, 500=0.26% lat (msec) : 2=0.39%, 4=0.78%, 10=12.76%, 20=28.65%, 50=47.40% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.06%, sys=30.90%, ctx=2860, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154934: Thu Jun 25 00:47:59 2026 read: IOPS=22, BW=359KiB/s (367kB/s)(6032KiB/16817msec) clat (usec): min=34, max=73470, avg=23036.34, stdev=13664.81 lat (usec): min=35, max=73471, avg=23037.10, stdev=13664.84 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 157], 10.00th=[ 231], 20.00th=[13435], | 30.00th=[16450], 40.00th=[19006], 50.00th=[21890], 60.00th=[25297], | 70.00th=[29230], 80.00th=[34341], 90.00th=[41681], 95.00th=[46400], | 99.00th=[62129], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 159, max= 608, per=26.99%, avg=358.21, stdev=119.86, samples=33 iops : min= 9, max= 38, avg=21.73, stdev= 7.68, samples=33 write: IOPS=23, BW=372KiB/s (381kB/s)(6256KiB/16817msec); 0 zone resets clat (usec): min=1222, max=114658, avg=20637.60, stdev=15400.50 lat (usec): min=1223, max=114659, avg=20639.00, stdev=15400.52 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 69], 99.50th=[ 91], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 126, max= 608, per=26.81%, avg=374.30, stdev=104.13, samples=33 iops : min= 7, max= 38, avg=22.76, stdev= 6.67, samples=33 lat (usec) : 50=0.13%, 100=0.52%, 250=4.43%, 500=0.78% lat (msec) : 2=0.26%, 4=0.91%, 10=15.76%, 20=27.86%, 50=45.70% lat (msec) : 100=3.52%, 250=0.13% cpu : usr=0.07%, sys=31.70%, ctx=2817, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1328KiB/s (1360kB/s), 318KiB/s-359KiB/s (326kB/s-367kB/s), io=23.4MiB (24.5MB), run=16817-18039msec WRITE: bw=1397KiB/s (1431kB/s), 339KiB/s-372KiB/s (347kB/s-381kB/s), io=24.6MiB (25.8MB), run=16817-18039msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154926: Thu Jun 25 00:48:04 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(5920KiB/23206msec) clat (msec): min=3, max=153, avg=21.68, stdev=21.04 lat (msec): min=3, max=153, avg=21.68, stdev=21.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 15], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 51], 95.00th=[ 67], | 99.00th=[ 97], 99.50th=[ 109], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 64, max= 768, per=24.62%, avg=254.07, stdev=155.11, samples=46 iops : min= 4, max= 48, avg=15.48, stdev= 9.89, samples=46 write: IOPS=17, BW=274KiB/s (281kB/s)(6368KiB/23206msec); 0 zone resets clat (msec): min=12, max=152, avg=38.06, stdev=20.69 lat (msec): min=12, max=152, avg=38.06, stdev=20.69 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 105], 99.50th=[ 136], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 32, max= 640, per=25.25%, avg=273.93, stdev=152.89, samples=46 iops : min= 2, max= 40, avg=16.74, stdev= 9.80, samples=46 lat (msec) : 4=1.30%, 10=17.97%, 20=18.10%, 50=45.18%, 100=16.41% lat (msec) : 250=1.04% cpu : usr=0.06%, sys=13.16%, ctx=1872, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154927: Thu Jun 25 00:48:04 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(5744KiB/23199msec) clat (msec): min=3, max=105, avg=20.99, stdev=19.29 lat (msec): min=3, max=105, avg=20.99, stdev=19.29 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 91], 99.50th=[ 100], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 63, max= 800, per=24.10%, avg=248.70, stdev=159.80, samples=46 iops : min= 3, max= 50, avg=15.15, stdev=10.14, samples=46 write: IOPS=17, BW=282KiB/s (289kB/s)(6544KiB/23199msec); 0 zone resets clat (msec): min=12, max=152, avg=38.19, stdev=20.69 lat (msec): min=12, max=152, avg=38.19, stdev=20.69 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 53], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 112], 99.50th=[ 117], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 95, max= 640, per=25.98%, avg=281.87, stdev=151.37, samples=46 iops : min= 5, max= 40, avg=17.22, stdev= 9.70, samples=46 lat (msec) : 4=0.78%, 10=17.32%, 20=19.40%, 50=45.57%, 100=16.02% lat (msec) : 250=0.91% cpu : usr=0.06%, sys=12.99%, ctx=1868, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154928: Thu Jun 25 00:48:04 2026 read: IOPS=17, BW=273KiB/s (280kB/s)(6256KiB/22910msec) clat (msec): min=3, max=109, avg=20.76, stdev=19.11 lat (msec): min=3, max=109, avg=20.76, stdev=19.11 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 64], | 99.00th=[ 91], 99.50th=[ 107], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 95, max= 832, per=26.59%, avg=274.42, stdev=189.35, samples=45 iops : min= 5, max= 52, avg=16.76, stdev=12.04, samples=45 write: IOPS=16, BW=263KiB/s (270kB/s)(6032KiB/22910msec); 0 zone resets clat (msec): min=14, max=140, avg=39.08, stdev=21.85 lat (msec): min=14, max=140, avg=39.09, stdev=21.85 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 67], 95.00th=[ 85], | 99.00th=[ 118], 99.50th=[ 134], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 95, max= 608, per=23.88%, avg=259.04, stdev=139.43, samples=45 iops : min= 5, max= 38, avg=15.80, stdev= 8.92, samples=45 lat (msec) : 4=1.17%, 10=18.75%, 20=19.79%, 50=44.14%, 100=14.45% lat (msec) : 250=1.69% cpu : usr=0.09%, sys=13.47%, ctx=1888, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154929: Thu Jun 25 00:48:04 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23119msec) clat (msec): min=3, max=124, avg=21.52, stdev=19.26 lat (msec): min=3, max=124, avg=21.52, stdev=19.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 67], | 99.00th=[ 90], 99.50th=[ 100], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 63, max= 704, per=24.56%, avg=253.47, stdev=151.59, samples=45 iops : min= 3, max= 44, avg=15.44, stdev= 9.63, samples=45 write: IOPS=16, BW=271KiB/s (277kB/s)(6256KiB/23119msec); 0 zone resets clat (msec): min=16, max=121, avg=38.33, stdev=19.80 lat (msec): min=16, max=121, avg=38.33, stdev=19.80 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 66], 95.00th=[ 80], | 99.00th=[ 111], 99.50th=[ 121], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 95, max= 640, per=24.44%, avg=265.18, stdev=141.35, samples=45 iops : min= 5, max= 40, avg=16.18, stdev= 9.06, samples=45 lat (msec) : 4=1.04%, 10=17.32%, 20=16.54%, 50=48.57%, 100=15.63% lat (msec) : 250=0.91% cpu : usr=0.09%, sys=13.34%, ctx=1838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1032KiB/s (1057kB/s), 248KiB/s-273KiB/s (254kB/s-280kB/s), io=23.4MiB (24.5MB), run=22910-23206msec WRITE: bw=1086KiB/s (1112kB/s), 263KiB/s-282KiB/s (270kB/s-289kB/s), io=24.6MiB (25.8MB), run=22910-23206msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154942: Thu Jun 25 00:48:16 2026 read: IOPS=1, BW=1742KiB/s (1784kB/s)(7168KiB/4114msec) clat (msec): min=54, max=333, avg=253.79, stdev=95.01 lat (msec): min=54, max=333, avg=253.79, stdev=95.01 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 228], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 275], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1753, max= 3893, per=59.38%, avg=2341.80, stdev=875.19, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1245KiB/s (1274kB/s)(5120KiB/4114msec); 0 zone resets clat (msec): min=194, max=684, avg=456.70, stdev=185.36 lat (msec): min=194, max=684, avg=456.78, stdev=185.35 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2048, max= 4063, per=49.25%, avg=2719.67, stdev=1163.36, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=51.71%, ctx=1279, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154943: Thu Jun 25 00:48:16 2026 read: IOPS=0, BW=394KiB/s (404kB/s)(2048KiB/5192msec) clat (msec): min=317, max=416, avg=367.14, stdev=69.63 lat (msec): min=317, max=416, avg=367.15, stdev=69.64 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1750, max= 2031, per=47.93%, avg=1890.50, stdev=198.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1972KiB/s (2020kB/s)(10.0MiB/5192msec); 0 zone resets clat (msec): min=191, max=755, avg=442.46, stdev=197.25 lat (msec): min=191, max=755, avg=442.54, stdev=197.25 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 268], | 30.00th=[ 309], 40.00th=[ 321], 50.00th=[ 347], 60.00th=[ 414], | 70.00th=[ 493], 80.00th=[ 575], 90.00th=[ 751], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1984, max= 4096, per=55.14%, avg=3045.00, stdev=1122.32, samples=6 iops : min= 1, max= 4, avg= 2.50, stdev= 1.38, samples=6 lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=47.25%, ctx=342, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154944: Thu Jun 25 00:48:16 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(6144KiB/4602msec) clat (usec): min=700, max=813293, avg=221561.91, stdev=302046.11 lat (usec): min=701, max=813294, avg=221563.19, stdev=302046.22 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 35914], | 30.00th=[ 35914], 40.00th=[ 74974], 50.00th=[ 74974], 60.00th=[185598], | 70.00th=[219153], 80.00th=[219153], 90.00th=[809501], 95.00th=[809501], | 99.00th=[809501], 99.50th=[809501], 99.90th=[809501], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 2031, max= 4096, per=85.32%, avg=3365.00, stdev=1157.05, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1335KiB/s (1367kB/s)(6144KiB/4602msec); 0 zone resets clat (msec): min=315, max=1244, avg=543.31, stdev=368.31 lat (msec): min=315, max=1244, avg=543.41, stdev=368.30 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 368], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1732, max= 2048, per=35.58%, avg=1964.83, stdev=120.95, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=41.88%, ctx=822, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154945: Thu Jun 25 00:48:16 2026 read: IOPS=1, BW=1168KiB/s (1196kB/s)(5120KiB/4384msec) clat (usec): min=512, max=420122, avg=245550.86, stdev=165892.15 lat (usec): min=513, max=420124, avg=245552.12, stdev=165892.21 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[160433], 40.00th=[160433], 50.00th=[320865], 60.00th=[320865], | 70.00th=[329253], 80.00th=[329253], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 4063, max= 4096, per=100.00%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1635KiB/s (1674kB/s)(7168KiB/4384msec); 0 zone resets clat (msec): min=251, max=883, avg=444.31, stdev=219.04 lat (msec): min=251, max=883, avg=444.38, stdev=219.04 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 275], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 368], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 567], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1741, max= 4096, per=48.29%, avg=2666.80, stdev=1047.14, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=45.90%, ctx=555, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3945KiB/s (4039kB/s), 394KiB/s-1742KiB/s (404kB/s-1784kB/s), io=20.0MiB (20.0MB), run=4114-5192msec WRITE: bw=5522KiB/s (5655kB/s), 1245KiB/s-1972KiB/s (1274kB/s-2020kB/s), io=28.0MiB (29.4MB), run=4114-5192msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154947: Thu Jun 25 00:48:17 2026 read: IOPS=1, BW=1312KiB/s (1344kB/s)(7168KiB/5463msec) clat (msec): min=97, max=1078, avg=392.54, stdev=351.44 lat (msec): min=97, max=1078, avg=393.45, stdev=351.33 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 257], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 625], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1825, max= 4079, per=68.42%, avg=2494.75, stdev=1060.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=937KiB/s (960kB/s)(5120KiB/5463msec); 0 zone resets clat (msec): min=209, max=960, avg=535.26, stdev=288.69 lat (msec): min=209, max=961, avg=535.36, stdev=288.70 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1924, max= 2048, per=39.28%, avg=2005.00, stdev=58.55, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.07%, sys=14.54%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154948: Thu Jun 25 00:48:17 2026 read: IOPS=0, BW=367KiB/s (376kB/s)(2048KiB/5574msec) clat (msec): min=113, max=869, avg=491.43, stdev=534.69 lat (msec): min=113, max=869, avg=491.44, stdev=534.69 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2048, max= 2048, per=56.17%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1837KiB/s (1881kB/s)(10.0MiB/5574msec); 0 zone resets clat (msec): min=63, max=1081, avg=455.56, stdev=363.63 lat (msec): min=63, max=1082, avg=455.64, stdev=363.64 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 128], | 30.00th=[ 155], 40.00th=[ 171], 50.00th=[ 228], 60.00th=[ 430], | 70.00th=[ 701], 80.00th=[ 709], 90.00th=[ 885], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1924, max= 4096, per=47.47%, avg=2423.20, stdev=936.50, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=14.79%, ctx=361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154949: Thu Jun 25 00:48:17 2026 read: IOPS=1, BW=1121KiB/s (1148kB/s)(6144KiB/5482msec) clat (msec): min=84, max=1143, avg=350.29, stdev=403.19 lat (msec): min=84, max=1143, avg=350.30, stdev=403.19 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 309], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2039, max= 4000, per=73.93%, avg=2695.67, stdev=1129.59, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1121KiB/s (1148kB/s)(6144KiB/5482msec); 0 zone resets clat (msec): min=110, max=1297, avg=559.38, stdev=472.03 lat (msec): min=110, max=1297, avg=559.46, stdev=472.05 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 527], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1924, max= 2048, per=39.55%, avg=2019.00, stdev=53.88, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.02%, sys=12.59%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154950: Thu Jun 25 00:48:17 2026 read: IOPS=0, BW=912KiB/s (934kB/s)(5120KiB/5616msec) clat (msec): min=25, max=1023, avg=493.51, stdev=377.58 lat (msec): min=25, max=1023, avg=493.52, stdev=377.58 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1924, max= 2048, per=54.60%, avg=1990.67, stdev=62.52, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1276KiB/s (1307kB/s)(7168KiB/5616msec); 0 zone resets clat (msec): min=58, max=1300, avg=418.26, stdev=452.58 lat (msec): min=58, max=1300, avg=418.34, stdev=452.61 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 102], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 300], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 743], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2039, max= 4096, per=53.43%, avg=2727.67, stdev=1185.02, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=25.00% lat (msec) : 2000=16.67% cpu : usr=0.02%, sys=12.41%, ctx=410, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3647KiB/s (3734kB/s), 367KiB/s-1312KiB/s (376kB/s-1344kB/s), io=20.0MiB (20.0MB), run=5463-5616msec WRITE: bw=5105KiB/s (5228kB/s), 937KiB/s-1837KiB/s (960kB/s-1881kB/s), io=28.0MiB (29.4MB), run=5463-5616msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154957: Thu Jun 25 00:48:29 2026 read: IOPS=1, BW=5218KiB/s (5343kB/s)(12.0MiB/2355msec) clat (msec): min=645, max=827, avg=745.49, stdev=92.35 lat (msec): min=645, max=827, avg=745.49, stdev=92.35 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=53.53%, ctx=2971, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154960: Thu Jun 25 00:48:29 2026 read: IOPS=0, BW=1826KiB/s (1870kB/s)(4096KiB/2243msec) clat (nsec): min=841894k, max=841894k, avg=841894069.00, stdev= 0.00 lat (nsec): min=841897k, max=841897k, avg=841897141.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3652KiB/s (3740kB/s)(8192KiB/2243msec); 0 zone resets clat (msec): min=508, max=775, avg=641.76, stdev=189.06 lat (msec): min=508, max=775, avg=642.09, stdev=189.14 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8175, max= 8175, per=83.50%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=35.01%, ctx=973, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154962: Thu Jun 25 00:48:29 2026 write: IOPS=0, BW=3671KiB/s (3759kB/s)(12.0MiB/3347msec); 0 zone resets clat (msec): min=189, max=2561, avg=1058.44, stdev=1306.98 lat (msec): min=190, max=2561, avg=1058.80, stdev=1307.01 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8192, max= 8192, per=83.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=17.36%, ctx=109, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154964: Thu Jun 25 00:48:29 2026 rand-rw: (groupid=0, jobs=1): err= 0: pid=154958: Thu Jun 25 00:48:29 2026 read: IOPS=1, BW=4878KiB/s (4995kB/s)(12.0MiB/2519msec) clat (msec): min=325, max=1418, avg=833.81, stdev=550.60 lat (msec): min=325, max=1418, avg=833.81, stdev=550.60 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 6838, max= 8192, per=100.00%, avg=7515.00, stdev=957.42, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.42%, ctx=219, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154959: Thu Jun 25 00:48:29 2026 read: IOPS=0, BW=1211KiB/s (1240kB/s)(4096KiB/3383msec) clat (nsec): min=1045.1M, max=1045.1M, avg=1045114528.00, stdev= 0.00 lat (nsec): min=1045.1M, max=1045.1M, avg=1045115742.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2422KiB/s (2480kB/s)(8192KiB/3383msec); 0 zone resets clat (msec): min=503, max=1811, avg=1157.38, stdev=924.65 lat (msec): min=503, max=1811, avg=1157.71, stdev=924.82 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8192, max= 8192, per=84.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=14.70%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154961: Thu Jun 25 00:48:29 2026 write: IOPS=0, BW=3852KiB/s (3944kB/s)(12.0MiB/3190msec); 0 zone resets clat (msec): min=326, max=2369, avg=1053.96, stdev=1141.60 lat (msec): min=326, max=2370, avg=1054.33, stdev=1141.64 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8192, max= 8192, per=84.58%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=18.0 write: IOPS=0, BW=4037KiB/s (4134kB/s)(12.0MiB/3044msec); 0 zone resets clat (msec): min=803, max=1239, avg=1007.76, stdev=219.28 9%, ctx=129, majf=0, minf=7 lat (msec): min=803, max=1239, avg=1008.07, stdev=219.17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% clat percentiles (msec): submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | 30.00th=[ 802], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], latency : target=0, window=0, percentile=100.00%, depth=16 | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], rand-rw: (groupid=0, jobs=1): err= 0: pid=154963: Thu Jun 25 00:48:29 2026 | 99.99th=[ 1234] write: IOPS=1, BW=4475KiB/s (4582kB/s)(12.0MiB/2746msec); 0 zone resets clat (msec): min=262, max=1970, avg=912.25, stdev=924.39 bw ( KiB/s): min= 8175, max= 8192, per=83.59%, avg=8183.50, stdev=12.02, samples=2 lat (msec): min=262, max=1970, avg=912.58, stdev=924.38 clat percentiles (msec): iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], lat (msec) : 1000=66.67%, 2000=33.33% | 30.00th=[ 264], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], cpu : usr=0.00%, sys=24.75%, ctx=167, majf=0, minf=7 | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% bw ( KiB/s): min= 6627, max= 8192, per=76.50%, avg=7409.50, stdev=1106.62, samples=2 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% latency : target=0, window=0, percentile=100.00%, depth=16 cpu : usr=0.04%, sys=15.56%, ctx=131, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% Run status group 0 (all jobs): submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% READ: bw=6957KiB/s (7124kB/s), 1826KiB/s-5218KiB/s (1870kB/s-5343kB/s), io=16.0MiB (16.8MB), run=2243-2355msec complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% WRITE: bw=9790KiB/s (10.0MB/s), 3652KiB/s-4037KiB/s (3740kB/s-4134kB/s), io=32.0MiB (33.6MB), run=2243-3347msec issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4843KiB/s (4959kB/s), 1211KiB/s-4878KiB/s (1240kB/s-4995kB/s), io=16.0MiB (16.8MB), run=2519-3383msec WRITE: bw=9686KiB/s (9919kB/s), 2422KiB/s-4475KiB/s (2480kB/s-4582kB/s), io=32.0MiB (33.6MB), run=2746-3383msec