== sanity test 398b: DIO and buffer IO race ============== 08:35:32 (1789130132) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.78727 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145122: Fri Sep 11 08:38:20 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(5992KiB/147078msec) clat (usec): min=33, max=314978, avg=48003.71, stdev=35984.06 lat (usec): min=34, max=314978, avg=48005.77, stdev=35983.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 1434], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[177210], 99.50th=[189793], 99.90th=[263193], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 120, per=25.51%, avg=40.57, stdev=18.80, samples=287 iops : min= 1, max= 30, avg= 9.49, stdev= 4.74, samples=287 write: IOPS=10, BW=42.8KiB/s (43.8kB/s)(6296KiB/147078msec); 0 zone resets clat (usec): min=956, max=807842, avg=47565.32, stdev=52363.95 lat (usec): min=958, max=807845, avg=47570.31, stdev=52362.84 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 1926], 20.00th=[ 5211], | 30.00th=[ 10421], 40.00th=[ 20317], 50.00th=[ 34341], 60.00th=[ 46924], | 70.00th=[ 62653], 80.00th=[ 82314], 90.00th=[108528], 95.00th=[137364], | 99.00th=[217056], 99.50th=[246416], 99.90th=[383779], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 119, per=25.66%, avg=42.59, stdev=19.14, samples=287 iops : min= 1, max= 29, avg=10.00, stdev= 4.82, samples=287 lat (usec) : 50=0.29%, 100=4.10%, 250=0.33%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.57%, 4=2.96%, 10=6.90%, 20=8.33%, 50=33.30% lat (msec) : 100=27.83%, 250=9.90%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=4.82%, ctx=6529, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145123: Fri Sep 11 08:38:20 2026 read: IOPS=9, BW=39.7KiB/s (40.6kB/s)(5940KiB/149699msec) clat (usec): min=37, max=820040, avg=49801.15, stdev=42432.23 lat (usec): min=37, max=820042, avg=49803.91, stdev=42432.01 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 9765], 20.00th=[ 21890], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[187696], 99.50th=[225444], 99.90th=[325059], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 96, per=24.67%, avg=39.22, stdev=18.17, samples=293 iops : min= 1, max= 24, avg= 9.14, stdev= 4.57, samples=293 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6348KiB/149699msec); 0 zone resets clat (usec): min=1005, max=301665, avg=47563.85, stdev=46827.01 lat (usec): min=1007, max=301666, avg=47568.00, stdev=46827.40 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 5276], | 30.00th=[ 10945], 40.00th=[ 23200], 50.00th=[ 36439], 60.00th=[ 48497], | 70.00th=[ 64226], 80.00th=[ 84411], 90.00th=[112722], 95.00th=[133694], | 99.00th=[198181], 99.50th=[231736], 99.90th=[287310], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 125, per=25.31%, avg=42.02, stdev=20.40, samples=292 iops : min= 1, max= 31, avg= 9.84, stdev= 5.16, samples=292 lat (usec) : 50=0.46%, 100=3.52%, 250=0.33%, 500=0.07%, 750=0.03% lat (msec) : 2=5.34%, 4=3.52%, 10=6.71%, 20=7.88%, 50=33.01% lat (msec) : 100=28.06%, 250=10.77%, 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=4.93%, ctx=6501, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145124: Fri Sep 11 08:38:20 2026 read: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6028KiB/148209msec) clat (usec): min=21, max=267079, avg=46984.14, stdev=34190.86 lat (usec): min=21, max=267081, avg=46989.68, stdev=34189.80 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 725], 20.00th=[ 21365], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[152044], 99.50th=[189793], 99.90th=[248513], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 108, per=26.13%, avg=41.55, stdev=19.14, samples=282 iops : min= 1, max= 27, avg= 9.73, stdev= 4.83, samples=282 write: IOPS=10, BW=42.2KiB/s (43.3kB/s)(6260KiB/148209msec); 0 zone resets clat (usec): min=1077, max=972789, avg=49303.01, stdev=57083.16 lat (usec): min=1079, max=972814, avg=49320.20, stdev=57079.14 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1418], 10.00th=[ 1942], 20.00th=[ 5342], | 30.00th=[ 10028], 40.00th=[ 24511], 50.00th=[ 36439], 60.00th=[ 47973], | 70.00th=[ 63701], 80.00th=[ 81265], 90.00th=[111674], 95.00th=[147850], | 99.00th=[238027], 99.50th=[278922], 99.90th=[599786], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 104, per=25.23%, avg=41.88, stdev=17.35, samples=290 iops : min= 1, max= 26, avg= 9.81, stdev= 4.38, samples=290 lat (usec) : 50=0.26%, 100=3.91%, 250=0.42%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=5.27%, 4=3.09%, 10=7.06%, 20=7.45%, 50=34.02% lat (msec) : 100=27.73%, 250=9.96%, 500=0.36%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=4.94%, ctx=6568, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145125: Fri Sep 11 08:38:20 2026 read: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6052KiB/150619msec) clat (usec): min=32, max=367637, avg=49128.15, stdev=39440.30 lat (usec): min=33, max=367639, avg=49133.25, stdev=39440.86 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 210], 20.00th=[ 21103], | 30.00th=[ 28181], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[183501], 99.50th=[256902], 99.90th=[341836], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 111, per=25.21%, avg=40.08, stdev=19.40, samples=293 iops : min= 1, max= 27, avg= 9.35, stdev= 4.91, samples=293 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6236KiB/150619msec); 0 zone resets clat (usec): min=1001, max=985067, avg=48776.42, stdev=53949.55 lat (usec): min=1003, max=985071, avg=48785.33, stdev=53946.65 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2311], 20.00th=[ 6194], | 30.00th=[ 12518], 40.00th=[ 23725], 50.00th=[ 35914], 60.00th=[ 47449], | 70.00th=[ 63177], 80.00th=[ 83362], 90.00th=[113771], 95.00th=[139461], | 99.00th=[206570], 99.50th=[258999], 99.90th=[400557], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 110, per=24.75%, avg=41.09, stdev=18.79, samples=294 iops : min= 1, max= 27, avg= 9.62, stdev= 4.74, samples=294 lat (usec) : 50=0.46%, 100=3.97%, 250=0.62%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=4.79%, 4=3.19%, 10=6.09%, 20=8.76%, 50=33.04% lat (msec) : 100=27.83%, 250=10.48%, 500=0.49%, 1000=0.03% cpu : usr=0.10%, sys=5.07%, ctx=6573, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.7KiB/s-40.7KiB/s (40.6kB/s-41.7kB/s), io=23.4MiB (24.6MB), run=147078-150619msec WRITE: bw=167KiB/s (171kB/s), 41.4KiB/s-42.8KiB/s (42.4kB/s-43.8kB/s), io=24.6MiB (25.7MB), run=147078-150619msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145117: Fri Sep 11 08:40:27 2026 read: IOPS=5, BW=21.5KiB/s (22.0kB/s)(5992KiB/278420msec) clat (msec): min=5, max=575, avg=38.14, stdev=43.77 lat (msec): min=5, max=575, avg=38.14, stdev=43.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 118], | 99.00th=[ 201], 99.50th=[ 243], 99.90th=[ 456], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 110, per=28.97%, avg=24.91, stdev=17.77, samples=463 iops : min= 1, max= 27, avg= 5.58, stdev= 4.49, samples=463 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6296KiB/278420msec); 0 zone resets clat (msec): min=27, max=897, avg=140.33, stdev=80.97 lat (msec): min=27, max=897, avg=140.33, stdev=80.98 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 117], 60.00th=[ 136], | 70.00th=[ 161], 80.00th=[ 192], 90.00th=[ 249], 95.00th=[ 305], | 99.00th=[ 401], 99.50th=[ 464], 99.90th=[ 531], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 56, per=24.92%, avg=22.42, stdev=12.31, samples=538 iops : min= 1, max= 14, avg= 4.95, stdev= 3.13, samples=538 lat (msec) : 10=3.81%, 20=17.48%, 50=18.29%, 100=24.67%, 250=30.60% lat (msec) : 500=4.98%, 750=0.13%, 1000=0.03% cpu : usr=0.06%, sys=1.11%, ctx=5187, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145118: Fri Sep 11 08:40:27 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5940KiB/277489msec) clat (msec): min=4, max=1466, avg=37.51, stdev=53.77 lat (msec): min=4, max=1466, avg=37.52, stdev=53.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 502], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 119, per=29.12%, avg=25.05, stdev=18.44, samples=457 iops : min= 1, max= 29, avg= 5.61, stdev= 4.64, samples=457 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6348KiB/277489msec); 0 zone resets clat (msec): min=28, max=559, avg=139.48, stdev=76.87 lat (msec): min=28, max=559, avg=139.48, stdev=76.87 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 104], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 245], 95.00th=[ 292], | 99.00th=[ 397], 99.50th=[ 464], 99.90th=[ 510], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 64, per=25.10%, avg=22.59, stdev=12.10, samples=539 iops : min= 1, max= 16, avg= 4.99, stdev= 3.08, samples=539 lat (msec) : 10=5.66%, 20=16.70%, 50=17.29%, 100=24.74%, 250=30.73% lat (msec) : 500=4.69%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.10%, ctx=5021, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145119: Fri Sep 11 08:40:27 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/278130msec) clat (msec): min=4, max=459, avg=40.55, stdev=46.53 lat (msec): min=4, max=459, avg=40.55, stdev=46.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 95], 95.00th=[ 129], | 99.00th=[ 230], 99.50th=[ 284], 99.90th=[ 443], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=27.87%, avg=23.97, stdev=16.78, samples=485 iops : min= 1, max= 25, avg= 5.34, stdev= 4.23, samples=485 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6260KiB/278130msec); 0 zone resets clat (msec): min=19, max=1585, avg=138.38, stdev=85.64 lat (msec): min=19, max=1585, avg=138.39, stdev=85.64 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 118], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 241], 95.00th=[ 296], | 99.00th=[ 409], 99.50th=[ 485], 99.90th=[ 642], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7, max= 63, per=25.12%, avg=22.61, stdev=12.26, samples=532 iops : min= 1, max= 15, avg= 4.99, stdev= 3.11, samples=532 lat (msec) : 10=4.33%, 20=16.34%, 50=18.52%, 100=24.97%, 250=30.92% lat (msec) : 500=4.72%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145120: Fri Sep 11 08:40:27 2026 read: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6052KiB/276289msec) clat (msec): min=5, max=484, avg=37.76, stdev=42.64 lat (msec): min=5, max=484, avg=37.76, stdev=42.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 87], 95.00th=[ 125], | 99.00th=[ 201], 99.50th=[ 232], 99.90th=[ 456], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 118, per=29.05%, avg=24.98, stdev=17.96, samples=467 iops : min= 1, max= 29, avg= 5.59, stdev= 4.54, samples=467 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6236KiB/276289msec); 0 zone resets clat (msec): min=31, max=1615, avg=140.27, stdev=84.62 lat (msec): min=31, max=1615, avg=140.27, stdev=84.62 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 91], 40.00th=[ 105], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 388], 99.50th=[ 447], 99.90th=[ 567], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7, max= 64, per=25.15%, avg=22.64, stdev=11.95, samples=529 iops : min= 1, max= 16, avg= 5.00, stdev= 3.04, samples=529 lat (msec) : 10=5.01%, 20=16.80%, 50=18.33%, 100=23.89%, 250=30.92% lat (msec) : 500=4.92%, 750=0.10%, 2000=0.03% cpu : usr=0.06%, sys=1.15%, ctx=5042, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.2KiB/s (88.3kB/s), 21.4KiB/s-21.9KiB/s (21.9kB/s-22.4kB/s), io=23.4MiB (24.6MB), run=276289-278420msec WRITE: bw=90.3KiB/s (92.5kB/s), 22.5KiB/s-22.9KiB/s (23.0kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=276289-278420msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Fri Sep 11 08:41:13 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5920KiB/34990msec) clat (usec): min=36, max=246093, avg=45651.98, stdev=35215.08 lat (usec): min=37, max=246095, avg=45671.24, stdev=35196.17 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 72], 10.00th=[ 86], 20.00th=[ 18482], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[164627], 99.50th=[198181], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 30, max= 351, per=25.42%, avg=171.06, stdev=83.41, samples=67 iops : min= 1, max= 21, avg= 9.93, stdev= 5.23, samples=67 write: IOPS=11, BW=182KiB/s (186kB/s)(6368KiB/34990msec); 0 zone resets clat (usec): min=1358, max=245839, avg=44650.23, stdev=48121.58 lat (usec): min=1361, max=245843, avg=44666.78, stdev=48114.54 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2040], 10.00th=[ 3458], 20.00th=[ 7308], | 30.00th=[ 10028], 40.00th=[ 16057], 50.00th=[ 25297], 60.00th=[ 38536], | 70.00th=[ 56886], 80.00th=[ 81265], 90.00th=[113771], 95.00th=[143655], | 99.00th=[208667], 99.50th=[221250], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 412, per=25.61%, avg=181.57, stdev=80.23, samples=68 iops : min= 1, max= 25, avg=10.60, stdev= 5.05, samples=68 lat (usec) : 50=1.04%, 100=4.95%, 250=1.17%, 500=0.26% lat (msec) : 2=2.47%, 4=3.65%, 10=9.90%, 20=10.42%, 50=30.34% lat (msec) : 100=26.04%, 250=9.77% cpu : usr=0.10%, sys=5.42%, ctx=1562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Fri Sep 11 08:41:13 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34636msec) clat (usec): min=41, max=420817, avg=53430.39, stdev=47122.16 lat (usec): min=42, max=420820, avg=53433.04, stdev=47122.09 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 71], 10.00th=[ 87], 20.00th=[ 19268], | 30.00th=[ 30278], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 65274], 80.00th=[ 80217], 90.00th=[102237], 95.00th=[128451], | 99.00th=[240124], 99.50th=[287310], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 30, max= 317, per=25.04%, avg=168.53, stdev=74.23, samples=66 iops : min= 1, max= 19, avg= 9.77, stdev= 4.68, samples=66 write: IOPS=11, BW=189KiB/s (193kB/s)(6544KiB/34636msec); 0 zone resets clat (usec): min=1491, max=242069, avg=36721.84, stdev=39890.07 lat (usec): min=1493, max=242073, avg=36733.35, stdev=39895.26 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1975], 10.00th=[ 2737], 20.00th=[ 5669], | 30.00th=[ 8291], 40.00th=[ 13698], 50.00th=[ 21103], 60.00th=[ 32113], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[119014], | 99.00th=[187696], 99.50th=[204473], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 30, max= 539, per=27.11%, avg=192.21, stdev=94.59, samples=66 iops : min= 1, max= 33, avg=11.27, stdev= 6.02, samples=66 lat (usec) : 50=0.52%, 100=5.08%, 250=0.78%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=3.78%, 10=10.68%, 20=10.55%, 50=28.26% lat (msec) : 100=27.08%, 250=8.85%, 500=0.26% cpu : usr=0.09%, sys=5.80%, ctx=1507, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Fri Sep 11 08:41:13 2026 read: IOPS=11, BW=176KiB/s (180kB/s)(6256KiB/35539msec) clat (usec): min=34, max=316646, avg=48309.14, stdev=38548.38 lat (usec): min=34, max=316646, avg=48311.13, stdev=38548.19 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 16450], | 30.00th=[ 27395], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[177210], 99.50th=[187696], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 414, per=26.76%, avg=180.12, stdev=82.61, samples=68 iops : min= 1, max= 25, avg=10.50, stdev= 5.20, samples=68 write: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35539msec); 0 zone resets clat (usec): min=1535, max=249811, avg=42983.39, stdev=46613.74 lat (usec): min=1537, max=249813, avg=42991.16, stdev=46611.67 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1909], 10.00th=[ 2409], 20.00th=[ 6325], | 30.00th=[ 11600], 40.00th=[ 16909], 50.00th=[ 26870], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[107480], 95.00th=[141558], | 99.00th=[219153], 99.50th=[235930], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 44, max= 408, per=23.87%, avg=169.23, stdev=84.38, samples=69 iops : min= 2, max= 25, avg= 9.80, stdev= 5.31, samples=69 lat (usec) : 50=0.65%, 100=6.90%, 250=1.43% lat (msec) : 2=3.91%, 4=2.60%, 10=6.90%, 20=9.77%, 50=30.21% lat (msec) : 100=27.73%, 250=9.77%, 500=0.13% cpu : usr=0.09%, sys=5.27%, ctx=1562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145184: Fri Sep 11 08:41:13 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33518msec) clat (usec): min=41, max=328695, avg=48722.98, stdev=44746.52 lat (usec): min=41, max=328696, avg=48724.94, stdev=44746.69 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 19006], | 30.00th=[ 27919], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[128451], | 99.00th=[206570], 99.50th=[316670], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 377, per=26.63%, avg=179.22, stdev=75.41, samples=65 iops : min= 1, max= 23, avg=10.43, stdev= 4.75, samples=65 write: IOPS=11, BW=187KiB/s (191kB/s)(6256KiB/33518msec); 0 zone resets clat (usec): min=1502, max=221919, avg=38283.48, stdev=41617.15 lat (usec): min=1506, max=221923, avg=38287.86, stdev=41619.54 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1909], 10.00th=[ 2966], 20.00th=[ 6194], | 30.00th=[ 10290], 40.00th=[ 13960], 50.00th=[ 22414], 60.00th=[ 33817], | 70.00th=[ 47449], 80.00th=[ 66847], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[191890], 99.50th=[219153], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 27, max= 412, per=26.43%, avg=187.42, stdev=85.54, samples=65 iops : min= 1, max= 25, avg=10.95, stdev= 5.40, samples=65 lat (usec) : 50=0.52%, 100=6.64%, 250=1.17%, 500=0.13% lat (msec) : 2=3.39%, 4=3.12%, 10=8.85%, 20=10.55%, 50=33.07% lat (msec) : 100=23.57%, 250=8.59%, 500=0.39% cpu : usr=0.09%, sys=5.39%, ctx=1487, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=674KiB/s (690kB/s), 166KiB/s-180KiB/s (170kB/s-184kB/s), io=23.4MiB (24.5MB), run=33518-35539msec WRITE: bw=709KiB/s (726kB/s), 170KiB/s-189KiB/s (174kB/s-193kB/s), io=24.6MiB (25.8MB), run=33518-35539msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145185: Fri Sep 11 08:41:56 2026 read: IOPS=4, BW=76.2KiB/s (78.0kB/s)(5920KiB/77684msec) clat (msec): min=6, max=344, avg=45.64, stdev=47.66 lat (msec): min=6, max=344, avg=45.64, stdev=47.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 99], 95.00th=[ 146], | 99.00th=[ 241], 99.50th=[ 300], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 28, max= 342, per=27.95%, avg=86.07, stdev=56.27, samples=134 iops : min= 1, max= 21, avg= 4.61, stdev= 3.63, samples=134 write: IOPS=5, BW=81.0KiB/s (83.9kB/s)(6368KiB/77684msec); 0 zone resets clat (msec): min=37, max=451, avg=151.68, stdev=72.28 lat (msec): min=37, max=451, avg=151.69, stdev=72.28 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 96], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 255], 95.00th=[ 296], | 99.00th=[ 384], 99.50th=[ 443], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 28, max= 192, per=25.82%, avg=83.67, stdev=39.48, samples=149 iops : min= 1, max= 12, avg= 4.45, stdev= 2.55, samples=149 lat (msec) : 10=1.04%, 20=13.15%, 50=21.35%, 100=20.57%, 250=37.89% lat (msec) : 500=5.99% cpu : usr=0.06%, sys=1.22%, ctx=1336, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Fri Sep 11 08:41:56 2026 read: IOPS=4, BW=74.1KiB/s (75.8kB/s)(5744KiB/77568msec) clat (msec): min=6, max=310, avg=42.47, stdev=39.72 lat (msec): min=6, max=310, avg=42.47, stdev=39.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 66], 90.00th=[ 95], 95.00th=[ 131], | 99.00th=[ 171], 99.50th=[ 305], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 352, per=29.42%, avg=90.60, stdev=62.64, samples=125 iops : min= 1, max= 22, avg= 4.90, stdev= 3.99, samples=125 write: IOPS=5, BW=84.4KiB/s (86.4kB/s)(6544KiB/77568msec); 0 zone resets clat (msec): min=42, max=578, avg=151.47, stdev=80.94 lat (msec): min=42, max=578, avg=151.47, stdev=80.94 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 116], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 264], 95.00th=[ 313], | 99.00th=[ 405], 99.50th=[ 447], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 28, max= 191, per=26.26%, avg=85.07, stdev=43.01, samples=151 iops : min= 1, max= 11, avg= 4.54, stdev= 2.79, samples=151 lat (msec) : 10=1.30%, 20=12.63%, 50=20.44%, 100=24.74%, 250=34.51% lat (msec) : 500=6.12%, 750=0.26% cpu : usr=0.06%, sys=1.18%, ctx=1408, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Fri Sep 11 08:41:56 2026 read: IOPS=5, BW=82.4KiB/s (84.4kB/s)(6256KiB/75880msec) clat (msec): min=7, max=408, avg=42.19, stdev=43.67 lat (msec): min=7, max=408, avg=42.20, stdev=43.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 138], | 99.00th=[ 241], 99.50th=[ 284], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 28, max= 320, per=29.87%, avg=91.99, stdev=66.30, samples=134 iops : min= 1, max= 20, avg= 4.98, stdev= 4.25, samples=134 write: IOPS=4, BW=79.5KiB/s (81.4kB/s)(6032KiB/75880msec); 0 zone resets clat (msec): min=40, max=553, avg=156.93, stdev=75.51 lat (msec): min=40, max=553, avg=156.94, stdev=75.51 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 182], 80.00th=[ 211], 90.00th=[ 259], 95.00th=[ 300], | 99.00th=[ 397], 99.50th=[ 447], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 28, max= 192, per=24.81%, avg=80.37, stdev=37.17, samples=146 iops : min= 1, max= 12, avg= 4.24, stdev= 2.41, samples=146 lat (msec) : 10=0.91%, 20=13.67%, 50=25.13%, 100=20.31%, 250=34.11% lat (msec) : 500=5.73%, 750=0.13% cpu : usr=0.05%, sys=1.24%, ctx=1320, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Fri Sep 11 08:41:56 2026 read: IOPS=4, BW=78.5KiB/s (80.4kB/s)(6032KiB/76805msec) clat (msec): min=6, max=399, avg=45.52, stdev=47.62 lat (msec): min=6, max=399, avg=45.53, stdev=47.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 155], | 99.00th=[ 226], 99.50th=[ 309], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 256, per=30.18%, avg=92.96, stdev=57.80, samples=126 iops : min= 1, max= 16, avg= 5.05, stdev= 3.72, samples=126 write: IOPS=5, BW=81.5KiB/s (83.4kB/s)(6256KiB/76805msec); 0 zone resets clat (msec): min=44, max=531, avg=151.70, stdev=73.89 lat (msec): min=44, max=531, avg=151.71, stdev=73.89 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 209], 90.00th=[ 255], 95.00th=[ 292], | 99.00th=[ 397], 99.50th=[ 426], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 28, max= 222, per=25.80%, avg=83.60, stdev=42.04, samples=146 iops : min= 1, max= 13, avg= 4.44, stdev= 2.72, samples=146 lat (msec) : 10=1.56%, 20=12.11%, 50=23.31%, 100=20.44%, 250=36.59% lat (msec) : 500=5.86%, 750=0.13% cpu : usr=0.05%, sys=1.26%, ctx=1299, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (316kB/s), 74.1KiB/s-82.4KiB/s (75.8kB/s-84.4kB/s), io=23.4MiB (24.5MB), run=75880-77684msec WRITE: bw=324KiB/s (332kB/s), 79.5KiB/s-84.4KiB/s (81.4kB/s-86.4kB/s), io=24.6MiB (25.8MB), run=75880-77684msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145209: Fri Sep 11 08:42:17 2026 read: IOPS=0, BW=857KiB/s (878kB/s)(7168KiB/8362msec) clat (usec): min=522, max=3913.1k, avg=994812.29, stdev=1579929.65 lat (usec): min=524, max=3913.1k, avg=994820.75, stdev=1579925.68 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], | 20.00th=[ 1090], 30.00th=[ 61604], 40.00th=[ 61604], | 50.00th=[ 177210], 60.00th=[ 263193], 70.00th=[ 263193], | 80.00th=[2533360], 90.00th=[3909092], 95.00th=[3909092], | 99.00th=[3909092], 99.50th=[3909092], 99.90th=[3909092], | 99.95th=[3909092], 99.99th=[3909092] bw ( KiB/s): min= 2031, max= 4096, per=100.00%, avg=3301.67, stdev=1111.86, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=612KiB/s (627kB/s)(5120KiB/8362msec); 0 zone resets clat (msec): min=125, max=340, avg=209.21, stdev=103.04 lat (msec): min=126, max=340, avg=209.38, stdev=103.05 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 2031, max= 6119, per=100.00%, avg=4075.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, >=2000=16.67% cpu : usr=0.02%, sys=5.71%, ctx=634, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Fri Sep 11 08:42:17 2026 read: IOPS=0, BW=223KiB/s (228kB/s)(2048KiB/9186msec) clat (msec): min=202, max=4334, avg=2268.78, stdev=2921.56 lat (msec): min=202, max=4334, avg=2268.79, stdev=2921.57 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 4329], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 2035, max= 2043, per=91.48%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1115KiB/s (1141kB/s)(10.0MiB/9186msec); 0 zone resets clat (msec): min=138, max=1901, avg=432.04, stdev=520.74 lat (msec): min=138, max=1901, avg=432.22, stdev=520.73 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 224], | 30.00th=[ 236], 40.00th=[ 247], 50.00th=[ 275], 60.00th=[ 284], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 405], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2015, max= 4096, per=100.00%, avg=3247.20, stdev=1118.09, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.77%, ctx=568, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145211: Fri Sep 11 08:42:17 2026 read: IOPS=0, BW=669KiB/s (685kB/s)(6144KiB/9179msec) clat (usec): min=540, max=617557, avg=297985.39, stdev=212924.13 lat (usec): min=542, max=617558, avg=297987.07, stdev=212924.04 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[214959], | 30.00th=[214959], 40.00th=[227541], 50.00th=[227541], 60.00th=[274727], | 70.00th=[450888], 80.00th=[450888], 90.00th=[616563], 95.00th=[616563], | 99.00th=[616563], 99.50th=[616563], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 1992, max= 4007, per=100.00%, avg=2516.25, stdev=994.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=669KiB/s (685kB/s)(6144KiB/9179msec); 0 zone resets clat (msec): min=308, max=3074, avg=1225.97, stdev=1367.56 lat (msec): min=308, max=3074, avg=1226.38, stdev=1367.31 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 384], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1700, max= 2043, per=63.06%, avg=1968.00, stdev=132.86, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=5.28%, ctx=210, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145212: Fri Sep 11 08:42:17 2026 read: IOPS=0, BW=622KiB/s (637kB/s)(5120KiB/8233msec) clat (usec): min=609, max=492216, avg=138911.48, stdev=215062.43 lat (usec): min=610, max=492216, avg=138914.95, stdev=215062.96 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 783], 40.00th=[ 783], 50.00th=[ 2966], 60.00th=[ 2966], | 70.00th=[198181], 80.00th=[198181], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 1992, max= 6107, per=100.00%, avg=4049.50, stdev=2909.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=871KiB/s (892kB/s)(7168KiB/8233msec); 0 zone resets clat (msec): min=225, max=3036, avg=1050.61, stdev=1289.95 lat (msec): min=225, max=3036, avg=1050.73, stdev=1289.92 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 234], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 363], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 2836], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1695, max= 3984, per=86.53%, avg=2700.60, stdev=1088.34, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=5.05%, ctx=135, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2229KiB/s (2283kB/s), 223KiB/s-857KiB/s (228kB/s-878kB/s), io=20.0MiB (20.0MB), run=8233-9186msec WRITE: bw=3121KiB/s (3196kB/s), 612KiB/s-1115KiB/s (627kB/s-1141kB/s), io=28.0MiB (29.4MB), run=8233-9186msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145214: Fri Sep 11 08:42:18 2026 read: IOPS=0, BW=740KiB/s (757kB/s)(7168KiB/9693msec) clat (msec): min=109, max=2721, avg=1000.20, stdev=1152.60 lat (msec): min=109, max=2721, avg=1000.20, stdev=1152.60 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 125], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 153], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 2366], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2019, max= 3676, per=100.00%, avg=2442.25, stdev=822.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=528KiB/s (541kB/s)(5120KiB/9693msec); 0 zone resets clat (msec): min=152, max=621, avg=441.63, stdev=174.94 lat (msec): min=152, max=621, avg=441.75, stdev=174.93 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1838, max= 4031, per=88.84%, avg=2628.00, stdev=1218.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.75%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145215: Fri Sep 11 08:42:18 2026 read: IOPS=0, BW=219KiB/s (225kB/s)(2048KiB/9338msec) clat (msec): min=87, max=4442, avg=2264.93, stdev=3079.30 lat (msec): min=87, max=4442, avg=2264.93, stdev=3079.30 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 4463], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 2039, max= 2048, per=96.76%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1097KiB/s (1123kB/s)(10.0MiB/9338msec); 0 zone resets clat (msec): min=197, max=1786, avg=436.36, stdev=477.56 lat (msec): min=197, max=1786, avg=439.32, stdev=476.78 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 241], | 30.00th=[ 245], 40.00th=[ 253], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 317], 80.00th=[ 326], 90.00th=[ 393], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1838, max= 4087, per=100.00%, avg=3013.50, stdev=1151.86, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.35%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145216: Fri Sep 11 08:42:18 2026 read: IOPS=0, BW=666KiB/s (682kB/s)(6144KiB/9223msec) clat (msec): min=98, max=384, avg=175.49, stdev=106.30 lat (msec): min=98, max=384, avg=175.49, stdev=106.30 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 155], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 4079, max= 4087, per=100.00%, avg=4083.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=666KiB/s (682kB/s)(6144KiB/9223msec); 0 zone resets clat (msec): min=156, max=4867, avg=1327.85, stdev=1870.98 lat (msec): min=156, max=4871, avg=1328.49, stdev=1872.20 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 397], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 2039, max= 4063, per=86.15%, avg=2548.25, stdev=1009.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, >=2000=16.67% cpu : usr=0.01%, sys=1.33%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145217: Fri Sep 11 08:42:18 2026 read: IOPS=0, BW=564KiB/s (577kB/s)(5120KiB/9080msec) clat (msec): min=107, max=380, avg=198.95, stdev=111.66 lat (msec): min=107, max=380, avg=198.95, stdev=111.66 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2031, max= 6131, per=100.00%, avg=4081.00, stdev=2899.14, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=789KiB/s (808kB/s)(7168KiB/9080msec); 0 zone resets clat (msec): min=239, max=3201, avg=1139.79, stdev=1095.22 lat (msec): min=239, max=3208, avg=1140.99, stdev=1097.61 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 249], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 793], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 2039], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2015, max= 2048, per=68.67%, avg=2031.17, stdev=12.40, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=50.00%, 500=8.33%, 750=8.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.03%, sys=2.59%, ctx=84, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2113KiB/s (2164kB/s), 219KiB/s-740KiB/s (225kB/s-757kB/s), io=20.0MiB (20.0MB), run=9080-9693msec WRITE: bw=2958KiB/s (3029kB/s), 528KiB/s-1097KiB/s (541kB/s-1123kB/s), io=28.0MiB (29.4MB), run=9080-9693msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145225: Fri Sep 11 08:42:37 2026 read: IOPS=0, BW=3997KiB/s (4093kB/s)(12.0MiB/3074msec) clat (msec): min=912, max=1076, avg=992.44, stdev=81.95 lat (msec): min=912, max=1076, avg=992.44, stdev=81.95 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.29%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145226: Fri Sep 11 08:42:37 2026 read: IOPS=0, BW=816KiB/s (836kB/s)(4096KiB/5019msec) clat (nsec): min=592262k, max=592262k, avg=592261807.00, stdev= 0.00 lat (nsec): min=592265k, max=592265k, avg=592264673.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1632KiB/s (1671kB/s)(8192KiB/5019msec); 0 zone resets clat (msec): min=1382, max=2915, avg=2149.26, stdev=1084.06 lat (msec): min=1387, max=2916, avg=2151.79, stdev=1081.18 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 2903], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.03%, ctx=42, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145227: Fri Sep 11 08:42:37 2026 write: IOPS=0, BW=2195KiB/s (2248kB/s)(12.0MiB/5598msec); 0 zone resets clat (msec): min=488, max=3265, avg=1812.50, stdev=1393.22 lat (msec): min=488, max=3267, avg=1814.50, stdev=1393.88 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1687], 50.00th=[ 1687], 60.00th=[ 1687], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.30%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145229: Fri Sep 11 08:42:37 2026 write: IOPS=0, BW=3199KiB/s (3276kB/s)(12.0MiB/3841msec); 0 zone resets clat (msec): min=466, max=2433, avg=1257.04, stdev=1039.05 lat (msec): min=467, max=2434, avg=1257.93, stdev=1038.50 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.53%, ctx=43, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3264KiB/s (3343kB/s), 816KiB/s-3997KiB/s (836kB/s-4093kB/s), io=16.0MiB (16.8MB), run=3074-5019msec WRITE: bw=5854KiB/s (5994kB/s), 1632KiB/s-3199KiB/s (1671kB/s-3276kB/s), io=32.0MiB (33.6MB), run=3841-5598msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145228: Fri Sep 11 08:42:37 2026 read: IOPS=1, BW=4395KiB/s (4500kB/s)(12.0MiB/2796msec) clat (msec): min=778, max=996, avg=900.62, stdev=111.29 lat (msec): min=778, max=996, avg=900.63, stdev=111.29 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8000, max= 8094, per=100.00%, avg=8047.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=10.91%, ctx=204, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145230: Fri Sep 11 08:42:37 2026 read: IOPS=0, BW=723KiB/s (740kB/s)(4096KiB/5665msec) clat (nsec): min=654079k, max=654079k, avg=654078811.00, stdev= 0.00 lat (nsec): min=654081k, max=654081k, avg=654081410.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1446KiB/s (1481kB/s)(8192KiB/5665msec); 0 zone resets clat (msec): min=2314, max=2501, avg=2408.42, stdev=132.25 lat (msec): min=2315, max=2502, avg=2409.16, stdev=132.45 clat percentiles (msec): | 1.00th=[ 2299], 5.00th=[ 2299], 10.00th=[ 2299], 20.00th=[ 2299], | 30.00th=[ 2299], 40.00th=[ 2299], 50.00th=[ 2299], 60.00th=[ 2500], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=3.95%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145231: Fri Sep 11 08:42:37 2026 write: IOPS=0, BW=2606KiB/s (2668kB/s)(12.0MiB/4716msec); 0 zone resets clat (msec): min=472, max=2834, avg=1539.73, stdev=1197.36 lat (msec): min=472, max=2850, avg=1545.56, stdev=1206.11 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.74%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145232: Fri Sep 11 08:42:37 2026 write: IOPS=0, BW=2880KiB/s (2949kB/s)(12.0MiB/4267msec); 0 zone resets clat (msec): min=522, max=2326, avg=1397.37, stdev=903.04 lat (msec): min=523, max=2326, avg=1398.47, stdev=903.05 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.46%, ctx=34, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2892KiB/s (2962kB/s), 723KiB/s-4395KiB/s (740kB/s-4500kB/s), io=16.0MiB (16.8MB), run=2796-5665msec WRITE: bw=5784KiB/s (5923kB/s), 1446KiB/s-2880KiB/s (1481kB/s-2949kB/s), io=32.0MiB (33.6MB), run=4267-5665msec