== sanity test 398b: DIO and buffer IO race ============== 16:19:57 (1786652397) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.26153 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143952: Thu Aug 13 16:23:03 2026 read: IOPS=9, BW=36.4KiB/s (37.3kB/s)(5992KiB/164676msec) clat (usec): min=37, max=924713, avg=56217.65, stdev=48796.49 lat (usec): min=37, max=924714, avg=56221.72, stdev=48795.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 75], 10.00th=[ 16057], 20.00th=[ 26608], | 30.00th=[ 32900], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 65274], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[128451], | 99.00th=[198181], 99.50th=[240124], 99.90th=[471860], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 103, per=24.95%, avg=36.18, stdev=16.74, samples=318 iops : min= 1, max= 25, avg= 8.41, stdev= 4.25, samples=318 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6296KiB/164676msec); 0 zone resets clat (usec): min=1129, max=429262, avg=50801.92, stdev=54154.18 lat (usec): min=1131, max=429263, avg=50811.59, stdev=54154.61 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1516], 10.00th=[ 1991], 20.00th=[ 5669], | 30.00th=[ 11076], 40.00th=[ 22152], 50.00th=[ 37487], 60.00th=[ 49546], | 70.00th=[ 63701], 80.00th=[ 86508], 90.00th=[122160], 95.00th=[156238], | 99.00th=[246416], 99.50th=[278922], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 134, per=25.28%, avg=38.18, stdev=18.04, samples=318 iops : min= 1, max= 33, avg= 8.90, stdev= 4.56, samples=318 lat (usec) : 50=0.39%, 100=2.90%, 250=0.36%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.27%, 4=2.77%, 10=6.97%, 20=7.39%, 50=30.96% lat (msec) : 100=29.92%, 250=12.17%, 500=0.68%, 1000=0.03% cpu : usr=0.08%, sys=4.42%, ctx=6642, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143953: Thu Aug 13 16:23:03 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(5940KiB/164576msec) clat (usec): min=26, max=511415, avg=55225.65, stdev=43282.04 lat (usec): min=26, max=511417, avg=55232.57, stdev=43278.53 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 72], 10.00th=[ 15664], 20.00th=[ 25297], | 30.00th=[ 32637], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 54789], | 70.00th=[ 64226], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[128451], | 99.00th=[200279], 99.50th=[254804], 99.90th=[442500], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 95, per=24.87%, avg=36.06, stdev=17.08, samples=318 iops : min= 1, max= 23, avg= 8.37, stdev= 4.34, samples=318 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6348KiB/164576msec); 0 zone resets clat (usec): min=1082, max=808693, avg=51696.65, stdev=56547.11 lat (usec): min=1084, max=808694, avg=51703.16, stdev=56544.55 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1532], 10.00th=[ 2376], 20.00th=[ 6652], | 30.00th=[ 11994], 40.00th=[ 23987], 50.00th=[ 36963], 60.00th=[ 50594], | 70.00th=[ 66323], 80.00th=[ 87557], 90.00th=[119014], 95.00th=[152044], | 99.00th=[252707], 99.50th=[295699], 99.90th=[421528], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 109, per=25.46%, avg=38.45, stdev=18.46, samples=318 iops : min= 1, max= 27, avg= 8.97, stdev= 4.65, samples=318 lat (usec) : 50=0.13%, 100=3.29%, 250=0.13%, 500=0.03%, 1000=0.10% lat (msec) : 2=4.79%, 4=2.51%, 10=6.84%, 20=7.81%, 50=31.64% lat (msec) : 100=29.26%, 250=12.66%, 500=0.75%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.35%, ctx=6712, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143954: Thu Aug 13 16:23:03 2026 read: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6028KiB/165552msec) clat (usec): min=36, max=568089, avg=55384.90, stdev=44005.37 lat (usec): min=36, max=568090, avg=55387.88, stdev=44005.73 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 76], 10.00th=[ 16450], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 56361], | 70.00th=[ 66323], 80.00th=[ 79168], 90.00th=[103285], 95.00th=[125305], | 99.00th=[219153], 99.50th=[267387], 99.90th=[371196], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 103, per=24.90%, avg=36.11, stdev=18.19, samples=322 iops : min= 1, max= 25, avg= 8.39, stdev= 4.61, samples=322 write: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6260KiB/165552msec); 0 zone resets clat (usec): min=1056, max=807370, avg=52144.85, stdev=55503.65 lat (usec): min=1056, max=807372, avg=52152.49, stdev=55503.99 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1565], 10.00th=[ 2278], 20.00th=[ 6587], | 30.00th=[ 14484], 40.00th=[ 26346], 50.00th=[ 39060], 60.00th=[ 51643], | 70.00th=[ 66323], 80.00th=[ 85459], 90.00th=[122160], 95.00th=[156238], | 99.00th=[233833], 99.50th=[263193], 99.90th=[450888], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 109, per=24.84%, avg=37.52, stdev=17.31, samples=322 iops : min= 1, max= 27, avg= 8.74, stdev= 4.37, samples=322 lat (usec) : 50=0.26%, 100=2.80%, 250=0.16%, 500=0.07%, 1000=0.10% lat (msec) : 2=4.95%, 4=2.90%, 10=5.27%, 20=7.91%, 50=32.16% lat (msec) : 100=30.53%, 250=12.17%, 500=0.65%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.59%, ctx=6789, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143955: Thu Aug 13 16:23:03 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6052KiB/162275msec) clat (usec): min=34, max=894387, avg=53418.76, stdev=45094.27 lat (usec): min=34, max=894388, avg=53420.94, stdev=45094.23 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 12387], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[202376], 99.50th=[223347], 99.90th=[341836], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 101, per=25.68%, avg=37.23, stdev=17.57, samples=314 iops : min= 1, max= 25, avg= 8.67, stdev= 4.46, samples=314 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6236KiB/162275msec); 0 zone resets clat (usec): min=1146, max=622428, avg=51947.49, stdev=55067.23 lat (usec): min=1146, max=622431, avg=51949.87, stdev=55067.21 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1516], 10.00th=[ 1909], 20.00th=[ 5932], | 30.00th=[ 11076], 40.00th=[ 23462], 50.00th=[ 36963], 60.00th=[ 50070], | 70.00th=[ 67634], 80.00th=[ 90702], 90.00th=[124257], 95.00th=[156238], | 99.00th=[246416], 99.50th=[274727], 99.90th=[404751], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=38.23, stdev=18.73, samples=315 iops : min= 1, max= 33, avg= 8.91, stdev= 4.72, samples=315 lat (usec) : 50=0.29%, 100=3.61%, 250=0.36%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=2.41%, 10=6.74%, 20=6.84%, 50=32.36% lat (msec) : 100=28.29%, 250=12.89%, 500=0.52%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.57%, ctx=6631, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=145KiB/s (149kB/s), 36.1KiB/s-37.3KiB/s (36.0kB/s-38.2kB/s), io=23.4MiB (24.6MB), run=162275-165552msec WRITE: bw=152KiB/s (156kB/s), 37.8KiB/s-38.6KiB/s (38.7kB/s-39.5kB/s), io=24.6MiB (25.7MB), run=162275-165552msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143957: Thu Aug 13 16:25:51 2026 read: IOPS=4, BW=18.1KiB/s (18.5kB/s)(5992KiB/331729msec) clat (msec): min=6, max=766, avg=50.30, stdev=50.27 lat (msec): min=6, max=766, avg=50.30, stdev=50.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 245], 99.50th=[ 271], 99.90th=[ 514], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 87, per=29.60%, avg=21.31, stdev=14.70, samples=539 iops : min= 1, max= 21, avg= 4.69, stdev= 3.73, samples=539 write: IOPS=4, BW=18.0KiB/s (19.4kB/s)(6296KiB/331729msec); 0 zone resets clat (msec): min=42, max=712, avg=162.75, stdev=83.98 lat (msec): min=42, max=712, avg=162.76, stdev=83.98 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 186], 80.00th=[ 218], 90.00th=[ 271], 95.00th=[ 330], | 99.00th=[ 464], 99.50th=[ 510], 99.90th=[ 701], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 48, per=25.43%, avg=19.07, stdev= 9.33, samples=629 iops : min= 1, max= 12, avg= 4.11, stdev= 2.36, samples=629 lat (msec) : 10=1.73%, 20=9.93%, 50=21.52%, 100=22.23%, 250=37.60% lat (msec) : 500=6.64%, 750=0.33%, 1000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5622, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143958: Thu Aug 13 16:25:51 2026 read: IOPS=4, BW=17.9KiB/s (18.3kB/s)(5940KiB/332371msec) clat (msec): min=4, max=873, avg=48.74, stdev=48.73 lat (msec): min=4, max=873, avg=48.74, stdev=48.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 96], 95.00th=[ 131], | 99.00th=[ 243], 99.50th=[ 268], 99.90th=[ 405], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 95, per=29.71%, avg=21.39, stdev=14.57, samples=531 iops : min= 1, max= 23, avg= 4.70, stdev= 3.66, samples=531 write: IOPS=4, BW=19.1KiB/s (19.6kB/s)(6348KiB/332371msec); 0 zone resets clat (msec): min=29, max=693, avg=163.69, stdev=84.44 lat (msec): min=29, max=693, avg=163.70, stdev=84.44 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 110], 40.00th=[ 127], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 188], 80.00th=[ 226], 90.00th=[ 279], 95.00th=[ 326], | 99.00th=[ 447], 99.50th=[ 506], 99.90th=[ 642], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 6, max= 47, per=25.22%, avg=18.92, stdev= 9.27, samples=637 iops : min= 1, max= 11, avg= 4.07, stdev= 2.36, samples=637 lat (msec) : 10=1.69%, 20=9.80%, 50=21.19%, 100=23.60%, 250=35.32% lat (msec) : 500=8.07%, 750=0.29%, 1000=0.03% cpu : usr=0.05%, sys=1.27%, ctx=5658, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143959: Thu Aug 13 16:25:51 2026 read: IOPS=4, BW=18.1KiB/s (18.6kB/s)(6028KiB/332288msec) clat (msec): min=5, max=505, avg=50.95, stdev=47.72 lat (msec): min=5, max=505, avg=50.95, stdev=47.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 247], 99.50th=[ 288], 99.90th=[ 447], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 6, max= 95, per=28.99%, avg=20.87, stdev=14.47, samples=551 iops : min= 1, max= 23, avg= 4.57, stdev= 3.64, samples=551 write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6260KiB/332288msec); 0 zone resets clat (msec): min=31, max=1224, avg=163.13, stdev=88.64 lat (msec): min=31, max=1224, avg=163.14, stdev=88.64 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 182], 80.00th=[ 218], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 435], 99.50th=[ 535], 99.90th=[ 718], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 55, per=25.16%, avg=18.87, stdev= 9.49, samples=630 iops : min= 1, max= 13, avg= 4.06, stdev= 2.41, samples=630 lat (msec) : 10=1.60%, 20=8.92%, 50=22.36%, 100=22.07%, 250=37.79% lat (msec) : 500=6.90%, 750=0.33%, 2000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5648, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143960: Thu Aug 13 16:25:51 2026 read: IOPS=4, BW=18.3KiB/s (18.7kB/s)(6052KiB/331484msec) clat (msec): min=6, max=525, avg=49.74, stdev=46.43 lat (msec): min=6, max=525, avg=49.74, stdev=46.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 97], 95.00th=[ 140], | 99.00th=[ 236], 99.50th=[ 271], 99.90th=[ 405], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 109, per=29.86%, avg=21.50, stdev=15.49, samples=540 iops : min= 1, max= 27, avg= 4.72, stdev= 3.91, samples=540 write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6236KiB/331484msec); 0 zone resets clat (msec): min=42, max=1205, avg=164.22, stdev=85.61 lat (msec): min=42, max=1205, avg=164.23, stdev=85.61 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 84], 20.00th=[ 103], | 30.00th=[ 114], 40.00th=[ 129], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 213], 90.00th=[ 271], 95.00th=[ 326], | 99.00th=[ 451], 99.50th=[ 502], 99.90th=[ 751], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 48, per=25.08%, avg=18.81, stdev= 8.99, samples=632 iops : min= 1, max= 12, avg= 4.04, stdev= 2.28, samples=632 lat (msec) : 10=1.46%, 20=10.16%, 50=21.74%, 100=20.70%, 250=39.26% lat (msec) : 500=6.38%, 750=0.23%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5706, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=72.2KiB/s (73.0kB/s), 17.9KiB/s-18.3KiB/s (18.3kB/s-18.7kB/s), io=23.4MiB (24.6MB), run=331484-332371msec WRITE: bw=75.6KiB/s (77.5kB/s), 18.8KiB/s-19.1KiB/s (19.3kB/s-19.6kB/s), io=24.6MiB (25.7MB), run=331484-332371msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144028: Thu Aug 13 16:26:36 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5920KiB/32162msec) clat (usec): min=39, max=545870, avg=45450.23, stdev=46712.26 lat (usec): min=40, max=545871, avg=45452.01, stdev=46712.21 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 143], | 30.00th=[ 27657], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[250610], 99.50th=[333448], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 31, max= 416, per=25.04%, avg=184.06, stdev=76.77, samples=63 iops : min= 1, max= 26, avg=10.73, stdev= 4.87, samples=63 write: IOPS=12, BW=198KiB/s (203kB/s)(6368KiB/32162msec); 0 zone resets clat (usec): min=1480, max=234771, avg=38407.06, stdev=39597.44 lat (usec): min=1482, max=234775, avg=38412.24, stdev=39595.76 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2147], 10.00th=[ 3720], 20.00th=[ 6652], | 30.00th=[ 9896], 40.00th=[ 14222], 50.00th=[ 25035], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[117965], | 99.00th=[166724], 99.50th=[223347], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 411, per=25.66%, avg=198.63, stdev=85.52, samples=63 iops : min= 1, max= 25, avg=11.65, stdev= 5.40, samples=63 lat (usec) : 50=0.78%, 100=7.68%, 250=1.30% lat (msec) : 2=1.95%, 4=3.91%, 10=10.55%, 20=8.85%, 50=31.51% lat (msec) : 100=26.43%, 250=6.64%, 500=0.26%, 750=0.13% cpu : usr=0.07%, sys=5.82%, ctx=1508, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144029: Thu Aug 13 16:26:36 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5744KiB/32555msec) clat (usec): min=41, max=265779, avg=45648.43, stdev=35646.75 lat (usec): min=41, max=265784, avg=45650.24, stdev=35646.77 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 17957], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[175113], 99.50th=[254804], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 411, per=24.77%, avg=182.06, stdev=82.08, samples=62 iops : min= 1, max= 25, avg=10.60, stdev= 5.22, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32555msec); 0 zone resets clat (usec): min=1661, max=438487, avg=39354.65, stdev=51111.07 lat (usec): min=1663, max=438489, avg=39362.31, stdev=51113.86 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2212], 10.00th=[ 3884], 20.00th=[ 6652], | 30.00th=[ 10028], 40.00th=[ 13698], 50.00th=[ 20317], 60.00th=[ 32637], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 90702], 95.00th=[120062], | 99.00th=[278922], 99.50th=[316670], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 31, max= 479, per=25.90%, avg=200.44, stdev=98.33, samples=64 iops : min= 1, max= 29, avg=11.75, stdev= 6.16, samples=64 lat (usec) : 50=0.78%, 100=6.12%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.17%, 4=4.43%, 10=10.55%, 20=11.72%, 50=30.34% lat (msec) : 100=26.82%, 250=5.86%, 500=1.04% cpu : usr=0.07%, sys=5.48%, ctx=1583, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144030: Thu Aug 13 16:26:36 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32176msec) clat (usec): min=28, max=345787, avg=46418.09, stdev=38992.56 lat (usec): min=28, max=345789, avg=46420.74, stdev=38991.44 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 67], 10.00th=[ 80], 20.00th=[ 996], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[183501], 99.50th=[227541], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 414, per=26.54%, avg=195.06, stdev=79.27, samples=63 iops : min= 1, max= 25, avg=11.43, stdev= 4.98, samples=63 write: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32176msec); 0 zone resets clat (usec): min=1785, max=401838, avg=37024.98, stdev=43005.38 lat (usec): min=1787, max=401842, avg=37051.26, stdev=42999.54 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2311], 10.00th=[ 3949], 20.00th=[ 6194], | 30.00th=[ 8979], 40.00th=[ 13829], 50.00th=[ 23462], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 63701], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[177210], 99.50th=[308282], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 63, max= 445, per=24.35%, avg=188.44, stdev=78.42, samples=62 iops : min= 3, max= 27, avg=11.02, stdev= 4.97, samples=62 lat (usec) : 50=0.78%, 100=7.42%, 250=1.69%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.43%, 4=4.43%, 10=11.07%, 20=7.42%, 50=31.12% lat (msec) : 100=26.95%, 250=6.90%, 500=0.39% cpu : usr=0.08%, sys=5.61%, ctx=1546, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144031: Thu Aug 13 16:26:36 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(6032KiB/31243msec) clat (usec): min=24, max=270416, avg=45937.59, stdev=38902.47 lat (usec): min=24, max=270419, avg=45939.32, stdev=38902.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 9503], | 30.00th=[ 28967], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 51119], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[223347], 99.50th=[250610], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 349, per=26.19%, avg=192.49, stdev=74.64, samples=61 iops : min= 1, max= 21, avg=11.26, stdev= 4.73, samples=61 write: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31243msec); 0 zone resets clat (usec): min=1513, max=414503, avg=35460.85, stdev=43235.27 lat (usec): min=1516, max=414506, avg=35466.58, stdev=43235.94 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2212], 10.00th=[ 3523], 20.00th=[ 6128], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 17171], 60.00th=[ 30802], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 84411], 95.00th=[116917], | 99.00th=[191890], 99.50th=[258999], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 31, max= 372, per=25.92%, avg=200.64, stdev=81.20, samples=61 iops : min= 1, max= 23, avg=11.79, stdev= 5.16, samples=61 lat (usec) : 50=0.39%, 100=7.94%, 250=0.91%, 500=0.26% lat (msec) : 2=1.04%, 4=5.21%, 10=12.50%, 20=9.24%, 50=29.95% lat (msec) : 100=25.26%, 250=6.77%, 500=0.52% cpu : usr=0.10%, sys=5.52%, ctx=1484, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=736KiB/s (753kB/s), 176KiB/s-194KiB/s (181kB/s-199kB/s), io=23.4MiB (24.5MB), run=31243-32555msec WRITE: bw=774KiB/s (793kB/s), 187KiB/s-201KiB/s (192kB/s-206kB/s), io=24.6MiB (25.8MB), run=31243-32555msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144023: Thu Aug 13 16:27:21 2026 read: IOPS=4, BW=76.0KiB/s (77.8kB/s)(5920KiB/77873msec) clat (msec): min=7, max=229, avg=46.05, stdev=39.28 lat (msec): min=7, max=229, avg=46.06, stdev=39.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 226], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 287, per=28.44%, avg=87.02, stdev=55.13, samples=133 iops : min= 1, max= 17, avg= 4.60, stdev= 3.46, samples=133 write: IOPS=5, BW=81.8KiB/s (83.7kB/s)(6368KiB/77873msec); 0 zone resets clat (msec): min=30, max=558, avg=152.19, stdev=69.52 lat (msec): min=30, max=558, avg=152.20, stdev=69.52 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 101], | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 243], 95.00th=[ 275], | 99.00th=[ 405], 99.50th=[ 510], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 31, max= 222, per=25.57%, avg=82.35, stdev=36.59, samples=151 iops : min= 1, max= 13, avg= 4.30, stdev= 2.31, samples=151 lat (msec) : 10=1.56%, 20=8.72%, 50=25.13%, 100=18.88%, 250=41.67% lat (msec) : 500=3.78%, 750=0.26% cpu : usr=0.05%, sys=1.48%, ctx=1390, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144024: Thu Aug 13 16:27:21 2026 read: IOPS=4, BW=73.5KiB/s (75.3kB/s)(5744KiB/78136msec) clat (msec): min=8, max=346, avg=46.99, stdev=45.14 lat (msec): min=8, max=346, avg=46.99, stdev=45.14 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 313], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 315, per=29.95%, avg=91.65, stdev=62.51, samples=122 iops : min= 1, max= 19, avg= 4.89, stdev= 3.91, samples=122 write: IOPS=5, BW=83.8KiB/s (85.8kB/s)(6544KiB/78136msec); 0 zone resets clat (msec): min=49, max=525, avg=149.45, stdev=67.77 lat (msec): min=49, max=525, avg=149.47, stdev=67.78 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 232], 95.00th=[ 284], | 99.00th=[ 393], 99.50th=[ 422], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 190, per=26.12%, avg=84.11, stdev=35.18, samples=152 iops : min= 1, max= 11, avg= 4.41, stdev= 2.24, samples=152 lat (msec) : 10=0.65%, 20=9.51%, 50=23.96%, 100=20.70%, 250=40.49% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.05%, sys=1.43%, ctx=1417, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144025: Thu Aug 13 16:27:21 2026 read: IOPS=5, BW=82.1KiB/s (84.1kB/s)(6256KiB/76158msec) clat (msec): min=7, max=354, avg=46.98, stdev=44.65 lat (msec): min=7, max=354, avg=46.98, stdev=44.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 63], 90.00th=[ 88], 95.00th=[ 138], | 99.00th=[ 224], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 29, max= 318, per=29.40%, avg=89.96, stdev=59.93, samples=137 iops : min= 1, max= 19, avg= 4.78, stdev= 3.79, samples=137 write: IOPS=4, BW=79.2KiB/s (81.1kB/s)(6032KiB/76158msec); 0 zone resets clat (msec): min=51, max=559, avg=152.73, stdev=71.72 lat (msec): min=51, max=559, avg=152.76, stdev=71.73 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 99], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 275], | 99.00th=[ 388], 99.50th=[ 535], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 190, per=25.46%, avg=81.97, stdev=34.74, samples=144 iops : min= 1, max= 11, avg= 4.28, stdev= 2.20, samples=144 lat (msec) : 10=0.65%, 20=9.64%, 50=26.17%, 100=21.74%, 250=37.37% lat (msec) : 500=4.04%, 750=0.39% cpu : usr=0.04%, sys=1.44%, ctx=1343, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144026: Thu Aug 13 16:27:21 2026 read: IOPS=4, BW=77.5KiB/s (79.3kB/s)(6032KiB/77850msec) clat (msec): min=7, max=369, avg=50.57, stdev=47.22 lat (msec): min=7, max=369, avg=50.57, stdev=47.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 90], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 368], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 29, max= 318, per=29.56%, avg=90.46, stdev=50.48, samples=130 iops : min= 1, max= 19, avg= 4.82, stdev= 3.18, samples=130 write: IOPS=5, BW=80.4KiB/s (82.3kB/s)(6256KiB/77850msec); 0 zone resets clat (msec): min=46, max=542, avg=149.83, stdev=65.05 lat (msec): min=46, max=542, avg=149.84, stdev=65.05 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 124], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 199], 90.00th=[ 230], 95.00th=[ 279], | 99.00th=[ 355], 99.50th=[ 368], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 31, max= 190, per=25.52%, avg=82.17, stdev=36.15, samples=149 iops : min= 1, max= 11, avg= 4.30, stdev= 2.28, samples=149 lat (msec) : 10=1.17%, 20=7.55%, 50=25.00%, 100=21.48%, 250=40.76% lat (msec) : 500=3.91%, 750=0.13% cpu : usr=0.04%, sys=1.40%, ctx=1351, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=307KiB/s (314kB/s), 73.5KiB/s-82.1KiB/s (75.3kB/s-84.1kB/s), io=23.4MiB (24.5MB), run=76158-78136msec WRITE: bw=323KiB/s (330kB/s), 79.2KiB/s-83.8KiB/s (81.1kB/s-85.8kB/s), io=24.6MiB (25.8MB), run=76158-78136msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144051: Thu Aug 13 16:27:45 2026 read: IOPS=1, BW=1039KiB/s (1064kB/s)(7168KiB/6897msec) clat (msec): min=100, max=3502, avg=672.44, stdev=1250.48 lat (msec): min=100, max=3502, avg=672.44, stdev=1250.48 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 165], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 359], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2007, max= 4598, per=100.00%, avg=3540.00, stdev=1359.24, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=742KiB/s (760kB/s)(5120KiB/6897msec); 0 zone resets clat (msec): min=223, max=641, avg=414.85, stdev=163.60 lat (msec): min=223, max=641, avg=414.96, stdev=163.62 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2003, max= 4055, per=99.33%, avg=2525.00, stdev=1020.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.35%, ctx=53, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144052: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=182KiB/s (186kB/s)(2048KiB/11277msec) clat (msec): min=132, max=158, avg=145.21, stdev=18.18 lat (msec): min=132, max=158, avg=145.21, stdev=18.18 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 1546, max= 2007, per=97.82%, avg=1776.50, stdev=325.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=908KiB/s (930kB/s)(10.0MiB/11277msec); 0 zone resets clat (msec): min=246, max=4000, avg=1086.61, stdev=1306.25 lat (msec): min=246, max=4000, avg=1087.00, stdev=1306.08 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 292], | 30.00th=[ 313], 40.00th=[ 326], 50.00th=[ 485], 60.00th=[ 514], | 70.00th=[ 726], 80.00th=[ 1011], 90.00th=[ 2970], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 1546, max= 4000, per=86.32%, avg=2194.25, stdev=747.54, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33%, >=2000=16.67% cpu : usr=0.02%, sys=1.57%, ctx=68, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144053: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=552KiB/s (565kB/s)(6144KiB/11137msec) clat (msec): min=119, max=853, avg=360.87, stdev=261.19 lat (msec): min=119, max=853, avg=360.87, stdev=261.19 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 268], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1992, max= 2039, per=100.00%, avg=2020.00, stdev=19.92, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=552KiB/s (565kB/s)(6144KiB/11137msec); 0 zone resets clat (msec): min=251, max=4520, avg=1487.77, stdev=1829.21 lat (msec): min=251, max=4520, avg=1487.87, stdev=1829.20 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 567], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 2007, max= 4079, per=100.00%, avg=2808.00, stdev=989.58, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.04%, ctx=57, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144054: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=486KiB/s (498kB/s)(5120KiB/10534msec) clat (msec): min=155, max=322, avg=230.10, stdev=70.48 lat (msec): min=155, max=322, avg=230.10, stdev=70.48 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2027, max= 4071, per=100.00%, avg=2712.33, stdev=1176.66, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=680KiB/s (697kB/s)(7168KiB/10534msec); 0 zone resets clat (msec): min=184, max=3760, avg=1331.42, stdev=1642.31 lat (msec): min=184, max=3760, avg=1331.56, stdev=1642.28 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 228], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 550], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 3675], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1988, max= 3313, per=89.65%, avg=2278.80, stdev=578.52, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, >=2000=16.67% cpu : usr=0.01%, sys=1.32%, ctx=47, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1816KiB/s (1860kB/s), 182KiB/s-1039KiB/s (186kB/s-1064kB/s), io=20.0MiB (20.0MB), run=6897-11277msec WRITE: bw=2543KiB/s (2604kB/s), 552KiB/s-908KiB/s (565kB/s-930kB/s), io=28.0MiB (29.4MB), run=6897-11277msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144056: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=673KiB/s (689kB/s)(7168KiB/10658msec) clat (usec): min=560, max=4900.1k, avg=1338458.75, stdev=2035902.92 lat (usec): min=562, max=4900.1k, avg=1338461.38, stdev=2035905.03 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], | 20.00th=[ 996], 30.00th=[ 1778], 40.00th=[ 1778], | 50.00th=[ 261096], 60.00th=[ 608175], 70.00th=[ 608175], | 80.00th=[3607102], 90.00th=[4932502], 95.00th=[4932502], | 99.00th=[4932502], 99.50th=[4932502], 99.90th=[4932502], | 99.95th=[4932502], 99.99th=[4932502] bw ( KiB/s): min= 1454, max= 4071, per=100.00%, avg=2321.20, stdev=1009.18, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=480KiB/s (492kB/s)(5120KiB/10658msec); 0 zone resets clat (msec): min=83, max=695, avg=255.93, stdev=249.42 lat (msec): min=83, max=696, avg=256.07, stdev=249.59 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 4031, max= 6107, per=100.00%, avg=5069.00, stdev=1467.95, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : >=2000=16.67% cpu : usr=0.01%, sys=4.89%, ctx=851, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144057: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=188KiB/s (193kB/s)(2048KiB/10868msec) clat (msec): min=42, max=215, avg=129.22, stdev=122.72 lat (msec): min=42, max=215, avg=129.22, stdev=122.73 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 43], 40.00th=[ 43], 50.00th=[ 43], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 1462, max= 1906, per=89.38%, avg=1684.00, stdev=313.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=942KiB/s (965kB/s)(10.0MiB/10868msec); 0 zone resets clat (msec): min=123, max=4120, avg=1058.81, stdev=1383.20 lat (msec): min=124, max=4121, avg=1059.09, stdev=1383.46 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 247], | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 300], 60.00th=[ 460], | 70.00th=[ 634], 80.00th=[ 1099], 90.00th=[ 3037], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 1906, max= 4096, per=100.00%, avg=3031.67, stdev=1137.22, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 50=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.02%, sys=4.43%, ctx=121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144058: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=597KiB/s (612kB/s)(6144KiB/10284msec) clat (msec): min=6, max=350, avg=229.20, stdev=119.88 lat (msec): min=6, max=350, avg=229.20, stdev=119.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 255], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2000, max= 4087, per=100.00%, avg=2539.50, stdev=1031.85, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=597KiB/s (612kB/s)(6144KiB/10284msec); 0 zone resets clat (msec): min=212, max=4467, avg=1483.31, stdev=1853.69 lat (msec): min=212, max=4468, avg=1483.42, stdev=1853.69 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 600], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1906, max= 2868, per=83.82%, avg=2211.25, stdev=442.19, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.86%, ctx=293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144059: Thu Aug 13 16:27:45 2026 read: IOPS=0, BW=501KiB/s (513kB/s)(5120KiB/10219msec) clat (usec): min=749, max=291189, avg=119187.39, stdev=122137.97 lat (usec): min=751, max=291191, avg=119189.14, stdev=122137.82 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[ 1205], 40.00th=[ 1205], 50.00th=[145753], 60.00th=[145753], | 70.00th=[156238], 80.00th=[156238], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1906, max= 6131, per=100.00%, avg=4018.50, stdev=2987.53, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=701KiB/s (718kB/s)(7168KiB/10219msec); 0 zone resets clat (msec): min=168, max=4619, avg=1373.24, stdev=1801.66 lat (msec): min=168, max=4620, avg=1373.33, stdev=1801.66 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 180], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 506], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 3272], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1656, max= 2048, per=73.03%, avg=1926.60, stdev=160.52, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=3.00%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1884KiB/s (1930kB/s), 188KiB/s-673KiB/s (193kB/s-689kB/s), io=20.0MiB (20.0MB), run=10219-10868msec WRITE: bw=2638KiB/s (2702kB/s), 480KiB/s-942KiB/s (492kB/s-965kB/s), io=28.0MiB (29.4MB), run=10219-10868msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144070: Thu Aug 13 16:28:02 2026 read: IOPS=0, BW=3806KiB/s (3897kB/s)(12.0MiB/3229msec) clat (msec): min=920, max=1061, avg=976.14, stdev=75.00 lat (msec): min=920, max=1061, avg=976.14, stdev=75.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.13%, ctx=185, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144073: Thu Aug 13 16:28:02 2026 read: IOPS=0, BW=1164KiB/s (1192kB/s)(4096KiB/3519msec) clat (nsec): min=1148.2M, max=1148.2M, avg=1148247668.00, stdev= 0.00 lat (nsec): min=1148.2M, max=1148.2M, avg=1148250370.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2328KiB/s (2384kB/s)(8192KiB/3519msec); 0 zone resets clat (msec): min=823, max=1353, avg=1088.60, stdev=375.25 lat (msec): min=823, max=1354, avg=1089.04, stdev=375.32 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=87.80%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.88%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144074: Thu Aug 13 16:28:02 2026 write: IOPS=1, BW=6592KiB/s (6750kB/s)(12.0MiB/1864msec); 0 zone resets clat (msec): min=447, max=854, avg=594.16, stdev=225.89 lat (msec): min=448, max=854, avg=594.54, stdev=225.91 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 5801, max= 8159, per=74.97%, avg=6980.00, stdev=1667.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.16%, sys=4.51%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144075: Thu Aug 13 16:28:02 2026 write: IOPS=0, BW=3658KiB/s (3746kB/s)(12.0MiB/3359msec); 0 zone resets clat (msec): min=599, max=1235, avg=1001.12, stdev=349.58 lat (msec): min=601, max=1238, avg=1003.11, stdev=349.94 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8062, max= 8175, per=87.19%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.06%, sys=3.33%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4656KiB/s (4768kB/s), 1164KiB/s-3806KiB/s (1192kB/s-3897kB/s), io=16.0MiB (16.8MB), run=3229-3519msec WRITE: bw=9312KiB/s (9535kB/s), 2328KiB/s-6592KiB/s (2384kB/s-6750kB/s), io=32.0MiB (33.6MB), run=1864-3519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144068: Thu Aug 13 16:28:03 2026 read: IOPS=0, BW=3092KiB/s (3166kB/s)(12.0MiB/3974msec) clat (msec): min=266, max=1867, avg=1218.43, stdev=842.21 lat (msec): min=266, max=1867, avg=1218.43, stdev=842.21 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.24%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144069: Thu Aug 13 16:28:03 2026 read: IOPS=0, BW=913KiB/s (935kB/s)(4096KiB/4484msec) clat (nsec): min=1953.3M, max=1953.3M, avg=1953251049.00, stdev= 0.00 lat (nsec): min=1953.3M, max=1953.3M, avg=1953251954.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1955], 5.00th=[ 1955], 10.00th=[ 1955], 20.00th=[ 1955], | 30.00th=[ 1955], 40.00th=[ 1955], 50.00th=[ 1955], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1827KiB/s (1871kB/s)(8192KiB/4484msec); 0 zone resets clat (msec): min=897, max=1307, avg=1102.81, stdev=290.16 lat (msec): min=898, max=1308, avg=1103.17, stdev=289.99 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.23%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144071: Thu Aug 13 16:28:03 2026 write: IOPS=0, BW=3363KiB/s (3444kB/s)(12.0MiB/3654msec); 0 zone resets clat (msec): min=633, max=1662, avg=1175.55, stdev=516.55 lat (msec): min=634, max=1662, avg=1176.46, stdev=516.44 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7922, max= 8159, per=100.00%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.58%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144072: Thu Aug 13 16:28:03 2026 write: IOPS=0, BW=4030KiB/s (4127kB/s)(12.0MiB/3049msec); 0 zone resets clat (msec): min=421, max=1999, avg=965.24, stdev=896.36 lat (msec): min=421, max=2003, avg=966.66, stdev=897.97 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 6450, max= 8159, per=99.97%, avg=7304.50, stdev=1208.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.07%, sys=4.86%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3654KiB/s (3742kB/s), 913KiB/s-3092KiB/s (935kB/s-3166kB/s), io=16.0MiB (16.8MB), run=3974-4484msec WRITE: bw=7308KiB/s (7483kB/s), 1827KiB/s-4030KiB/s (1871kB/s-4127kB/s), io=32.0MiB (33.6MB), run=3049-4484msec