== sanity test 398b: DIO and buffer IO race ============== 18:14:12 (1786313652) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.41898 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143696: Sun Aug 9 18:18:15 2026 read: IOPS=6, BW=27.1KiB/s (27.7kB/s)(5992KiB/221473msec) clat (usec): min=32, max=1056.1k, avg=79517.36, stdev=74275.45 lat (usec): min=32, max=1056.1k, avg=79520.97, stdev=74276.02 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 109], 10.00th=[ 19792], | 20.00th=[ 30540], 30.00th=[ 39584], 40.00th=[ 49021], | 50.00th=[ 61080], 60.00th=[ 72877], 70.00th=[ 90702], | 80.00th=[ 116917], 90.00th=[ 158335], 95.00th=[ 212861], | 99.00th=[ 358613], 99.50th=[ 408945], 99.90th=[ 717226], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 6, max= 80, per=26.02%, avg=27.84, stdev=14.99, samples=410 iops : min= 1, max= 20, avg= 6.34, stdev= 3.81, samples=410 write: IOPS=7, BW=28.4KiB/s (29.1kB/s)(6296KiB/221473msec); 0 zone resets clat (usec): min=1194, max=813699, avg=64898.53, stdev=74443.48 lat (usec): min=1195, max=813701, avg=64900.91, stdev=74443.08 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1795], 10.00th=[ 2376], 20.00th=[ 5276], | 30.00th=[ 12125], 40.00th=[ 27657], 50.00th=[ 43779], 60.00th=[ 59507], | 70.00th=[ 82314], 80.00th=[112722], 90.00th=[158335], 95.00th=[198181], | 99.00th=[325059], 99.50th=[396362], 99.90th=[608175], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 6, max= 95, per=25.24%, avg=28.27, stdev=17.21, samples=424 iops : min= 1, max= 23, avg= 6.45, stdev= 4.35, samples=424 lat (usec) : 50=0.33%, 100=2.08%, 250=0.26%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=3.48%, 4=5.11%, 10=6.32%, 20=5.47%, 50=24.38% lat (msec) : 100=27.70%, 250=21.78%, 500=2.67%, 750=0.20%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=3.73%, ctx=6719, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143697: Sun Aug 9 18:18:15 2026 read: IOPS=6, BW=26.6KiB/s (27.2kB/s)(5940KiB/223329msec) clat (usec): min=36, max=763571, avg=78669.48, stdev=66588.40 lat (usec): min=37, max=763572, avg=78672.84, stdev=66589.44 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 766], 10.00th=[ 21627], 20.00th=[ 31851], | 30.00th=[ 40633], 40.00th=[ 50594], 50.00th=[ 61604], 60.00th=[ 73925], | 70.00th=[ 92799], 80.00th=[115868], 90.00th=[158335], 95.00th=[200279], | 99.00th=[308282], 99.50th=[337642], 99.90th=[683672], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 5, max= 79, per=25.95%, avg=27.77, stdev=14.49, samples=408 iops : min= 1, max= 19, avg= 6.31, stdev= 3.67, samples=408 write: IOPS=7, BW=28.4KiB/s (29.1kB/s)(6348KiB/223329msec); 0 zone resets clat (usec): min=1184, max=658056, avg=66858.64, stdev=79367.25 lat (usec): min=1185, max=658058, avg=66861.62, stdev=79367.48 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1795], 10.00th=[ 2573], 20.00th=[ 5145], | 30.00th=[ 11731], 40.00th=[ 26870], 50.00th=[ 41157], 60.00th=[ 58983], | 70.00th=[ 81265], 80.00th=[114820], 90.00th=[164627], 95.00th=[212861], | 99.00th=[358613], 99.50th=[434111], 99.90th=[616563], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 6, max= 111, per=25.80%, avg=28.90, stdev=17.52, samples=420 iops : min= 1, max= 27, avg= 6.61, stdev= 4.42, samples=420 lat (usec) : 50=0.20%, 100=2.05%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.74%, 4=4.43%, 10=6.58%, 20=5.70%, 50=24.64% lat (msec) : 100=27.34%, 250=22.66%, 500=2.21%, 750=0.23%, 1000=0.03% cpu : usr=0.05%, sys=3.61%, ctx=6718, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143698: Sun Aug 9 18:18:15 2026 read: IOPS=6, BW=27.2KiB/s (27.9kB/s)(6028KiB/221427msec) clat (usec): min=32, max=893660, avg=76387.23, stdev=63996.12 lat (usec): min=33, max=893662, avg=76391.22, stdev=63996.52 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 104], 10.00th=[ 19530], 20.00th=[ 31589], | 30.00th=[ 40109], 40.00th=[ 50594], 50.00th=[ 61604], 60.00th=[ 74974], | 70.00th=[ 90702], 80.00th=[113771], 90.00th=[154141], 95.00th=[185598], | 99.00th=[287310], 99.50th=[383779], 99.90th=[484443], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 80, per=25.96%, avg=27.77, stdev=14.97, samples=413 iops : min= 1, max= 20, avg= 6.33, stdev= 3.78, samples=413 write: IOPS=7, BW=28.3KiB/s (28.9kB/s)(6260KiB/221427msec); 0 zone resets clat (usec): min=1223, max=935695, avg=67755.52, stdev=78545.67 lat (usec): min=1224, max=935697, avg=67761.48, stdev=78545.69 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1827], 10.00th=[ 2540], 20.00th=[ 5473], | 30.00th=[ 13304], 40.00th=[ 28181], 50.00th=[ 43779], 60.00th=[ 62653], | 70.00th=[ 85459], 80.00th=[115868], 90.00th=[164627], 95.00th=[204473], | 99.00th=[333448], 99.50th=[429917], 99.90th=[750781], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 6, max= 87, per=25.67%, avg=28.75, stdev=14.91, samples=414 iops : min= 1, max= 21, avg= 6.58, stdev= 3.75, samples=414 lat (usec) : 50=0.20%, 100=2.25%, 250=0.49%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=3.22%, 4=5.08%, 10=6.05%, 20=5.34%, 50=23.80% lat (msec) : 100=28.52%, 250=22.33%, 500=2.38%, 750=0.03%, 1000=0.10% cpu : usr=0.06%, sys=4.13%, ctx=6710, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143699: Sun Aug 9 18:18:15 2026 read: IOPS=6, BW=27.4KiB/s (28.0kB/s)(6052KiB/221006msec) clat (usec): min=34, max=628070, avg=77290.72, stdev=64385.92 lat (usec): min=34, max=628070, avg=77293.17, stdev=64385.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 273], 10.00th=[ 21103], 20.00th=[ 31065], | 30.00th=[ 40109], 40.00th=[ 50070], 50.00th=[ 61604], 60.00th=[ 73925], | 70.00th=[ 91751], 80.00th=[115868], 90.00th=[147850], 95.00th=[189793], | 99.00th=[325059], 99.50th=[400557], 99.90th=[608175], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 6, max= 87, per=26.75%, avg=28.62, stdev=14.87, samples=404 iops : min= 1, max= 21, avg= 6.54, stdev= 3.75, samples=404 write: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6236KiB/221006msec); 0 zone resets clat (usec): min=1216, max=924487, avg=66607.51, stdev=78916.83 lat (usec): min=1218, max=924490, avg=66610.88, stdev=78917.30 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1991], 10.00th=[ 2769], 20.00th=[ 5473], | 30.00th=[ 13304], 40.00th=[ 27657], 50.00th=[ 42206], 60.00th=[ 60031], | 70.00th=[ 85459], 80.00th=[112722], 90.00th=[162530], 95.00th=[206570], | 99.00th=[333448], 99.50th=[471860], 99.90th=[868221], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 6, max= 98, per=25.53%, avg=28.60, stdev=16.00, samples=416 iops : min= 1, max= 24, avg= 6.55, stdev= 4.02, samples=416 lat (usec) : 50=0.29%, 100=1.99%, 250=0.16%, 500=0.16% lat (msec) : 2=2.64%, 4=5.50%, 10=5.79%, 20=5.60%, 50=25.26% lat (msec) : 100=27.47%, 250=23.01%, 500=1.89%, 750=0.16%, 1000=0.07% cpu : usr=0.05%, sys=3.32%, ctx=6755, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=108KiB/s (110kB/s), 26.6KiB/s-27.4KiB/s (27.2kB/s-28.0kB/s), io=23.4MiB (24.6MB), run=221006-223329msec WRITE: bw=113KiB/s (115kB/s), 28.2KiB/s-28.4KiB/s (28.9kB/s-29.1kB/s), io=24.6MiB (25.7MB), run=221006-223329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143691: Sun Aug 9 18:21:01 2026 read: IOPS=3, BW=15.5KiB/s (15.8kB/s)(5992KiB/387739msec) clat (msec): min=6, max=1197, avg=73.04, stdev=81.62 lat (msec): min=6, max=1197, avg=73.06, stdev=81.62 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 101], 90.00th=[ 148], 95.00th=[ 209], | 99.00th=[ 397], 99.50th=[ 523], 99.90th=[ 1003], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 5, max= 87, per=31.44%, avg=19.18, stdev=12.17, samples=592 iops : min= 1, max= 21, avg= 4.18, stdev= 3.09, samples=592 write: IOPS=4, BW=16.2KiB/s (16.6kB/s)(6296KiB/387739msec); 0 zone resets clat (msec): min=39, max=977, avg=176.45, stdev=117.44 lat (msec): min=39, max=977, avg=176.45, stdev=117.44 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 197], 80.00th=[ 241], 90.00th=[ 334], 95.00th=[ 418], | 99.00th=[ 617], 99.50th=[ 701], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 6, max= 52, per=26.39%, avg=16.89, stdev= 9.04, samples=702 iops : min= 1, max= 13, avg= 3.60, stdev= 2.31, samples=702 lat (msec) : 10=0.78%, 20=5.63%, 50=18.88%, 100=26.89%, 250=36.85% lat (msec) : 500=9.57%, 750=1.17%, 1000=0.16%, 2000=0.07% cpu : usr=0.03%, sys=1.16%, ctx=5753, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143692: Sun Aug 9 18:21:01 2026 read: IOPS=3, BW=15.2KiB/s (15.6kB/s)(5940KiB/389533msec) clat (msec): min=5, max=893, avg=72.72, stdev=74.34 lat (msec): min=5, max=893, avg=72.72, stdev=74.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 106], 90.00th=[ 155], 95.00th=[ 211], | 99.00th=[ 355], 99.50th=[ 510], 99.90th=[ 667], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 6, max= 87, per=31.35%, avg=19.12, stdev=12.32, samples=588 iops : min= 1, max= 21, avg= 4.17, stdev= 3.15, samples=588 write: IOPS=4, BW=16.3KiB/s (16.7kB/s)(6348KiB/389533msec); 0 zone resets clat (msec): min=32, max=946, avg=177.01, stdev=114.26 lat (msec): min=32, max=946, avg=177.02, stdev=114.26 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 92], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 142], 60.00th=[ 167], | 70.00th=[ 199], 80.00th=[ 249], 90.00th=[ 330], 95.00th=[ 414], | 99.00th=[ 609], 99.50th=[ 659], 99.90th=[ 709], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 6, max= 72, per=26.59%, avg=17.02, stdev= 9.48, samples=704 iops : min= 1, max= 18, avg= 3.64, stdev= 2.42, samples=704 lat (msec) : 10=0.78%, 20=5.44%, 50=19.43%, 100=25.46%, 250=37.14% lat (msec) : 500=10.35%, 750=1.33%, 1000=0.07% cpu : usr=0.03%, sys=1.28%, ctx=5722, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143693: Sun Aug 9 18:21:01 2026 read: IOPS=3, BW=15.6KiB/s (15.0kB/s)(6028KiB/386389msec) clat (msec): min=7, max=993, avg=72.40, stdev=74.60 lat (msec): min=7, max=993, avg=72.41, stdev=74.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 40], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 105], 90.00th=[ 150], 95.00th=[ 205], | 99.00th=[ 368], 99.50th=[ 447], 99.90th=[ 634], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 6, max= 69, per=30.54%, avg=18.63, stdev=12.15, samples=611 iops : min= 1, max= 17, avg= 4.05, stdev= 3.09, samples=611 write: IOPS=4, BW=16.2KiB/s (16.6kB/s)(6260KiB/386389msec); 0 zone resets clat (msec): min=38, max=1068, avg=176.76, stdev=117.85 lat (msec): min=38, max=1068, avg=176.77, stdev=117.85 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 105], 40.00th=[ 123], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 199], 80.00th=[ 243], 90.00th=[ 326], 95.00th=[ 414], | 99.00th=[ 609], 99.50th=[ 701], 99.90th=[ 844], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 5, max= 48, per=26.63%, avg=17.04, stdev= 9.18, samples=692 iops : min= 1, max= 12, avg= 3.64, stdev= 2.37, samples=692 lat (msec) : 10=0.91%, 20=5.21%, 50=18.52%, 100=27.93%, 250=36.30% lat (msec) : 500=9.57%, 750=1.37%, 1000=0.16%, 2000=0.03% cpu : usr=0.03%, sys=1.24%, ctx=5728, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143694: Sun Aug 9 18:21:01 2026 read: IOPS=3, BW=15.7KiB/s (16.0kB/s)(6052KiB/386624msec) clat (msec): min=7, max=765, avg=73.75, stdev=71.69 lat (msec): min=7, max=765, avg=73.76, stdev=71.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 27], | 30.00th=[ 34], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 155], 95.00th=[ 215], | 99.00th=[ 368], 99.50th=[ 456], 99.90th=[ 584], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 6, max= 96, per=31.78%, avg=19.39, stdev=12.73, samples=592 iops : min= 1, max= 24, avg= 4.23, stdev= 3.26, samples=592 write: IOPS=4, BW=16.1KiB/s (16.5kB/s)(6236KiB/386624msec); 0 zone resets clat (msec): min=36, max=1071, avg=176.01, stdev=113.90 lat (msec): min=36, max=1071, avg=176.02, stdev=113.90 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 93], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 194], 80.00th=[ 245], 90.00th=[ 317], 95.00th=[ 401], | 99.00th=[ 600], 99.50th=[ 684], 99.90th=[ 986], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 6, max= 48, per=26.19%, avg=16.76, stdev= 9.06, samples=701 iops : min= 1, max= 12, avg= 3.57, stdev= 2.30, samples=701 lat (msec) : 10=0.59%, 20=5.53%, 50=18.42%, 100=26.82%, 250=37.53% lat (msec) : 500=9.96%, 750=1.01%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=1.32%, ctx=5788, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=61.6KiB/s (63.1kB/s), 15.2KiB/s-15.7KiB/s (15.6kB/s-16.0kB/s), io=23.4MiB (24.6MB), run=386389-389533msec WRITE: bw=64.5KiB/s (66.1kB/s), 16.1KiB/s-16.3KiB/s (16.5kB/s-16.7kB/s), io=24.6MiB (25.7MB), run=386389-389533msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143777: Sun Aug 9 18:21:53 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5920KiB/42882msec) clat (usec): min=43, max=566754, avg=63181.90, stdev=57481.48 lat (usec): min=43, max=566755, avg=63183.55, stdev=57481.29 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 84], 20.00th=[ 24249], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 51643], 60.00th=[ 63177], | 70.00th=[ 73925], 80.00th=[ 98042], 90.00th=[129500], 95.00th=[164627], | 99.00th=[231736], 99.50th=[396362], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 30, max= 311, per=25.96%, avg=140.20, stdev=64.32, samples=82 iops : min= 1, max= 19, avg= 8.07, stdev= 4.08, samples=82 write: IOPS=9, BW=149KiB/s (152kB/s)(6368KiB/42882msec); 0 zone resets clat (usec): min=1709, max=353922, avg=48840.67, stdev=53731.82 lat (usec): min=1711, max=353924, avg=48844.00, stdev=53731.70 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2507], 10.00th=[ 3130], 20.00th=[ 5342], | 30.00th=[ 8717], 40.00th=[ 19006], 50.00th=[ 31065], 60.00th=[ 44303], | 70.00th=[ 62653], 80.00th=[ 88605], 90.00th=[120062], 95.00th=[164627], | 99.00th=[231736], 99.50th=[274727], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 30, max= 423, per=26.54%, avg=150.72, stdev=80.61, samples=82 iops : min= 1, max= 26, avg= 8.70, stdev= 5.08, samples=82 lat (usec) : 50=0.52%, 100=4.56%, 250=1.17%, 500=0.13%, 750=0.26% lat (msec) : 2=1.17%, 4=7.29%, 10=8.46%, 20=5.34%, 50=27.34% lat (msec) : 100=26.30%, 250=16.80%, 500=0.52%, 750=0.13% cpu : usr=0.07%, sys=5.01%, ctx=1571, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143778: Sun Aug 9 18:21:53 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5744KiB/44298msec) clat (usec): min=41, max=362028, avg=62357.08, stdev=53679.16 lat (usec): min=41, max=362029, avg=62358.65, stdev=53679.23 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 80], 20.00th=[ 22152], | 30.00th=[ 33162], 40.00th=[ 42206], 50.00th=[ 51119], 60.00th=[ 63701], | 70.00th=[ 76022], 80.00th=[ 92799], 90.00th=[131597], 95.00th=[162530], | 99.00th=[238027], 99.50th=[333448], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 26, max= 348, per=24.73%, avg=133.55, stdev=60.40, samples=84 iops : min= 1, max= 21, avg= 7.63, stdev= 3.79, samples=84 write: IOPS=9, BW=148KiB/s (151kB/s)(6544KiB/44298msec); 0 zone resets clat (usec): min=1470, max=366362, avg=53452.86, stdev=66679.22 lat (usec): min=1471, max=366365, avg=53457.87, stdev=66677.76 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2278], 10.00th=[ 3064], 20.00th=[ 4490], | 30.00th=[ 8455], 40.00th=[ 15664], 50.00th=[ 27919], 60.00th=[ 41157], | 70.00th=[ 62653], 80.00th=[ 92799], 90.00th=[149947], 95.00th=[191890], | 99.00th=[304088], 99.50th=[337642], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 29, max= 442, per=26.35%, avg=149.65, stdev=88.83, samples=85 iops : min= 1, max= 27, avg= 8.65, stdev= 5.62, samples=85 lat (usec) : 50=0.65%, 100=4.69%, 250=0.91%, 750=0.26%, 1000=0.26% lat (msec) : 2=1.56%, 4=7.55%, 10=8.85%, 20=6.64%, 50=25.39% lat (msec) : 100=25.39%, 250=16.15%, 500=1.69% cpu : usr=0.07%, sys=4.89%, ctx=1627, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143779: Sun Aug 9 18:21:53 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(6256KiB/42705msec) clat (usec): min=41, max=577075, avg=64307.59, stdev=59330.78 lat (usec): min=41, max=577075, avg=64313.49, stdev=59331.87 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 23200], | 30.00th=[ 32113], 40.00th=[ 42206], 50.00th=[ 54264], 60.00th=[ 67634], | 70.00th=[ 79168], 80.00th=[ 98042], 90.00th=[130548], 95.00th=[168821], | 99.00th=[267387], 99.50th=[337642], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 31, max= 316, per=27.61%, avg=149.07, stdev=72.05, samples=82 iops : min= 1, max= 19, avg= 8.62, stdev= 4.54, samples=82 write: IOPS=8, BW=141KiB/s (145kB/s)(6032KiB/42705msec); 0 zone resets clat (usec): min=1605, max=424597, avg=46465.58, stdev=57848.22 lat (usec): min=1607, max=424600, avg=46469.00, stdev=57847.79 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2376], 10.00th=[ 3261], 20.00th=[ 5080], | 30.00th=[ 8029], 40.00th=[ 13566], 50.00th=[ 24249], 60.00th=[ 36439], | 70.00th=[ 54789], 80.00th=[ 82314], 90.00th=[117965], 95.00th=[164627], | 99.00th=[283116], 99.50th=[329253], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 28, max= 377, per=25.35%, avg=143.99, stdev=74.40, samples=81 iops : min= 1, max= 23, avg= 8.28, stdev= 4.68, samples=81 lat (usec) : 50=0.78%, 100=5.73%, 250=0.91%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=1.04%, 4=6.51%, 10=9.90%, 20=7.03%, 50=24.22% lat (msec) : 100=25.52%, 250=16.28%, 500=1.04%, 750=0.13% cpu : usr=0.07%, sys=4.77%, ctx=1660, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143780: Sun Aug 9 18:21:53 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42450msec) clat (usec): min=28, max=658923, avg=61627.37, stdev=60792.78 lat (usec): min=28, max=658924, avg=61644.55, stdev=60785.74 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 19268], | 30.00th=[ 31065], 40.00th=[ 38011], 50.00th=[ 49021], 60.00th=[ 62129], | 70.00th=[ 76022], 80.00th=[ 93848], 90.00th=[130548], 95.00th=[160433], | 99.00th=[258999], 99.50th=[329253], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 26, max= 381, per=26.50%, avg=143.07, stdev=74.57, samples=81 iops : min= 1, max= 23, avg= 8.25, stdev= 4.70, samples=81 write: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42450msec); 0 zone resets clat (usec): min=1529, max=320393, avg=48902.45, stdev=55526.98 lat (usec): min=1531, max=320394, avg=48919.96, stdev=55525.42 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2737], 10.00th=[ 3589], 20.00th=[ 5342], | 30.00th=[ 9896], 40.00th=[ 17433], 50.00th=[ 29754], 60.00th=[ 43254], | 70.00th=[ 62653], 80.00th=[ 85459], 90.00th=[121111], 95.00th=[160433], | 99.00th=[270533], 99.50th=[295699], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 29, max= 349, per=26.33%, avg=149.53, stdev=73.65, samples=81 iops : min= 1, max= 21, avg= 8.65, stdev= 4.66, samples=81 lat (usec) : 50=0.91%, 100=5.34%, 250=0.91%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=9.38%, 20=7.81%, 50=26.17% lat (msec) : 100=25.65%, 250=15.49%, 500=1.04%, 750=0.13% cpu : usr=0.04%, sys=5.44%, ctx=1661, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=541KiB/s (554kB/s), 130KiB/s-146KiB/s (133kB/s-150kB/s), io=23.4MiB (24.5MB), run=42450-44298msec WRITE: bw=569KiB/s (583kB/s), 141KiB/s-149KiB/s (145kB/s-152kB/s), io=24.6MiB (25.8MB), run=42450-44298msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143772: Sun Aug 9 18:22:38 2026 read: IOPS=4, BW=65.7KiB/s (67.3kB/s)(5920KiB/90109msec) clat (msec): min=7, max=480, avg=61.24, stdev=61.94 lat (msec): min=7, max=480, avg=61.24, stdev=61.94 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 67], 80.00th=[ 91], 90.00th=[ 126], 95.00th=[ 190], | 99.00th=[ 305], 99.50th=[ 347], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 27, max= 287, per=28.78%, avg=76.27, stdev=48.60, samples=150 iops : min= 1, max= 17, avg= 4.08, stdev= 3.11, samples=150 write: IOPS=4, BW=70.7KiB/s (72.4kB/s)(6368KiB/90109msec); 0 zone resets clat (msec): min=34, max=660, avg=168.92, stdev=95.65 lat (msec): min=34, max=660, avg=168.93, stdev=95.65 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 127], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 192], 80.00th=[ 232], 90.00th=[ 296], 95.00th=[ 363], | 99.00th=[ 550], 99.50th=[ 600], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 27, max= 160, per=26.20%, avg=73.09, stdev=34.85, samples=169 iops : min= 1, max= 10, avg= 3.87, stdev= 2.27, samples=169 lat (msec) : 10=0.78%, 20=8.98%, 50=19.92%, 100=22.40%, 250=38.15% lat (msec) : 500=9.11%, 750=0.65% cpu : usr=0.03%, sys=1.52%, ctx=1454, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143773: Sun Aug 9 18:22:38 2026 read: IOPS=3, BW=63.8KiB/s (65.3kB/s)(5744KiB/90037msec) clat (msec): min=6, max=536, avg=61.84, stdev=64.85 lat (msec): min=6, max=536, avg=61.84, stdev=64.85 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 132], 95.00th=[ 188], | 99.00th=[ 355], 99.50th=[ 468], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 28, max= 317, per=30.26%, avg=80.19, stdev=46.64, samples=138 iops : min= 1, max= 19, avg= 4.33, stdev= 3.02, samples=138 write: IOPS=4, BW=72.7KiB/s (74.4kB/s)(6544KiB/90037msec); 0 zone resets clat (msec): min=44, max=615, avg=165.46, stdev=89.34 lat (msec): min=44, max=615, avg=165.48, stdev=89.33 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 110], 40.00th=[ 127], 50.00th=[ 146], 60.00th=[ 167], | 70.00th=[ 188], 80.00th=[ 226], 90.00th=[ 288], 95.00th=[ 326], | 99.00th=[ 485], 99.50th=[ 575], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 28, max= 191, per=26.96%, avg=75.22, stdev=34.27, samples=167 iops : min= 1, max= 11, avg= 4.01, stdev= 2.26, samples=167 lat (msec) : 10=0.52%, 20=7.29%, 50=20.96%, 100=23.31%, 250=38.54% lat (msec) : 500=8.72%, 750=0.65% cpu : usr=0.03%, sys=1.28%, ctx=1334, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143774: Sun Aug 9 18:22:38 2026 read: IOPS=4, BW=71.3KiB/s (73.1kB/s)(6256KiB/87683msec) clat (msec): min=8, max=541, avg=61.70, stdev=59.46 lat (msec): min=8, max=541, avg=61.71, stdev=59.46 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 52], | 70.00th=[ 68], 80.00th=[ 90], 90.00th=[ 138], 95.00th=[ 199], | 99.00th=[ 253], 99.50th=[ 326], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 28, max= 256, per=31.20%, avg=82.69, stdev=51.46, samples=147 iops : min= 1, max= 16, avg= 4.48, stdev= 3.29, samples=147 write: IOPS=4, BW=68.8KiB/s (70.4kB/s)(6032KiB/87683msec); 0 zone resets clat (msec): min=45, max=681, avg=168.41, stdev=93.46 lat (msec): min=45, max=681, avg=168.41, stdev=93.46 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 113], 40.00th=[ 128], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 190], 80.00th=[ 230], 90.00th=[ 305], 95.00th=[ 372], | 99.00th=[ 456], 99.50th=[ 575], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 28, max= 149, per=25.63%, avg=71.51, stdev=31.05, samples=163 iops : min= 1, max= 9, avg= 3.77, stdev= 2.07, samples=163 lat (msec) : 10=0.52%, 20=7.42%, 50=22.01%, 100=23.96%, 250=38.28% lat (msec) : 500=7.29%, 750=0.52% cpu : usr=0.03%, sys=1.15%, ctx=1325, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143775: Sun Aug 9 18:22:38 2026 read: IOPS=4, BW=68.1KiB/s (69.8kB/s)(6032KiB/88544msec) clat (msec): min=6, max=470, avg=63.42, stdev=61.69 lat (msec): min=6, max=470, avg=63.42, stdev=61.69 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 41], 60.00th=[ 53], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 140], 95.00th=[ 199], | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 27, max= 256, per=30.47%, avg=80.74, stdev=48.08, samples=143 iops : min= 1, max= 16, avg= 4.36, stdev= 3.11, samples=143 write: IOPS=4, BW=70.7KiB/s (72.3kB/s)(6256KiB/88544msec); 0 zone resets clat (msec): min=46, max=707, avg=164.82, stdev=91.15 lat (msec): min=46, max=707, avg=164.82, stdev=91.15 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 126], 50.00th=[ 142], 60.00th=[ 167], | 70.00th=[ 190], 80.00th=[ 220], 90.00th=[ 275], 95.00th=[ 334], | 99.00th=[ 518], 99.50th=[ 584], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 27, max= 187, per=26.87%, avg=74.96, stdev=31.78, samples=161 iops : min= 1, max= 11, avg= 3.98, stdev= 2.10, samples=161 lat (msec) : 10=0.78%, 20=8.46%, 50=19.40%, 100=23.57%, 250=39.58% lat (msec) : 500=7.55%, 750=0.65% cpu : usr=0.04%, sys=1.30%, ctx=1372, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=266KiB/s (272kB/s), 63.8KiB/s-71.3KiB/s (65.3kB/s-73.1kB/s), io=23.4MiB (24.5MB), run=87683-90109msec WRITE: bw=280KiB/s (286kB/s), 68.8KiB/s-72.7KiB/s (70.4kB/s-74.4kB/s), io=24.6MiB (25.8MB), run=87683-90109msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143808: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=808KiB/s (828kB/s)(7168KiB/8866msec) clat (usec): min=551, max=496136, avg=266333.91, stdev=213530.32 lat (usec): min=552, max=496138, avg=266335.34, stdev=213530.42 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 979], | 30.00th=[183501], 40.00th=[183501], 50.00th=[270533], 60.00th=[446694], | 70.00th=[446694], 80.00th=[467665], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 1432, max= 4007, per=100.00%, avg=2765.00, stdev=1242.00, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=577KiB/s (591kB/s)(5120KiB/8866msec); 0 zone resets clat (msec): min=801, max=1942, avg=1399.63, stdev=531.59 lat (msec): min=801, max=1942, avg=1400.13, stdev=531.71 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1565, max= 2035, per=61.24%, avg=1917.40, stdev=198.70, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=8.33%, 500=33.33%, 1000=16.67%, 2000=25.00% cpu : usr=0.00%, sys=5.79%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143809: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=224KiB/s (229kB/s)(2048KiB/9155msec) clat (msec): min=502, max=691, avg=596.92, stdev=134.10 lat (msec): min=502, max=691, avg=596.92, stdev=134.10 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1841, max= 1906, per=83.75%, avg=1873.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1119KiB/s (1145kB/s)(10.0MiB/9155msec); 0 zone resets clat (msec): min=135, max=1989, avg=795.49, stdev=548.50 lat (msec): min=139, max=1989, avg=795.96, stdev=548.00 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 144], | 30.00th=[ 464], 40.00th=[ 617], 50.00th=[ 726], 60.00th=[ 760], | 70.00th=[ 902], 80.00th=[ 927], 90.00th=[ 1301], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1590, max= 4023, per=79.87%, avg=2500.71, stdev=1030.61, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=8.33%, 750=33.33%, 1000=25.00%, 2000=16.67% cpu : usr=0.00%, sys=5.29%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143810: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=781KiB/s (800kB/s)(6144KiB/7864msec) clat (msec): min=239, max=2888, avg=834.77, stdev=1014.98 lat (msec): min=239, max=2888, avg=834.77, stdev=1014.98 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 472], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1464, max= 2031, per=81.23%, avg=1817.20, stdev=278.81, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=781KiB/s (800kB/s)(6144KiB/7864msec); 0 zone resets clat (msec): min=114, max=935, avg=475.35, stdev=320.80 lat (msec): min=114, max=935, avg=475.65, stdev=320.71 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 393], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1809, max= 3930, per=74.98%, avg=2347.60, stdev=888.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.08%, ctx=237, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143811: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=659KiB/s (675kB/s)(5120KiB/7770msec) clat (usec): min=501, max=676141, avg=294642.72, stdev=299338.32 lat (usec): min=502, max=676142, avg=294643.77, stdev=299338.40 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 2008], 40.00th=[ 2008], 50.00th=[299893], 60.00th=[299893], | 70.00th=[497026], 80.00th=[497026], 90.00th=[675283], 95.00th=[675283], | 99.00th=[675283], 99.50th=[675283], 99.90th=[675283], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 3131, max= 3984, per=100.00%, avg=3557.50, stdev=603.16, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=923KiB/s (945kB/s)(7168KiB/7770msec); 0 zone resets clat (msec): min=91, max=1989, avg=893.81, stdev=601.42 lat (msec): min=91, max=1989, avg=894.09, stdev=601.40 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 527], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 936], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 1183], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1809, max= 2035, per=62.50%, avg=1957.00, stdev=87.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 500=16.67%, 750=25.00%, 1000=16.67% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=5.52%, ctx=203, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2237KiB/s (2291kB/s), 224KiB/s-808KiB/s (229kB/s-828kB/s), io=20.0MiB (20.0MB), run=7770-9155msec WRITE: bw=3132KiB/s (3207kB/s), 577KiB/s-1119KiB/s (591kB/s-1145kB/s), io=28.0MiB (29.4MB), run=7770-9155msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143803: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(7168KiB/9585msec) clat (msec): min=104, max=1042, avg=398.04, stdev=327.85 lat (msec): min=104, max=1042, avg=398.04, stdev=327.85 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 153], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 300], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 617], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 2031, max= 2589, per=100.00%, avg=2149.20, stdev=245.95, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=534KiB/s (547kB/s)(5120KiB/9585msec); 0 zone resets clat (msec): min=742, max=2285, avg=1351.32, stdev=615.27 lat (msec): min=742, max=2285, avg=1351.40, stdev=615.27 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1656, max= 2043, per=67.27%, avg=1905.20, stdev=158.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=25.00% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.48%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143804: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=202KiB/s (207kB/s)(2048KiB/10123msec) clat (msec): min=280, max=306, avg=293.20, stdev=18.63 lat (msec): min=280, max=306, avg=293.20, stdev=18.63 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1359, max= 1656, per=74.52%, avg=1507.50, stdev=210.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1012KiB/s (1036kB/s)(10.0MiB/10123msec); 0 zone resets clat (msec): min=134, max=3197, avg=933.86, stdev=891.72 lat (msec): min=134, max=3198, avg=934.15, stdev=891.52 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 178], | 30.00th=[ 518], 40.00th=[ 634], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 735], 80.00th=[ 1167], 90.00th=[ 1485], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1656, max= 2048, per=67.99%, avg=1925.43, stdev=141.15, samples=7 iops : min= 1, max= 2, avg= 1.14, stdev= 0.38, samples=7 lat (msec) : 250=16.67%, 500=16.67%, 750=41.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=3.26%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143805: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=765KiB/s (783kB/s)(6144KiB/8031msec) clat (msec): min=224, max=593, avg=443.13, stdev=171.32 lat (msec): min=224, max=593, avg=443.13, stdev=171.32 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1656, max= 4087, per=100.00%, avg=2419.50, stdev=1121.50, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=765KiB/s (783kB/s)(6144KiB/8031msec); 0 zone resets clat (msec): min=224, max=2186, avg=875.20, stdev=725.11 lat (msec): min=227, max=2186, avg=875.78, stdev=724.62 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 760], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1841, max= 2605, per=73.72%, avg=2087.80, stdev=302.25, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 250=25.00%, 500=16.67%, 750=33.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.15%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143806: Sun Aug 9 18:22:58 2026 read: IOPS=0, BW=611KiB/s (625kB/s)(5120KiB/8384msec) clat (msec): min=150, max=1261, avg=505.68, stdev=442.28 lat (msec): min=150, max=1261, avg=505.68, stdev=442.28 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 3984, max= 4071, per=100.00%, avg=4027.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=855KiB/s (875kB/s)(7168KiB/8384msec); 0 zone resets clat (msec): min=284, max=2300, avg=811.97, stdev=725.74 lat (msec): min=285, max=2300, avg=812.05, stdev=725.72 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 372], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 506], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 1234], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1889, max= 2048, per=70.48%, avg=1995.86, stdev=67.15, samples=7 iops : min= 1, max= 2, avg= 1.14, stdev= 0.38, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.05%, sys=1.37%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2023KiB/s (2072kB/s), 202KiB/s-765KiB/s (207kB/s-783kB/s), io=20.0MiB (20.0MB), run=8031-10123msec WRITE: bw=2832KiB/s (2900kB/s), 534KiB/s-1012KiB/s (547kB/s-1036kB/s), io=28.0MiB (29.4MB), run=8031-10123msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143818: Sun Aug 9 18:23:11 2026 read: IOPS=0, BW=3054KiB/s (3127kB/s)(12.0MiB/4024msec) clat (msec): min=1033, max=1597, avg=1340.81, stdev=285.75 lat (msec): min=1033, max=1597, avg=1340.81, stdev=285.75 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7742, max= 8126, per=100.00%, avg=7934.00, stdev=271.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.24%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143819: Sun Aug 9 18:23:11 2026 read: IOPS=0, BW=1005KiB/s (1029kB/s)(4096KiB/4075msec) clat (nsec): min=1641.1M, max=1641.1M, avg=1641095493.00, stdev= 0.00 lat (nsec): min=1641.1M, max=1641.1M, avg=1641097736.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1636], 5.00th=[ 1636], 10.00th=[ 1636], 20.00th=[ 1636], | 30.00th=[ 1636], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2010KiB/s (2059kB/s)(8192KiB/4075msec); 0 zone resets clat (msec): min=902, max=1527, avg=1215.40, stdev=441.80 lat (msec): min=903, max=1528, avg=1215.77, stdev=441.73 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.01%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143820: Sun Aug 9 18:23:11 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=429, max=791, avg=628.06, stdev=183.76 lat (msec): min=429, max=791, avg=628.49, stdev=183.80 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.22%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143821: Sun Aug 9 18:23:11 2026 write: IOPS=0, BW=2844KiB/s (2913kB/s)(12.0MiB/4320msec); 0 zone resets clat (msec): min=669, max=2669, avg=1429.85, stdev=1082.73 lat (msec): min=671, max=2696, avg=1439.50, stdev=1097.18 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 5468, max= 8110, per=89.51%, avg=6789.00, stdev=1868.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.13%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4021KiB/s (4117kB/s), 1005KiB/s-3054KiB/s (1029kB/s-3127kB/s), io=16.0MiB (16.8MB), run=4024-4075msec WRITE: bw=7585KiB/s (7767kB/s), 2010KiB/s-6015KiB/s (2059kB/s-6159kB/s), io=32.0MiB (33.6MB), run=2043-4320msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143823: Sun Aug 9 18:23:14 2026 read: IOPS=0, BW=2398KiB/s (2455kB/s)(12.0MiB/5125msec) clat (msec): min=1408, max=2015, avg=1708.00, stdev=303.84 lat (msec): min=1408, max=2015, avg=1708.00, stdev=303.84 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.05%, ctx=218, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143824: Sun Aug 9 18:23:14 2026 read: IOPS=0, BW=971KiB/s (994kB/s)(4096KiB/4219msec) clat (nsec): min=1945.1M, max=1945.1M, avg=1945077080.00, stdev= 0.00 lat (nsec): min=1945.1M, max=1945.1M, avg=1945078257.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1938], 5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938], | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1942KiB/s (1988kB/s)(8192KiB/4219msec); 0 zone resets clat (msec): min=814, max=1457, avg=1135.95, stdev=455.25 lat (msec): min=814, max=1458, avg=1136.34, stdev=455.22 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.21%, sys=6.31%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143825: Sun Aug 9 18:23:14 2026 write: IOPS=0, BW=2093KiB/s (2143kB/s)(12.0MiB/5872msec); 0 zone resets clat (msec): min=580, max=2808, avg=1956.59, stdev=1202.74 lat (msec): min=581, max=2808, avg=1956.84, stdev=1202.70 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 2467], 50.00th=[ 2467], 60.00th=[ 2467], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 7557, max= 8126, per=100.00%, avg=7841.50, stdev=402.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.50%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143826: Sun Aug 9 18:23:14 2026 write: IOPS=0, BW=3051KiB/s (3125kB/s)(12.0MiB/4027msec); 0 zone resets clat (msec): min=716, max=2007, avg=1341.67, stdev=646.30 lat (msec): min=717, max=2008, avg=1342.07, stdev=646.43 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.49%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3197KiB/s (3274kB/s), 971KiB/s-2398KiB/s (994kB/s-2455kB/s), io=16.0MiB (16.8MB), run=4219-5125msec WRITE: bw=5580KiB/s (5714kB/s), 1942KiB/s-3051KiB/s (1988kB/s-3125kB/s), io=32.0MiB (33.6MB), run=4027-5872msec