== sanity test 398b: DIO and buffer IO race ============== 20:38:58 (1772761138) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.80033 s, 13.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191981: Thu Mar 5 20:40:28 2026 read: IOPS=19, BW=77.2KiB/s (79.0kB/s)(5992KiB/77661msec) clat (usec): min=196, max=1232.0k, avg=28659.23, stdev=34476.54 lat (usec): min=197, max=1232.0k, avg=28661.32, stdev=34476.56 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 10552], 10.00th=[ 12780], | 20.00th=[ 15926], 30.00th=[ 19006], 40.00th=[ 21890], | 50.00th=[ 25822], 60.00th=[ 29492], 70.00th=[ 33162], | 80.00th=[ 38011], 90.00th=[ 46400], 95.00th=[ 53216], | 99.00th=[ 79168], 99.50th=[ 92799], 99.90th=[ 127402], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 143, per=25.06%, avg=76.93, stdev=22.87, samples=153 iops : min= 1, max= 35, avg=18.72, stdev= 5.74, samples=153 write: IOPS=20, BW=81.1KiB/s (83.0kB/s)(6296KiB/77661msec); 0 zone resets clat (usec): min=887, max=131967, avg=21832.31, stdev=18435.90 lat (usec): min=887, max=131968, avg=21834.12, stdev=18435.85 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2606], 10.00th=[ 3425], 20.00th=[ 5080], | 30.00th=[ 8291], 40.00th=[ 13960], 50.00th=[ 17957], 60.00th=[ 21890], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 46400], 95.00th=[ 59507], | 99.00th=[ 86508], 99.50th=[ 93848], 99.90th=[108528], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 7, max= 192, per=25.46%, avg=81.98, stdev=27.93, samples=151 iops : min= 1, max= 48, avg=19.99, stdev= 7.04, samples=151 lat (usec) : 250=0.07%, 500=0.26%, 750=0.42%, 1000=0.39% lat (msec) : 2=1.66%, 4=5.83%, 10=10.55%, 20=25.85%, 50=47.36% lat (msec) : 100=7.23%, 250=0.36%, 2000=0.03% cpu : usr=0.12%, sys=16.48%, ctx=8940, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191984: Thu Mar 5 20:40:28 2026 read: IOPS=19, BW=76.7KiB/s (78.6kB/s)(5940KiB/77409msec) clat (usec): min=174, max=149013, avg=28234.39, stdev=15184.89 lat (usec): min=175, max=149014, avg=28237.03, stdev=15184.75 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 11207], 10.00th=[ 13566], 20.00th=[ 16712], | 30.00th=[ 19792], 40.00th=[ 22676], 50.00th=[ 25560], 60.00th=[ 28967], | 70.00th=[ 32900], 80.00th=[ 38011], 90.00th=[ 45876], 95.00th=[ 53740], | 99.00th=[ 88605], 99.50th=[ 95945], 99.90th=[147850], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 7, max= 143, per=25.19%, avg=77.33, stdev=23.32, samples=152 iops : min= 1, max= 35, avg=18.82, stdev= 5.93, samples=152 write: IOPS=20, BW=82.0KiB/s (83.0kB/s)(6348KiB/77409msec); 0 zone resets clat (usec): min=971, max=1245.2k, avg=22120.64, stdev=35669.29 lat (usec): min=972, max=1245.2k, avg=22122.52, stdev=35669.50 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2442], 10.00th=[ 3359], | 20.00th=[ 4621], 30.00th=[ 7111], 40.00th=[ 12911], | 50.00th=[ 17171], 60.00th=[ 21627], 70.00th=[ 27132], | 80.00th=[ 35390], 90.00th=[ 47449], 95.00th=[ 57410], | 99.00th=[ 76022], 99.50th=[ 84411], 99.90th=[ 133694], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 176, per=25.68%, avg=82.68, stdev=27.76, samples=152 iops : min= 1, max= 44, avg=20.16, stdev= 6.99, samples=152 lat (usec) : 250=0.10%, 500=0.36%, 750=0.29%, 1000=0.13% lat (msec) : 2=1.82%, 4=5.76%, 10=11.20%, 20=24.48%, 50=47.88% lat (msec) : 100=7.71%, 250=0.23%, 2000=0.03% cpu : usr=0.12%, sys=16.47%, ctx=8868, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191986: Thu Mar 5 20:40:28 2026 read: IOPS=19, BW=78.8KiB/s (80.7kB/s)(6028KiB/76464msec) clat (usec): min=169, max=1239.9k, avg=28804.07, stdev=35430.02 lat (usec): min=169, max=1239.9k, avg=28807.57, stdev=35430.53 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 10159], 10.00th=[ 12780], | 20.00th=[ 15795], 30.00th=[ 18482], 40.00th=[ 21890], | 50.00th=[ 25560], 60.00th=[ 28443], 70.00th=[ 32637], | 80.00th=[ 38011], 90.00th=[ 45876], 95.00th=[ 55837], | 99.00th=[ 85459], 99.50th=[ 113771], 99.90th=[ 227541], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 136, per=25.73%, avg=78.99, stdev=23.05, samples=151 iops : min= 1, max= 34, avg=19.24, stdev= 5.80, samples=151 write: IOPS=20, BW=81.9KiB/s (83.8kB/s)(6260KiB/76464msec); 0 zone resets clat (usec): min=972, max=120222, avg=20889.69, stdev=18209.57 lat (usec): min=974, max=120224, avg=20899.27, stdev=18219.99 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2212], 10.00th=[ 3130], 20.00th=[ 4490], | 30.00th=[ 7177], 40.00th=[ 12387], 50.00th=[ 16909], 60.00th=[ 21103], | 70.00th=[ 26084], 80.00th=[ 33817], 90.00th=[ 45876], 95.00th=[ 56886], | 99.00th=[ 82314], 99.50th=[ 92799], 99.90th=[106431], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 7, max= 151, per=25.44%, avg=81.91, stdev=28.48, samples=151 iops : min= 1, max= 37, avg=19.97, stdev= 7.19, samples=151 lat (usec) : 250=0.10%, 500=0.16%, 750=0.72%, 1000=0.20% lat (msec) : 2=1.92%, 4=6.67%, 10=10.84%, 20=25.36%, 50=46.65% lat (msec) : 100=6.93%, 250=0.42%, 2000=0.03% cpu : usr=0.13%, sys=16.51%, ctx=8768, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191988: Thu Mar 5 20:40:28 2026 read: IOPS=19, BW=77.5KiB/s (79.4kB/s)(6052KiB/78048msec) clat (usec): min=164, max=1265.1k, avg=29034.02, stdev=35642.79 lat (usec): min=166, max=1265.1k, avg=29035.62, stdev=35642.74 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 10421], 10.00th=[ 12911], | 20.00th=[ 15795], 30.00th=[ 18744], 40.00th=[ 22152], | 50.00th=[ 25297], 60.00th=[ 29492], 70.00th=[ 33817], | 80.00th=[ 38011], 90.00th=[ 47449], 95.00th=[ 56361], | 99.00th=[ 82314], 99.50th=[ 96994], 99.90th=[ 173016], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 143, per=25.42%, avg=78.03, stdev=22.49, samples=153 iops : min= 1, max= 35, avg=18.99, stdev= 5.69, samples=153 write: IOPS=19, BW=79.9KiB/s (81.8kB/s)(6236KiB/78048msec); 0 zone resets clat (usec): min=928, max=121286, avg=21658.50, stdev=18391.63 lat (usec): min=930, max=121288, avg=21660.31, stdev=18391.53 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2606], 10.00th=[ 3425], 20.00th=[ 5014], | 30.00th=[ 7439], 40.00th=[ 12649], 50.00th=[ 16909], 60.00th=[ 21890], | 70.00th=[ 28181], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 57410], | 99.00th=[ 78119], 99.50th=[ 88605], 99.90th=[101188], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 29, max= 175, per=24.93%, avg=80.26, stdev=25.69, samples=153 iops : min= 7, max= 43, avg=19.56, stdev= 6.49, samples=153 lat (usec) : 250=0.10%, 500=0.52%, 750=0.49%, 1000=0.33% lat (msec) : 2=1.37%, 4=5.79%, 10=11.33%, 20=25.59%, 50=46.03% lat (msec) : 100=8.14%, 250=0.29%, 2000=0.03% cpu : usr=0.12%, sys=16.31%, ctx=8901, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (315kB/s), 76.7KiB/s-78.8KiB/s (78.6kB/s-80.7kB/s), io=23.4MiB (24.6MB), run=76464-78048msec WRITE: bw=322KiB/s (330kB/s), 79.9KiB/s-82.0KiB/s (81.8kB/s-83.0kB/s), io=24.6MiB (25.7MB), run=76464-78048msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191982: Thu Mar 5 20:40:45 2026 read: IOPS=15, BW=63.5KiB/s (65.0kB/s)(5992KiB/94353msec) clat (msec): min=4, max=1269, avg=25.04, stdev=38.39 lat (msec): min=4, max=1269, avg=25.04, stdev=38.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 72], | 99.00th=[ 103], 99.50th=[ 117], 99.90th=[ 130], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 199, per=25.17%, avg=63.67, stdev=43.82, samples=184 iops : min= 1, max= 49, avg=15.34, stdev=11.02, samples=184 write: IOPS=16, BW=66.7KiB/s (68.3kB/s)(6296KiB/94353msec); 0 zone resets clat (msec): min=6, max=228, avg=35.90, stdev=26.00 lat (msec): min=6, max=228, avg=35.91, stdev=26.00 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 69], 95.00th=[ 85], | 99.00th=[ 128], 99.50th=[ 146], 99.90th=[ 205], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 206, per=25.22%, avg=66.84, stdev=44.00, samples=184 iops : min= 1, max= 51, avg=16.14, stdev=11.08, samples=184 lat (msec) : 10=12.08%, 20=35.42%, 50=35.25%, 100=15.30%, 250=1.92% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=8.19%, ctx=6087, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191983: Thu Mar 5 20:40:45 2026 read: IOPS=15, BW=62.8KiB/s (64.3kB/s)(5940KiB/94659msec) clat (msec): min=4, max=1280, avg=25.34, stdev=39.09 lat (msec): min=4, max=1280, avg=25.34, stdev=39.09 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 55], 95.00th=[ 72], | 99.00th=[ 101], 99.50th=[ 118], 99.90th=[ 155], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 231, per=24.84%, avg=62.84, stdev=46.45, samples=186 iops : min= 1, max= 57, avg=15.14, stdev=11.68, samples=186 write: IOPS=16, BW=67.1KiB/s (68.7kB/s)(6348KiB/94659msec); 0 zone resets clat (msec): min=7, max=233, avg=35.72, stdev=25.16 lat (msec): min=7, max=233, avg=35.72, stdev=25.16 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 71], 95.00th=[ 86], | 99.00th=[ 118], 99.50th=[ 133], 99.90th=[ 157], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 8, max= 223, per=25.29%, avg=67.02, stdev=44.39, samples=186 iops : min= 2, max= 55, avg=16.18, stdev=11.16, samples=186 lat (msec) : 10=12.14%, 20=35.74%, 50=34.60%, 100=15.72%, 250=1.76% lat (msec) : 2000=0.03% cpu : usr=0.12%, sys=8.00%, ctx=6105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191985: Thu Mar 5 20:40:45 2026 read: IOPS=16, BW=64.1KiB/s (65.6kB/s)(6028KiB/94062msec) clat (msec): min=4, max=152, avg=24.70, stdev=21.40 lat (msec): min=4, max=152, avg=24.71, stdev=21.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 55], 95.00th=[ 70], | 99.00th=[ 100], 99.50th=[ 123], 99.90th=[ 140], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 8, max= 216, per=25.70%, avg=65.02, stdev=44.17, samples=183 iops : min= 2, max= 54, avg=15.68, stdev=11.13, samples=183 write: IOPS=16, BW=66.6KiB/s (68.1kB/s)(6260KiB/94062msec); 0 zone resets clat (msec): min=7, max=1317, avg=36.10, stdev=40.56 lat (msec): min=7, max=1317, avg=36.10, stdev=40.57 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 82], | 99.00th=[ 118], 99.50th=[ 146], 99.90th=[ 186], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8, max= 199, per=25.17%, avg=66.70, stdev=43.84, samples=185 iops : min= 2, max= 49, avg=16.10, stdev=11.02, samples=185 lat (msec) : 10=12.57%, 20=33.72%, 50=36.26%, 100=15.82%, 250=1.60% lat (msec) : 2000=0.03% cpu : usr=0.11%, sys=8.31%, ctx=5971, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191987: Thu Mar 5 20:40:45 2026 read: IOPS=16, BW=64.5KiB/s (66.1kB/s)(6052KiB/93796msec) clat (msec): min=4, max=134, avg=24.45, stdev=20.35 lat (msec): min=4, max=134, avg=24.45, stdev=20.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 54], 95.00th=[ 69], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 117], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 231, per=25.60%, avg=64.76, stdev=43.14, samples=183 iops : min= 1, max= 57, avg=15.61, stdev=10.86, samples=183 write: IOPS=16, BW=66.5KiB/s (68.1kB/s)(6236KiB/93796msec); 0 zone resets clat (msec): min=7, max=1284, avg=36.23, stdev=39.83 lat (msec): min=7, max=1284, avg=36.23, stdev=39.83 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 81], | 99.00th=[ 124], 99.50th=[ 140], 99.90th=[ 211], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 15, max= 224, per=25.09%, avg=66.49, stdev=42.75, samples=184 iops : min= 3, max= 56, avg=16.05, stdev=10.75, samples=184 lat (msec) : 10=11.56%, 20=34.54%, 50=36.88%, 100=15.36%, 250=1.63% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=8.21%, ctx=6166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=254KiB/s (260kB/s), 62.8KiB/s-64.5KiB/s (64.3kB/s-66.1kB/s), io=23.4MiB (24.6MB), run=93796-94659msec WRITE: bw=266KiB/s (272kB/s), 66.5KiB/s-67.1KiB/s (68.1kB/s-68.7kB/s), io=24.6MiB (25.7MB), run=93796-94659msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192021: Thu Mar 5 20:41:14 2026 read: IOPS=17, BW=280KiB/s (287kB/s)(5920KiB/21114msec) clat (usec): min=264, max=123773, avg=30303.62, stdev=16494.57 lat (usec): min=265, max=123774, avg=30304.65, stdev=16494.58 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 1123], 10.00th=[ 13960], 20.00th=[ 18744], | 30.00th=[ 21627], 40.00th=[ 25035], 50.00th=[ 27919], 60.00th=[ 32113], | 70.00th=[ 36963], 80.00th=[ 41157], 90.00th=[ 50070], 95.00th=[ 58459], | 99.00th=[ 81265], 99.50th=[ 94897], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 159, max= 415, per=25.43%, avg=278.24, stdev=69.28, samples=41 iops : min= 9, max= 25, avg=16.80, stdev= 4.32, samples=41 write: IOPS=18, BW=302KiB/s (309kB/s)(6368KiB/21114msec); 0 zone resets clat (usec): min=1764, max=105750, avg=24780.88, stdev=19983.22 lat (usec): min=1766, max=105752, avg=24787.85, stdev=19987.96 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 54], 95.00th=[ 66], | 99.00th=[ 90], 99.50th=[ 96], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 128, max= 569, per=26.19%, avg=301.49, stdev=91.65, samples=41 iops : min= 8, max= 35, avg=18.27, stdev= 5.73, samples=41 lat (usec) : 500=0.65%, 750=0.78%, 1000=0.65% lat (msec) : 2=1.04%, 4=2.60%, 10=12.11%, 20=20.70%, 50=50.26% lat (msec) : 100=10.94%, 250=0.26% cpu : usr=0.09%, sys=17.86%, ctx=2548, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192022: Thu Mar 5 20:41:14 2026 read: IOPS=16, BW=262KiB/s (269kB/s)(5744KiB/21885msec) clat (usec): min=223, max=108452, avg=30410.21, stdev=17189.58 lat (usec): min=224, max=108452, avg=30411.27, stdev=17189.61 clat percentiles (usec): | 1.00th=[ 255], 5.00th=[ 586], 10.00th=[ 14353], 20.00th=[ 18220], | 30.00th=[ 21890], 40.00th=[ 25297], 50.00th=[ 28181], 60.00th=[ 31327], | 70.00th=[ 36439], 80.00th=[ 41681], 90.00th=[ 49021], 95.00th=[ 61604], | 99.00th=[ 91751], 99.50th=[101188], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 96, max= 416, per=23.92%, avg=261.67, stdev=75.44, samples=43 iops : min= 6, max= 26, avg=15.77, stdev= 4.76, samples=43 write: IOPS=18, BW=299KiB/s (306kB/s)(6544KiB/21885msec); 0 zone resets clat (usec): min=1261, max=117936, avg=26761.65, stdev=21382.78 lat (usec): min=1262, max=117938, avg=26764.60, stdev=21382.43 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 111], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 158, max= 701, per=25.93%, avg=298.47, stdev=104.63, samples=43 iops : min= 9, max= 43, avg=18.07, stdev= 6.58, samples=43 lat (usec) : 250=0.39%, 500=1.30%, 750=0.91%, 1000=0.52% lat (msec) : 2=0.65%, 4=2.08%, 10=10.42%, 20=20.83%, 50=50.78% lat (msec) : 100=11.33%, 250=0.78% cpu : usr=0.09%, sys=18.03%, ctx=2563, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192023: Thu Mar 5 20:41:14 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(6256KiB/21852msec) clat (usec): min=170, max=186146, avg=30973.98, stdev=19598.88 lat (usec): min=171, max=186147, avg=30975.54, stdev=19599.93 clat percentiles (usec): | 1.00th=[ 251], 5.00th=[ 1221], 10.00th=[ 13566], 20.00th=[ 17957], | 30.00th=[ 20841], 40.00th=[ 23987], 50.00th=[ 28181], 60.00th=[ 32375], | 70.00th=[ 35390], 80.00th=[ 41157], 90.00th=[ 50070], 95.00th=[ 67634], | 99.00th=[102237], 99.50th=[141558], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 128, max= 474, per=26.15%, avg=286.09, stdev=81.78, samples=43 iops : min= 8, max= 29, avg=17.30, stdev= 5.05, samples=43 write: IOPS=17, BW=276KiB/s (283kB/s)(6032KiB/21852msec); 0 zone resets clat (usec): min=1262, max=99094, avg=25733.43, stdev=18949.98 lat (usec): min=1263, max=99096, avg=25739.15, stdev=18945.89 clat percentiles (usec): | 1.00th=[ 2409], 5.00th=[ 4080], 10.00th=[ 5604], 20.00th=[ 8717], | 30.00th=[13304], 40.00th=[17171], 50.00th=[20579], 60.00th=[25822], | 70.00th=[33424], 80.00th=[40109], 90.00th=[51643], 95.00th=[66323], | 99.00th=[88605], 99.50th=[93848], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 95, max= 541, per=23.72%, avg=273.00, stdev=91.37, samples=43 iops : min= 5, max= 33, avg=16.47, stdev= 5.78, samples=43 lat (usec) : 250=0.52%, 500=0.91%, 750=0.65%, 1000=0.39% lat (msec) : 2=0.52%, 4=1.95%, 10=8.98%, 20=23.05%, 50=52.21% lat (msec) : 100=10.29%, 250=0.52% cpu : usr=0.12%, sys=17.46%, ctx=2552, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192024: Thu Mar 5 20:41:14 2026 read: IOPS=17, BW=283KiB/s (290kB/s)(6032KiB/21285msec) clat (usec): min=204, max=103124, avg=29590.47, stdev=16871.53 lat (usec): min=204, max=103125, avg=29591.58, stdev=16871.44 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 775], 10.00th=[ 12387], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 24511], 50.00th=[ 28181], 60.00th=[ 31065], | 70.00th=[ 35914], 80.00th=[ 40633], 90.00th=[ 50070], 95.00th=[ 58983], | 99.00th=[ 85459], 99.50th=[ 90702], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 127, max= 480, per=25.91%, avg=283.48, stdev=86.34, samples=42 iops : min= 7, max= 30, avg=17.14, stdev= 5.48, samples=42 write: IOPS=18, BW=294KiB/s (301kB/s)(6256KiB/21285msec); 0 zone resets clat (usec): min=1837, max=90786, avg=25838.73, stdev=19343.94 lat (usec): min=1838, max=90789, avg=25843.85, stdev=19341.81 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4490], 10.00th=[ 5473], 20.00th=[ 7177], | 30.00th=[11469], 40.00th=[16581], 50.00th=[21890], 60.00th=[26346], | 70.00th=[33817], 80.00th=[42206], 90.00th=[53216], 95.00th=[64226], | 99.00th=[83362], 99.50th=[89654], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 128, max= 480, per=25.56%, avg=294.21, stdev=78.09, samples=42 iops : min= 8, max= 30, avg=17.81, stdev= 4.89, samples=42 lat (usec) : 250=0.39%, 500=0.52%, 750=1.17%, 1000=1.30% lat (msec) : 2=0.78%, 4=2.08%, 10=12.37%, 20=18.49%, 50=51.82% lat (msec) : 100=10.94%, 250=0.13% cpu : usr=0.13%, sys=17.76%, ctx=2498, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1094KiB/s (1121kB/s), 262KiB/s-286KiB/s (269kB/s-293kB/s), io=23.4MiB (24.5MB), run=21114-21885msec WRITE: bw=1151KiB/s (1179kB/s), 276KiB/s-302KiB/s (283kB/s-309kB/s), io=24.6MiB (25.8MB), run=21114-21885msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192016: Thu Mar 5 20:41:19 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27065msec) clat (msec): min=5, max=153, avg=29.04, stdev=23.21 lat (msec): min=5, max=153, avg=29.04, stdev=23.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 74], | 99.00th=[ 113], 99.50th=[ 128], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 638, per=24.24%, avg=214.28, stdev=125.15, samples=53 iops : min= 1, max= 39, avg=12.72, stdev= 7.85, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27065msec); 0 zone resets clat (msec): min=12, max=189, avg=40.82, stdev=25.46 lat (msec): min=12, max=189, avg=40.82, stdev=25.46 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 74], 95.00th=[ 90], | 99.00th=[ 131], 99.50th=[ 140], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 63, max= 509, per=24.96%, avg=232.38, stdev=109.42, samples=53 iops : min= 3, max= 31, avg=13.85, stdev= 6.85, samples=53 lat (msec) : 10=4.30%, 20=27.86%, 50=46.88%, 100=18.10%, 250=2.86% cpu : usr=0.10%, sys=7.77%, ctx=1611, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192017: Thu Mar 5 20:41:19 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27044msec) clat (msec): min=6, max=125, avg=29.21, stdev=21.75 lat (msec): min=6, max=125, avg=29.21, stdev=21.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 61], 95.00th=[ 78], | 99.00th=[ 108], 99.50th=[ 110], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 63, max= 509, per=23.76%, avg=210.00, stdev=108.10, samples=53 iops : min= 3, max= 31, avg=12.45, stdev= 6.72, samples=53 write: IOPS=15, BW=242KiB/s (248kB/s)(6544KiB/27044msec); 0 zone resets clat (msec): min=11, max=196, avg=40.31, stdev=24.86 lat (msec): min=11, max=196, avg=40.32, stdev=24.86 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 85], | 99.00th=[ 129], 99.50th=[ 142], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 95, max= 576, per=25.55%, avg=237.87, stdev=113.70, samples=53 iops : min= 5, max= 36, avg=14.19, stdev= 7.11, samples=53 lat (msec) : 10=3.65%, 20=25.78%, 50=50.26%, 100=18.10%, 250=2.21% cpu : usr=0.08%, sys=7.79%, ctx=1584, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192018: Thu Mar 5 20:41:19 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26944msec) clat (msec): min=6, max=117, avg=29.89, stdev=22.10 lat (msec): min=6, max=117, avg=29.89, stdev=22.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 65], 95.00th=[ 80], | 99.00th=[ 109], 99.50th=[ 116], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 63, max= 698, per=26.14%, avg=231.09, stdev=130.81, samples=53 iops : min= 3, max= 43, avg=13.77, stdev= 8.19, samples=53 write: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26944msec); 0 zone resets clat (msec): min=12, max=147, avg=40.37, stdev=24.03 lat (msec): min=12, max=147, avg=40.37, stdev=24.03 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 75], 95.00th=[ 87], | 99.00th=[ 126], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 64, max= 573, per=23.61%, avg=219.83, stdev=112.35, samples=53 iops : min= 4, max= 35, avg=13.06, stdev= 7.07, samples=53 lat (msec) : 10=3.78%, 20=26.95%, 50=47.79%, 100=19.53%, 250=1.95% cpu : usr=0.08%, sys=7.79%, ctx=1603, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192019: Thu Mar 5 20:41:19 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(6032KiB/26739msec) clat (msec): min=6, max=169, avg=28.43, stdev=22.73 lat (msec): min=6, max=169, avg=28.43, stdev=22.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 73], | 99.00th=[ 113], 99.50th=[ 155], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 63, max= 608, per=25.31%, avg=223.77, stdev=118.40, samples=53 iops : min= 3, max= 38, avg=13.30, stdev= 7.47, samples=53 write: IOPS=14, BW=234KiB/s (240kB/s)(6256KiB/26739msec); 0 zone resets clat (msec): min=12, max=154, avg=40.83, stdev=25.03 lat (msec): min=12, max=154, avg=40.83, stdev=25.03 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 73], 95.00th=[ 86], | 99.00th=[ 144], 99.50th=[ 153], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 63, max= 606, per=25.17%, avg=234.38, stdev=115.97, samples=53 iops : min= 3, max= 37, avg=13.96, stdev= 7.24, samples=53 lat (msec) : 10=3.39%, 20=29.30%, 50=45.83%, 100=19.14%, 250=2.34% cpu : usr=0.07%, sys=7.62%, ctx=1531, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=885KiB/s (906kB/s), 212KiB/s-232KiB/s (217kB/s-238kB/s), io=23.4MiB (24.5MB), run=26739-27065msec WRITE: bw=931KiB/s (953kB/s), 224KiB/s-242KiB/s (229kB/s-248kB/s), io=24.6MiB (25.8MB), run=26739-27065msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192036: Thu Mar 5 20:41:30 2026 read: IOPS=2, BW=2122KiB/s (2173kB/s)(7168KiB/3378msec) clat (msec): min=103, max=605, avg=264.33, stdev=167.63 lat (msec): min=103, max=605, avg=264.33, stdev=167.63 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 124], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 264], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 300], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1950, max= 4096, per=69.19%, avg=3030.00, stdev=1212.19, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1516KiB/s (1552kB/s)(5120KiB/3378msec); 0 zone resets clat (msec): min=277, max=338, avg=301.14, stdev=25.41 lat (msec): min=277, max=339, avg=301.24, stdev=25.40 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1950, max= 3908, per=40.42%, avg=2478.00, stdev=954.11, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=16.76%, ctx=156, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192037: Thu Mar 5 20:41:30 2026 read: IOPS=0, BW=441KiB/s (451kB/s)(2048KiB/4645msec) clat (msec): min=93, max=167, avg=130.13, stdev=52.20 lat (msec): min=93, max=167, avg=130.13, stdev=52.19 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 1385, max= 2039, per=39.10%, avg=1712.00, stdev=462.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2205KiB/s (2257kB/s)(10.0MiB/4645msec); 0 zone resets clat (msec): min=153, max=979, avg=435.04, stdev=254.27 lat (msec): min=153, max=979, avg=435.16, stdev=254.24 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 171], | 30.00th=[ 201], 40.00th=[ 368], 50.00th=[ 388], 60.00th=[ 414], | 70.00th=[ 443], 80.00th=[ 575], 90.00th=[ 667], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1957, max= 5919, per=48.96%, avg=3001.67, stdev=1657.46, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.76%, ctx=198, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192038: Thu Mar 5 20:41:30 2026 read: IOPS=1, BW=1314KiB/s (1345kB/s)(6144KiB/4676msec) clat (msec): min=118, max=1004, avg=410.91, stdev=323.28 lat (msec): min=118, max=1004, avg=410.91, stdev=323.28 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 443], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1980, max= 4096, per=77.36%, avg=3387.67, stdev=1219.08, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1314KiB/s (1345kB/s)(6144KiB/4676msec); 0 zone resets clat (msec): min=88, max=536, avg=345.43, stdev=160.42 lat (msec): min=88, max=536, avg=345.53, stdev=160.42 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 342], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1914, max= 3900, per=38.69%, avg=2371.80, stdev=856.23, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.60%, ctx=107, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192039: Thu Mar 5 20:41:30 2026 read: IOPS=1, BW=1234KiB/s (1264kB/s)(5120KiB/4149msec) clat (msec): min=83, max=412, avg=219.94, stdev=136.07 lat (msec): min=83, max=412, avg=219.94, stdev=136.07 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2039, max= 5742, per=88.84%, avg=3890.50, stdev=2618.42, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1728KiB/s (1769kB/s)(7168KiB/4149msec); 0 zone resets clat (msec): min=103, max=765, avg=428.79, stdev=290.61 lat (msec): min=104, max=765, avg=428.96, stdev=290.56 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 131], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 584], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 659], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1389, max= 2019, per=30.40%, avg=1863.60, stdev=266.29, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=9.98%, ctx=103, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4380KiB/s (4485kB/s), 441KiB/s-2122KiB/s (451kB/s-2173kB/s), io=20.0MiB (20.0MB), run=3378-4676msec WRITE: bw=6132KiB/s (6279kB/s), 1314KiB/s-2205KiB/s (1345kB/s-2257kB/s), io=28.0MiB (29.4MB), run=3378-4676msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192040: Thu Mar 5 20:41:30 2026 read: IOPS=1, BW=1806KiB/s (1849kB/s)(7168KiB/3970msec) clat (msec): min=127, max=307, avg=222.74, stdev=61.89 lat (msec): min=127, max=307, avg=222.76, stdev=61.87 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 194], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 205], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1965, max= 4266, per=77.64%, avg=3382.00, stdev=1239.64, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1290KiB/s (1321kB/s)(5120KiB/3970msec); 0 zone resets clat (msec): min=239, max=962, avg=471.04, stdev=287.90 lat (msec): min=239, max=963, avg=471.12, stdev=287.90 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1965, max= 3650, per=39.56%, avg=2412.50, stdev=825.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=40.92%, ctx=507, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192041: Thu Mar 5 20:41:30 2026 read: IOPS=0, BW=436KiB/s (446kB/s)(2048KiB/4701msec) clat (msec): min=158, max=290, avg=224.41, stdev=93.27 lat (msec): min=158, max=290, avg=224.41, stdev=93.27 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1410, max= 1825, per=37.13%, avg=1617.50, stdev=293.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2178KiB/s (2231kB/s)(10.0MiB/4701msec); 0 zone resets clat (msec): min=234, max=645, avg=408.98, stdev=155.84 lat (msec): min=234, max=646, avg=409.12, stdev=155.87 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 262], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 359], 60.00th=[ 384], | 70.00th=[ 447], 80.00th=[ 584], 90.00th=[ 609], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1965, max= 3992, per=43.52%, avg=2654.33, stdev=1006.93, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=58.33%, 750=25.00% cpu : usr=0.00%, sys=36.43%, ctx=379, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192042: Thu Mar 5 20:41:30 2026 read: IOPS=1, BW=1592KiB/s (1630kB/s)(6144KiB/3859msec) clat (usec): min=1727, max=336299, avg=176099.26, stdev=134740.62 lat (usec): min=1727, max=336301, avg=176100.75, stdev=134740.87 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1729], 10.00th=[ 1729], 20.00th=[ 46924], | 30.00th=[ 46924], 40.00th=[177210], 50.00th=[177210], 60.00th=[183501], | 70.00th=[308282], 80.00th=[308282], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1825, max= 4039, per=74.83%, avg=3259.67, stdev=1244.00, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1592KiB/s (1630kB/s)(6144KiB/3859msec); 0 zone resets clat (msec): min=141, max=841, avg=442.97, stdev=271.53 lat (msec): min=141, max=841, avg=443.06, stdev=271.54 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 426], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1957, max= 2817, per=35.41%, avg=2159.40, stdev=369.26, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 2=8.33%, 50=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=33.23%, ctx=341, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192043: Thu Mar 5 20:41:30 2026 read: IOPS=1, BW=1109KiB/s (1136kB/s)(5120KiB/4616msec) clat (usec): min=1426, max=245547, avg=114631.28, stdev=110010.14 lat (usec): min=1428, max=245547, avg=114632.70, stdev=110009.85 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1434], 10.00th=[ 1434], 20.00th=[ 1434], | 30.00th=[ 2343], 40.00th=[ 2343], 50.00th=[135267], 60.00th=[135267], | 70.00th=[187696], 80.00th=[187696], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 3650, max= 3930, per=87.01%, avg=3790.00, stdev=197.99, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1553KiB/s (1590kB/s)(7168KiB/4616msec); 0 zone resets clat (msec): min=180, max=1026, avg=555.97, stdev=253.92 lat (msec): min=181, max=1026, avg=556.10, stdev=253.90 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 447], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 575], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 609], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1452, max= 2019, per=30.46%, avg=1857.60, stdev=239.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=16.67%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=24.51%, ctx=287, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4357KiB/s (4461kB/s), 436KiB/s-1806KiB/s (446kB/s-1849kB/s), io=20.0MiB (20.0MB), run=3859-4701msec WRITE: bw=6099KiB/s (6246kB/s), 1290KiB/s-2178KiB/s (1321kB/s-2231kB/s), io=28.0MiB (29.4MB), run=3859-4701msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192050: Thu Mar 5 20:41:40 2026 read: IOPS=1, BW=6671KiB/s (6831kB/s)(12.0MiB/1842msec) clat (msec): min=545, max=585, avg=561.30, stdev=21.20 lat (msec): min=545, max=585, avg=561.30, stdev=21.21 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=39.92%, ctx=1293, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192051: Thu Mar 5 20:41:40 2026 read: IOPS=0, BW=1986KiB/s (2034kB/s)(4096KiB/2062msec) clat (nsec): min=577029k, max=577029k, avg=577029208.00, stdev= 0.00 lat (nsec): min=577031k, max=577031k, avg=577031477.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3973KiB/s (4068kB/s)(8192KiB/2062msec); 0 zone resets clat (msec): min=425, max=902, avg=663.65, stdev=337.17 lat (msec): min=425, max=902, avg=664.02, stdev=337.39 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8159, max= 8159, per=59.69%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=21.54%, ctx=497, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192052: Thu Mar 5 20:41:40 2026 write: IOPS=1, BW=5126KiB/s (5249kB/s)(12.0MiB/2397msec); 0 zone resets clat (msec): min=685, max=840, avg=745.78, stdev=83.37 lat (msec): min=686, max=841, avg=746.31, stdev=83.23 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8159, max= 8192, per=59.81%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.08%, sys=19.49%, ctx=182, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192053: Thu Mar 5 20:41:40 2026 write: IOPS=1, BW=5985KiB/s (6129kB/s)(12.0MiB/2053msec); 0 zone resets clat (msec): min=181, max=1436, avg=630.87, stdev=699.42 lat (msec): min=181, max=1437, avg=631.39, stdev=699.48 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min=13003, max=13003, per=95.12%, avg=13003.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.13%, ctx=105, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7946KiB/s (8136kB/s), 1986KiB/s-6671KiB/s (2034kB/s-6831kB/s), io=16.0MiB (16.8MB), run=1842-2062msec WRITE: bw=13.3MiB/s (13.0MB/s), 3973KiB/s-5985KiB/s (4068kB/s-6129kB/s), io=32.0MiB (33.6MB), run=2053-2397msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192054: Thu Mar 5 20:41:40 2026 read: IOPS=1, BW=4715KiB/s (4828kB/s)(12.0MiB/2606msec) clat (msec): min=216, max=1448, avg=860.29, stdev=617.93 lat (msec): min=216, max=1448, avg=860.29, stdev=617.94 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8031, max= 8126, per=100.00%, avg=8078.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.64%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192055: Thu Mar 5 20:41:40 2026 read: IOPS=0, BW=1611KiB/s (1650kB/s)(4096KiB/2542msec) clat (nsec): min=1567.7M, max=1567.7M, avg=1567666221.00, stdev= 0.00 lat (nsec): min=1567.7M, max=1567.7M, avg=1567668466.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1569], 5.00th=[ 1569], 10.00th=[ 1569], 20.00th=[ 1569], | 30.00th=[ 1569], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3223KiB/s (3300kB/s)(8192KiB/2542msec); 0 zone resets clat (msec): min=388, max=551, avg=469.82, stdev=115.38 lat (msec): min=389, max=551, avg=470.43, stdev=114.98 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.74%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192056: Thu Mar 5 20:41:40 2026 write: IOPS=1, BW=4945KiB/s (5064kB/s)(12.0MiB/2485msec); 0 zone resets clat (msec): min=247, max=1271, avg=810.07, stdev=519.41 lat (msec): min=248, max=1274, avg=811.05, stdev=520.31 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8126, max= 8126, per=63.04%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.11%, ctx=101, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192057: Thu Mar 5 20:41:40 2026 write: IOPS=1, BW=5699KiB/s (5836kB/s)(12.0MiB/2156msec); 0 zone resets clat (msec): min=354, max=1117, avg=713.05, stdev=383.79 lat (msec): min=355, max=1118, avg=713.57, stdev=383.72 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 6895, max= 8175, per=58.46%, avg=7535.00, stdev=905.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.34%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6287KiB/s (6438kB/s), 1611KiB/s-4715KiB/s (1650kB/s-4828kB/s), io=16.0MiB (16.8MB), run=2542-2606msec WRITE: bw=12.6MiB/s (13.2MB/s), 3223KiB/s-5699KiB/s (3300kB/s-5836kB/s), io=32.0MiB (33.6MB), run=2156-2542msec