== sanity test 398b: DIO and buffer IO race ============== 23:39:29 (1763354369) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.91231 s, 17.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184094: Sun Nov 16 23:40:27 2025 read: IOPS=31, BW=124KiB/s (127kB/s)(5992KiB/48307msec) clat (usec): min=155, max=409550, avg=17493.80, stdev=13596.68 lat (usec): min=155, max=409551, avg=17494.60, stdev=13596.69 clat percentiles (usec): | 1.00th=[ 306], 5.00th=[ 6718], 10.00th=[ 8291], 20.00th=[ 10159], | 30.00th=[ 11863], 40.00th=[ 13829], 50.00th=[ 15795], 60.00th=[ 17957], | 70.00th=[ 20317], 80.00th=[ 23462], 90.00th=[ 28705], 95.00th=[ 33817], | 99.00th=[ 46400], 99.50th=[ 52167], 99.90th=[ 72877], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 55, max= 184, per=24.99%, avg=123.71, stdev=27.13, samples=96 iops : min= 13, max= 46, avg=30.54, stdev= 6.83, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6296KiB/48307msec); 0 zone resets clat (usec): min=706, max=79580, avg=13975.27, stdev=11107.85 lat (usec): min=707, max=79582, avg=13976.27, stdev=11107.91 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2245], 10.00th=[ 2737], 20.00th=[ 3458], | 30.00th=[ 5932], 40.00th=[ 9503], 50.00th=[11731], 60.00th=[14222], | 70.00th=[17433], 80.00th=[22414], 90.00th=[28705], 95.00th=[35914], | 99.00th=[50070], 99.50th=[55313], 99.90th=[64226], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 39, max= 224, per=25.08%, avg=129.94, stdev=34.48, samples=96 iops : min= 9, max= 56, avg=32.09, stdev= 8.70, samples=96 lat (usec) : 250=0.20%, 500=1.14%, 750=0.33%, 1000=0.23% lat (msec) : 2=1.56%, 4=10.51%, 10=16.96%, 20=41.28%, 50=26.95% lat (msec) : 100=0.81%, 500=0.03% cpu : usr=0.12%, sys=23.84%, ctx=8699, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184095: Sun Nov 16 23:40:27 2025 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48115msec) clat (usec): min=131, max=403312, avg=17972.07, stdev=14103.57 lat (usec): min=132, max=403313, avg=17972.83, stdev=14103.61 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 7242], 10.00th=[ 8455], 20.00th=[ 10028], | 30.00th=[ 11863], 40.00th=[ 13698], 50.00th=[ 16057], 60.00th=[ 18220], | 70.00th=[ 20579], 80.00th=[ 23987], 90.00th=[ 29230], 95.00th=[ 33817], | 99.00th=[ 57410], 99.50th=[ 65274], 99.90th=[108528], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 13, max= 176, per=24.85%, avg=123.01, stdev=28.51, samples=95 iops : min= 3, max= 44, avg=30.37, stdev= 7.11, samples=95 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48115msec); 0 zone resets clat (usec): min=752, max=79919, avg=13433.74, stdev=10877.30 lat (usec): min=753, max=79919, avg=13434.66, stdev=10877.30 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2008], 10.00th=[ 2540], 20.00th=[ 3228], | 30.00th=[ 4817], 40.00th=[ 8455], 50.00th=[11207], 60.00th=[13698], | 70.00th=[17695], 80.00th=[21627], 90.00th=[28443], 95.00th=[34341], | 99.00th=[47449], 99.50th=[53740], 99.90th=[66847], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 32, max= 224, per=25.27%, avg=130.87, stdev=34.25, samples=95 iops : min= 8, max= 56, avg=32.34, stdev= 8.59, samples=95 lat (usec) : 250=0.10%, 500=0.81%, 750=0.13%, 1000=0.42% lat (msec) : 2=2.34%, 4=10.77%, 10=18.23%, 20=39.06%, 50=27.15% lat (msec) : 100=0.91%, 250=0.03%, 500=0.03% cpu : usr=0.14%, sys=23.39%, ctx=8854, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184096: Sun Nov 16 23:40:27 2025 read: IOPS=31, BW=126KiB/s (129kB/s)(6028KiB/47911msec) clat (usec): min=164, max=88754, avg=17233.64, stdev=8805.70 lat (usec): min=165, max=88755, avg=17235.33, stdev=8806.01 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 7111], 10.00th=[ 8455], 20.00th=[10159], | 30.00th=[11863], 40.00th=[13435], 50.00th=[15795], 60.00th=[17957], | 70.00th=[20579], 80.00th=[23462], 90.00th=[28443], 95.00th=[33162], | 99.00th=[43779], 99.50th=[49546], 99.90th=[63177], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 26, max= 181, per=25.41%, avg=125.77, stdev=29.89, samples=95 iops : min= 6, max= 45, avg=31.05, stdev= 7.50, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6260KiB/47911msec); 0 zone resets clat (usec): min=734, max=411918, avg=13953.80, stdev=15026.12 lat (usec): min=736, max=411919, avg=13955.13, stdev=15026.27 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2114], 10.00th=[ 2638], 20.00th=[ 3326], | 30.00th=[ 4883], 40.00th=[ 8848], 50.00th=[ 11207], 60.00th=[ 13960], | 70.00th=[ 17433], 80.00th=[ 22414], 90.00th=[ 29230], 95.00th=[ 34866], | 99.00th=[ 47973], 99.50th=[ 59507], 99.90th=[ 76022], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 26, max= 200, per=25.22%, avg=130.65, stdev=30.56, samples=95 iops : min= 6, max= 50, avg=32.27, stdev= 7.67, samples=95 lat (usec) : 250=0.33%, 500=0.98%, 750=0.16%, 1000=0.29% lat (msec) : 2=1.92%, 4=10.42%, 10=17.87%, 20=39.75%, 50=27.64% lat (msec) : 100=0.62%, 500=0.03% cpu : usr=0.14%, sys=23.72%, ctx=8834, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184097: Sun Nov 16 23:40:27 2025 read: IOPS=31, BW=125KiB/s (128kB/s)(6052KiB/48461msec) clat (usec): min=109, max=63925, avg=17073.99, stdev=8795.94 lat (usec): min=110, max=63925, avg=17074.79, stdev=8796.04 clat percentiles (usec): | 1.00th=[ 297], 5.00th=[ 6652], 10.00th=[ 8356], 20.00th=[10159], | 30.00th=[11600], 40.00th=[13435], 50.00th=[15664], 60.00th=[17957], | 70.00th=[20579], 80.00th=[23200], 90.00th=[28443], 95.00th=[32375], | 99.00th=[45351], 99.50th=[49546], 99.90th=[60031], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 13, max= 197, per=25.15%, avg=124.48, stdev=28.27, samples=96 iops : min= 3, max= 49, avg=30.74, stdev= 7.10, samples=96 write: IOPS=32, BW=129KiB/s (132kB/s)(6236KiB/48461msec); 0 zone resets clat (usec): min=785, max=383150, avg=14436.36, stdev=14734.75 lat (usec): min=786, max=383153, avg=14437.44, stdev=14734.72 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2089], 10.00th=[ 2671], 20.00th=[ 3359], | 30.00th=[ 5342], 40.00th=[ 8979], 50.00th=[ 11731], 60.00th=[ 14746], | 70.00th=[ 18482], 80.00th=[ 23200], 90.00th=[ 29754], 95.00th=[ 35914], | 99.00th=[ 49546], 99.50th=[ 55313], 99.90th=[ 81265], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 26, max= 239, per=24.76%, avg=128.28, stdev=31.01, samples=96 iops : min= 6, max= 59, avg=31.69, stdev= 7.79, samples=96 lat (usec) : 250=0.29%, 500=1.01%, 750=0.29%, 1000=0.52% lat (msec) : 2=1.89%, 4=10.16%, 10=17.48%, 20=39.00%, 50=28.68% lat (msec) : 100=0.65%, 500=0.03% cpu : usr=0.13%, sys=23.40%, ctx=8782, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (507kB/s), 123KiB/s-126KiB/s (126kB/s-129kB/s), io=23.4MiB (24.6MB), run=47911-48461msec WRITE: bw=519KiB/s (531kB/s), 129KiB/s-132KiB/s (132kB/s-135kB/s), io=24.6MiB (25.7MB), run=47911-48461msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184089: Sun Nov 16 23:40:38 2025 read: IOPS=25, BW=101KiB/s (103kB/s)(5992KiB/59422msec) clat (msec): min=3, max=419, avg=16.69, stdev=16.39 lat (msec): min=3, max=419, avg=16.70, stdev=16.39 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 66], 99.50th=[ 80], 99.90th=[ 97], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 20, max= 288, per=24.92%, avg=100.42, stdev=53.86, samples=118 iops : min= 5, max= 72, avg=24.78, stdev=13.59, samples=118 write: IOPS=26, BW=106KiB/s (108kB/s)(6296KiB/59422msec); 0 zone resets clat (msec): min=5, max=111, avg=21.75, stdev=13.44 lat (msec): min=5, max=111, avg=21.75, stdev=13.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 47], | 99.00th=[ 67], 99.50th=[ 80], 99.90th=[ 108], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 47, max= 248, per=25.27%, avg=106.64, stdev=50.09, samples=117 iops : min= 11, max= 62, avg=26.33, stdev=12.67, samples=117 lat (msec) : 4=0.23%, 10=24.58%, 20=41.24%, 50=30.47%, 100=3.39% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.12%, sys=10.61%, ctx=5631, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184090: Sun Nov 16 23:40:38 2025 read: IOPS=24, BW=99.9KiB/s (102kB/s)(5940KiB/59484msec) clat (msec): min=3, max=400, avg=16.56, stdev=15.51 lat (msec): min=3, max=400, avg=16.56, stdev=15.51 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 42], | 99.00th=[ 57], 99.50th=[ 61], 99.90th=[ 91], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 6, max= 272, per=24.66%, avg=99.40, stdev=54.54, samples=118 iops : min= 1, max= 68, avg=24.53, stdev=13.75, samples=118 write: IOPS=26, BW=107KiB/s (109kB/s)(6348KiB/59484msec); 0 zone resets clat (msec): min=4, max=104, avg=21.87, stdev=13.94 lat (msec): min=4, max=104, avg=21.87, stdev=13.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 49], | 99.00th=[ 69], 99.50th=[ 81], 99.90th=[ 96], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 13, max= 288, per=25.10%, avg=105.92, stdev=52.84, samples=118 iops : min= 3, max= 72, avg=26.15, stdev=13.36, samples=118 lat (msec) : 4=0.46%, 10=26.24%, 20=39.23%, 50=30.86%, 100=3.16% lat (msec) : 250=0.03%, 500=0.03% cpu : usr=0.12%, sys=10.52%, ctx=5580, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184091: Sun Nov 16 23:40:38 2025 read: IOPS=25, BW=102KiB/s (104kB/s)(6028KiB/59349msec) clat (usec): min=2885, max=91064, avg=16450.14, stdev=12043.56 lat (usec): min=2886, max=91065, avg=16450.94, stdev=12043.56 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 5276], 10.00th=[ 5997], 20.00th=[ 7635], | 30.00th=[ 9503], 40.00th=[10945], 50.00th=[12518], 60.00th=[14615], | 70.00th=[17433], 80.00th=[23462], 90.00th=[33424], 95.00th=[42730], | 99.00th=[58983], 99.50th=[64750], 99.90th=[84411], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 16, max= 288, per=25.41%, avg=102.39, stdev=52.63, samples=117 iops : min= 4, max= 72, avg=25.27, stdev=13.28, samples=117 write: IOPS=26, BW=105KiB/s (108kB/s)(6260KiB/59349msec); 0 zone resets clat (msec): min=4, max=410, avg=21.97, stdev=16.57 lat (msec): min=4, max=410, avg=21.97, stdev=16.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 47], | 99.00th=[ 69], 99.50th=[ 83], 99.90th=[ 113], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 13, max= 248, per=24.95%, avg=105.31, stdev=49.87, samples=118 iops : min= 3, max= 62, avg=26.00, stdev=12.61, samples=118 lat (msec) : 4=0.39%, 10=23.93%, 20=42.22%, 50=30.24%, 100=3.12% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.11%, sys=10.82%, ctx=5647, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184092: Sun Nov 16 23:40:38 2025 read: IOPS=25, BW=102KiB/s (104kB/s)(6052KiB/59379msec) clat (usec): min=3108, max=97698, avg=16308.64, stdev=11908.55 lat (usec): min=3109, max=97698, avg=16309.39, stdev=11908.59 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 5145], 10.00th=[ 5866], 20.00th=[ 7439], | 30.00th=[ 9241], 40.00th=[10814], 50.00th=[12256], 60.00th=[14222], | 70.00th=[17695], 80.00th=[23462], 90.00th=[33817], 95.00th=[41157], | 99.00th=[56361], 99.50th=[65799], 99.90th=[79168], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 23, max= 296, per=25.48%, avg=102.68, stdev=53.20, samples=117 iops : min= 5, max= 74, avg=25.34, stdev=13.44, samples=117 write: IOPS=26, BW=105KiB/s (108kB/s)(6236KiB/59379msec); 0 zone resets clat (msec): min=5, max=401, avg=22.14, stdev=16.76 lat (msec): min=5, max=401, avg=22.14, stdev=16.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 69], 99.50th=[ 82], 99.90th=[ 108], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 20, max= 288, per=24.84%, avg=104.82, stdev=51.84, samples=118 iops : min= 5, max= 72, avg=25.88, stdev=13.09, samples=118 lat (msec) : 4=0.42%, 10=24.12%, 20=41.70%, 50=30.47%, 100=3.16% lat (msec) : 250=0.10%, 500=0.03% cpu : usr=0.12%, sys=10.62%, ctx=5645, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=404KiB/s (413kB/s), 99.9KiB/s-102KiB/s (102kB/s-104kB/s), io=23.4MiB (24.6MB), run=59349-59484msec WRITE: bw=423KiB/s (433kB/s), 105KiB/s-107KiB/s (108kB/s-109kB/s), io=24.6MiB (25.7MB), run=59349-59484msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184123: Sun Nov 16 23:40:58 2025 read: IOPS=28, BW=450KiB/s (460kB/s)(5920KiB/13165msec) clat (usec): min=192, max=56969, avg=17807.55, stdev=9419.46 lat (usec): min=193, max=56970, avg=17808.62, stdev=9419.50 clat percentiles (usec): | 1.00th=[ 243], 5.00th=[ 404], 10.00th=[ 8356], 20.00th=[10945], | 30.00th=[12780], 40.00th=[14615], 50.00th=[16450], 60.00th=[19268], | 70.00th=[21103], 80.00th=[24773], 90.00th=[29230], 95.00th=[33817], | 99.00th=[49546], 99.50th=[52691], 99.90th=[56886], 99.95th=[56886], | 99.99th=[56886] bw ( KiB/s): min= 319, max= 672, per=25.84%, avg=450.73, stdev=102.13, samples=26 iops : min= 19, max= 42, avg=27.77, stdev= 6.46, samples=26 write: IOPS=30, BW=484KiB/s (495kB/s)(6368KiB/13165msec); 0 zone resets clat (usec): min=1387, max=62723, avg=16299.37, stdev=11410.41 lat (usec): min=1388, max=62725, avg=16300.76, stdev=11410.40 clat percentiles (usec): | 1.00th=[ 2180], 5.00th=[ 3818], 10.00th=[ 4555], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[11731], 50.00th=[13829], 60.00th=[15664], | 70.00th=[19268], 80.00th=[25035], 90.00th=[33162], 95.00th=[38536], | 99.00th=[53216], 99.50th=[61604], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 318, max= 672, per=26.36%, avg=483.73, stdev=99.64, samples=26 iops : min= 19, max= 42, avg=29.85, stdev= 6.40, samples=26 lat (usec) : 250=0.52%, 500=2.73%, 750=0.13% lat (msec) : 2=0.52%, 4=2.60%, 10=18.36%, 20=43.36%, 50=30.86% lat (msec) : 100=0.91% cpu : usr=0.10%, sys=26.51%, ctx=2687, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184124: Sun Nov 16 23:40:58 2025 read: IOPS=26, BW=428KiB/s (438kB/s)(5744KiB/13414msec) clat (usec): min=160, max=69848, avg=18953.53, stdev=9798.14 lat (usec): min=161, max=69849, avg=18954.29, stdev=9798.14 clat percentiles (usec): | 1.00th=[ 241], 5.00th=[ 416], 10.00th=[ 9241], 20.00th=[12256], | 30.00th=[14091], 40.00th=[16057], 50.00th=[18220], 60.00th=[20055], | 70.00th=[22414], 80.00th=[25297], 90.00th=[30016], 95.00th=[33817], | 99.00th=[50594], 99.50th=[68682], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 262, max= 608, per=24.66%, avg=430.15, stdev=92.33, samples=26 iops : min= 16, max= 38, avg=26.50, stdev= 5.78, samples=26 write: IOPS=30, BW=488KiB/s (500kB/s)(6544KiB/13414msec); 0 zone resets clat (usec): min=1388, max=66439, avg=15989.85, stdev=11274.89 lat (usec): min=1389, max=66441, avg=15991.59, stdev=11274.79 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 3687], 10.00th=[ 4113], 20.00th=[ 5473], | 30.00th=[ 7898], 40.00th=[10814], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20579], 80.00th=[24773], 90.00th=[31065], 95.00th=[40109], | 99.00th=[46400], 99.50th=[49021], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 349, max= 736, per=26.49%, avg=486.12, stdev=115.62, samples=26 iops : min= 21, max= 46, avg=30.00, stdev= 7.31, samples=26 lat (usec) : 250=0.52%, 500=2.34%, 750=0.13% lat (msec) : 2=0.65%, 4=3.78%, 10=17.32%, 20=39.19%, 50=35.29% lat (msec) : 100=0.78% cpu : usr=0.06%, sys=26.05%, ctx=2691, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184125: Sun Nov 16 23:40:58 2025 read: IOPS=28, BW=456KiB/s (467kB/s)(6256KiB/13729msec) clat (usec): min=129, max=71752, avg=18190.91, stdev=9149.82 lat (usec): min=130, max=71753, avg=18191.86, stdev=9150.00 clat percentiles (usec): | 1.00th=[ 237], 5.00th=[ 1037], 10.00th=[ 9503], 20.00th=[11338], | 30.00th=[13042], 40.00th=[15533], 50.00th=[17171], 60.00th=[19268], | 70.00th=[21627], 80.00th=[23987], 90.00th=[28967], 95.00th=[34866], | 99.00th=[50070], 99.50th=[60031], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 315, max= 608, per=26.24%, avg=457.59, stdev=89.08, samples=27 iops : min= 19, max= 38, avg=28.19, stdev= 5.63, samples=27 write: IOPS=27, BW=439KiB/s (450kB/s)(6032KiB/13729msec); 0 zone resets clat (usec): min=1551, max=70086, avg=17450.95, stdev=12863.99 lat (usec): min=1553, max=70088, avg=17453.56, stdev=12864.17 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2704], 10.00th=[ 3818], 20.00th=[ 5538], | 30.00th=[ 9110], 40.00th=[11863], 50.00th=[14615], 60.00th=[16909], | 70.00th=[21103], 80.00th=[28181], 90.00th=[35390], 95.00th=[44827], | 99.00th=[54264], 99.50th=[58983], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 223, max= 670, per=23.57%, avg=432.48, stdev=122.03, samples=27 iops : min= 13, max= 41, avg=26.63, stdev= 7.53, samples=27 lat (usec) : 250=0.52%, 500=1.56%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.17%, 4=4.56%, 10=13.54%, 20=43.23%, 50=33.20% lat (msec) : 100=1.82% cpu : usr=0.15%, sys=25.09%, ctx=2716, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184126: Sun Nov 16 23:40:58 2025 read: IOPS=29, BW=466KiB/s (477kB/s)(6032KiB/12943msec) clat (usec): min=166, max=57987, avg=17278.07, stdev=9768.82 lat (usec): min=166, max=57988, avg=17278.86, stdev=9768.85 clat percentiles (usec): | 1.00th=[ 289], 5.00th=[ 363], 10.00th=[ 725], 20.00th=[10945], | 30.00th=[12649], 40.00th=[14746], 50.00th=[16909], 60.00th=[18744], | 70.00th=[20841], 80.00th=[23987], 90.00th=[28705], 95.00th=[34866], | 99.00th=[52167], 99.50th=[55837], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 286, max= 638, per=26.65%, avg=464.84, stdev=108.03, samples=25 iops : min= 17, max= 39, avg=28.64, stdev= 6.84, samples=25 write: IOPS=30, BW=483KiB/s (495kB/s)(6256KiB/12943msec); 0 zone resets clat (usec): min=1712, max=65476, avg=16238.05, stdev=11464.61 lat (usec): min=1714, max=65477, avg=16239.77, stdev=11464.60 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 3556], 10.00th=[ 4293], 20.00th=[ 5800], | 30.00th=[ 8586], 40.00th=[10945], 50.00th=[13435], 60.00th=[16909], | 70.00th=[20579], 80.00th=[25035], 90.00th=[32113], 95.00th=[39060], | 99.00th=[53216], 99.50th=[56886], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 351, max= 704, per=26.35%, avg=483.52, stdev=104.76, samples=25 iops : min= 21, max= 44, avg=29.84, stdev= 6.61, samples=25 lat (usec) : 250=0.39%, 500=4.04%, 750=0.52% lat (msec) : 2=0.39%, 4=4.43%, 10=16.28%, 20=42.19%, 50=30.47% lat (msec) : 100=1.30% cpu : usr=0.15%, sys=26.26%, ctx=2610, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1745KiB/s (1786kB/s), 428KiB/s-466KiB/s (438kB/s-477kB/s), io=23.4MiB (24.5MB), run=12943-13729msec WRITE: bw=1836KiB/s (1880kB/s), 439KiB/s-488KiB/s (450kB/s-500kB/s), io=24.6MiB (25.8MB), run=12943-13729msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184118: Sun Nov 16 23:41:00 2025 read: IOPS=23, BW=372KiB/s (381kB/s)(5920KiB/15928msec) clat (usec): min=4519, max=82479, avg=16555.45, stdev=11562.82 lat (usec): min=4520, max=82480, avg=16556.20, stdev=11562.81 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 5669], 10.00th=[ 6259], 20.00th=[ 7701], | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[12649], 60.00th=[14877], | 70.00th=[18482], 80.00th=[23200], 90.00th=[32637], 95.00th=[40633], | 99.00th=[57934], 99.50th=[69731], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 160, max= 768, per=24.10%, avg=359.61, stdev=171.60, samples=31 iops : min= 10, max= 48, avg=22.13, stdev=10.81, samples=31 write: IOPS=24, BW=400KiB/s (409kB/s)(6368KiB/15928msec); 0 zone resets clat (usec): min=7449, max=80527, avg=24511.17, stdev=14737.87 lat (usec): min=7452, max=80529, avg=24512.94, stdev=14737.70 clat percentiles (usec): | 1.00th=[ 7570], 5.00th=[ 9241], 10.00th=[10159], 20.00th=[11469], | 30.00th=[13304], 40.00th=[16319], 50.00th=[19792], 60.00th=[24511], | 70.00th=[30016], 80.00th=[37487], 90.00th=[45876], 95.00th=[55837], | 99.00th=[65274], 99.50th=[67634], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 160, max= 1053, per=25.09%, avg=393.84, stdev=187.76, samples=31 iops : min= 10, max= 65, avg=24.29, stdev=11.78, samples=31 lat (msec) : 10=20.31%, 20=40.62%, 50=34.11%, 100=4.95% cpu : usr=0.09%, sys=10.58%, ctx=1442, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184119: Sun Nov 16 23:41:00 2025 read: IOPS=22, BW=360KiB/s (369kB/s)(5744KiB/15943msec) clat (usec): min=3631, max=79216, avg=18195.38, stdev=13512.74 lat (usec): min=3632, max=79216, avg=18196.12, stdev=13512.72 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5669], 10.00th=[ 6456], 20.00th=[ 7767], | 30.00th=[ 9241], 40.00th=[11076], 50.00th=[13304], 60.00th=[15533], | 70.00th=[19268], 80.00th=[29492], 90.00th=[39584], 95.00th=[47973], | 99.00th=[58983], 99.50th=[63177], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 160, max= 864, per=23.86%, avg=355.97, stdev=157.48, samples=31 iops : min= 10, max= 54, avg=21.90, stdev= 9.94, samples=31 write: IOPS=25, BW=410KiB/s (420kB/s)(6544KiB/15943msec); 0 zone resets clat (usec): min=6606, max=79532, avg=22950.87, stdev=13759.62 lat (usec): min=6607, max=79532, avg=22952.46, stdev=13759.64 clat percentiles (usec): | 1.00th=[ 7439], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[11600], | 30.00th=[13304], 40.00th=[16450], 50.00th=[18220], 60.00th=[22152], | 70.00th=[26346], 80.00th=[32637], 90.00th=[43779], 95.00th=[53216], | 99.00th=[68682], 99.50th=[72877], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 223, max= 1085, per=25.49%, avg=400.16, stdev=206.04, samples=31 iops : min= 13, max= 67, avg=24.68, stdev=12.90, samples=31 lat (msec) : 4=0.26%, 10=20.44%, 20=42.97%, 50=31.64%, 100=4.69% cpu : usr=0.15%, sys=10.49%, ctx=1419, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184120: Sun Nov 16 23:41:00 2025 read: IOPS=24, BW=390KiB/s (399kB/s)(6256KiB/16044msec) clat (usec): min=3511, max=81050, avg=17788.76, stdev=14256.43 lat (usec): min=3512, max=81050, avg=17789.64, stdev=14256.42 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5473], 10.00th=[ 6063], 20.00th=[ 7767], | 30.00th=[ 9110], 40.00th=[10159], 50.00th=[12387], 60.00th=[14615], | 70.00th=[19268], 80.00th=[25560], 90.00th=[39584], 95.00th=[45876], | 99.00th=[71828], 99.50th=[79168], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 190, max= 1184, per=25.69%, avg=383.29, stdev=219.64, samples=31 iops : min= 11, max= 74, avg=23.61, stdev=13.79, samples=31 write: IOPS=23, BW=376KiB/s (385kB/s)(6032KiB/16044msec); 0 zone resets clat (usec): min=6381, max=86562, avg=23914.43, stdev=14936.63 lat (usec): min=6382, max=86564, avg=23916.49, stdev=14936.40 clat percentiles (usec): | 1.00th=[ 7373], 5.00th=[ 8979], 10.00th=[ 9896], 20.00th=[11731], | 30.00th=[13304], 40.00th=[15664], 50.00th=[18482], 60.00th=[23462], | 70.00th=[28443], 80.00th=[35390], 90.00th=[45351], 95.00th=[54264], | 99.00th=[73925], 99.50th=[81265], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 958, per=22.84%, avg=358.58, stdev=174.45, samples=31 iops : min= 9, max= 59, avg=22.06, stdev=10.98, samples=31 lat (msec) : 4=0.26%, 10=25.00%, 20=38.02%, 50=31.64%, 100=5.08% cpu : usr=0.16%, sys=10.39%, ctx=1418, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184121: Sun Nov 16 23:41:00 2025 read: IOPS=23, BW=377KiB/s (386kB/s)(6032KiB/16002msec) clat (usec): min=3694, max=79968, avg=17992.09, stdev=14404.13 lat (usec): min=3694, max=79969, avg=17992.84, stdev=14404.09 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5211], 10.00th=[ 5735], 20.00th=[ 7177], | 30.00th=[ 9110], 40.00th=[10814], 50.00th=[13042], 60.00th=[15664], | 70.00th=[19792], 80.00th=[24773], 90.00th=[39584], 95.00th=[52167], | 99.00th=[68682], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 190, max= 1053, per=24.44%, avg=364.68, stdev=195.85, samples=31 iops : min= 11, max= 65, avg=22.45, stdev=12.26, samples=31 write: IOPS=24, BW=391KiB/s (400kB/s)(6256KiB/16002msec); 0 zone resets clat (usec): min=6079, max=84704, avg=23412.72, stdev=14051.97 lat (usec): min=6081, max=84705, avg=23415.15, stdev=14051.23 clat percentiles (usec): | 1.00th=[ 7504], 5.00th=[ 8848], 10.00th=[ 9896], 20.00th=[11863], | 30.00th=[14222], 40.00th=[16188], 50.00th=[18744], 60.00th=[22938], | 70.00th=[27919], 80.00th=[33817], 90.00th=[41681], 95.00th=[50594], | 99.00th=[78119], 99.50th=[83362], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 191, max= 864, per=24.21%, avg=380.06, stdev=176.41, samples=31 iops : min= 11, max= 54, avg=23.42, stdev=11.12, samples=31 lat (msec) : 4=0.26%, 10=22.14%, 20=39.58%, 50=32.55%, 100=5.47% cpu : usr=0.06%, sys=10.64%, ctx=1423, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1493KiB/s (1529kB/s), 360KiB/s-390KiB/s (369kB/s-399kB/s), io=23.4MiB (24.5MB), run=15928-16044msec WRITE: bw=1571KiB/s (1608kB/s), 376KiB/s-410KiB/s (385kB/s-420kB/s), io=24.6MiB (25.8MB), run=15928-16044msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184135: Sun Nov 16 23:41:10 2025 read: IOPS=2, BW=3002KiB/s (3074kB/s)(7168KiB/2388msec) clat (msec): min=28, max=151, avg=91.52, stdev=51.55 lat (msec): min=28, max=151, avg=91.52, stdev=51.55 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 31], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 87], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 144], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 4063, max= 5965, per=100.00%, avg=5014.00, stdev=1344.92, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2144KiB/s (2196kB/s)(5120KiB/2388msec); 0 zone resets clat (msec): min=53, max=826, avg=345.30, stdev=334.92 lat (msec): min=53, max=826, avg=345.38, stdev=334.94 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2015, max= 2048, per=31.64%, avg=2031.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 50=16.67%, 100=33.33%, 250=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=20.86%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184138: Sun Nov 16 23:41:10 2025 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4465msec) clat (msec): min=277, max=485, avg=381.53, stdev=147.63 lat (msec): min=277, max=485, avg=381.53, stdev=147.63 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 2015, max= 2048, per=44.30%, avg=2031.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2293KiB/s (2348kB/s)(10.0MiB/4465msec); 0 zone resets clat (msec): min=87, max=1534, avg=358.83, stdev=428.29 lat (msec): min=87, max=1534, avg=359.23, stdev=428.09 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 122], | 30.00th=[ 159], 40.00th=[ 197], 50.00th=[ 211], 60.00th=[ 213], | 70.00th=[ 218], 80.00th=[ 418], 90.00th=[ 430], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2043, max= 4096, per=55.67%, avg=3574.50, stdev=1021.12, samples=4 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.02%, sys=16.20%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184140: Sun Nov 16 23:41:10 2025 read: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4136msec) clat (msec): min=58, max=271, avg=142.81, stdev=95.57 lat (msec): min=58, max=271, avg=142.81, stdev=95.57 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 121], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2048, max= 4063, per=66.63%, avg=3055.50, stdev=1424.82, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4136msec); 0 zone resets clat (msec): min=54, max=1668, avg=517.03, stdev=584.48 lat (msec): min=54, max=1668, avg=517.11, stdev=584.49 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 409], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1358, max= 2048, per=29.09%, avg=1868.00, stdev=340.08, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=9.94%, ctx=270, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184141: Sun Nov 16 23:41:10 2025 read: IOPS=1, BW=1160KiB/s (1188kB/s)(5120KiB/4412msec) clat (msec): min=33, max=395, avg=123.67, stdev=152.36 lat (msec): min=33, max=395, avg=123.67, stdev=152.36 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 34], | 30.00th=[ 58], 40.00th=[ 58], 50.00th=[ 64], 60.00th=[ 64], | 70.00th=[ 69], 80.00th=[ 69], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1625KiB/s (1664kB/s)(7168KiB/4412msec); 0 zone resets clat (msec): min=52, max=1893, avg=518.57, stdev=627.90 lat (msec): min=52, max=1893, avg=518.65, stdev=627.91 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 167], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 443], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 456], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 1361, max= 4087, per=36.01%, avg=2312.40, stdev=1034.46, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=33.33%, 2000=8.33% cpu : usr=0.05%, sys=9.70%, ctx=357, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4587KiB/s (4697kB/s), 459KiB/s-3002KiB/s (470kB/s-3074kB/s), io=20.0MiB (20.0MB), run=2388-4465msec WRITE: bw=6422KiB/s (6576kB/s), 1485KiB/s-2293KiB/s (1521kB/s-2348kB/s), io=28.0MiB (29.4MB), run=2388-4465msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184134: Sun Nov 16 23:41:10 2025 read: IOPS=3, BW=3320KiB/s (3400kB/s)(7168KiB/2159msec) clat (usec): min=696, max=187484, avg=98199.58, stdev=71531.09 lat (usec): min=697, max=187485, avg=98200.92, stdev=71531.41 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 824], | 30.00th=[109577], 40.00th=[109577], 50.00th=[112722], 60.00th=[127402], | 70.00th=[127402], 80.00th=[147850], 90.00th=[187696], 95.00th=[187696], | 99.00th=[187696], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 2031, max= 5763, per=62.64%, avg=2969.25, stdev=1862.51, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=2, BW=2371KiB/s (2428kB/s)(5120KiB/2159msec); 0 zone resets clat (msec): min=160, max=423, avg=291.84, stdev=109.42 lat (msec): min=160, max=423, avg=291.90, stdev=109.41 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2031, max= 4096, per=40.99%, avg=2720.67, stdev=1191.08, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=58.33%, 500=25.00% cpu : usr=0.09%, sys=48.10%, ctx=895, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184136: Sun Nov 16 23:41:10 2025 read: IOPS=0, BW=474KiB/s (485kB/s)(2048KiB/4320msec) clat (msec): min=125, max=211, avg=168.38, stdev=61.22 lat (msec): min=125, max=211, avg=168.38, stdev=61.22 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 2027, max= 2048, per=42.99%, avg=2037.50, stdev=14.85, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2370KiB/s (2427kB/s)(10.0MiB/4320msec); 0 zone resets clat (msec): min=107, max=1732, avg=380.95, stdev=483.89 lat (msec): min=107, max=1732, avg=381.01, stdev=483.88 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 150], | 30.00th=[ 161], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 288], | 70.00th=[ 317], 80.00th=[ 342], 90.00th=[ 376], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 2031, max= 6144, per=61.51%, avg=4082.50, stdev=2359.11, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.38, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=32.58%, ctx=340, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184137: Sun Nov 16 23:41:10 2025 read: IOPS=1, BW=1648KiB/s (1688kB/s)(6144KiB/3728msec) clat (usec): min=753, max=283402, avg=135742.02, stdev=114722.71 lat (usec): min=754, max=283403, avg=135742.95, stdev=114722.94 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[141558], 50.00th=[141558], 60.00th=[175113], | 70.00th=[212861], 80.00th=[212861], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2048, max= 8126, per=100.00%, avg=5087.00, stdev=4297.80, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1648KiB/s (1688kB/s)(6144KiB/3728msec); 0 zone resets clat (msec): min=153, max=1660, avg=480.36, stdev=586.95 lat (msec): min=153, max=1660, avg=480.44, stdev=586.95 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 234], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 2031, max= 4031, per=38.21%, avg=2536.25, stdev=996.53, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=16.67% lat (msec) : 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=30.00%, ctx=818, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184139: Sun Nov 16 23:41:10 2025 read: IOPS=1, BW=1380KiB/s (1414kB/s)(5120KiB/3709msec) clat (usec): min=576, max=1509.3k, avg=343506.85, stdev=657736.79 lat (usec): min=577, max=1509.3k, avg=343507.77, stdev=657736.47 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 578], 30.00th=[ 652], 40.00th=[ 652], | 50.00th=[ 1057], 60.00th=[ 1057], 70.00th=[ 206570], | 80.00th=[ 206570], 90.00th=[1501561], 95.00th=[1501561], | 99.00th=[1501561], 99.50th=[1501561], 99.90th=[1501561], | 99.95th=[1501561], 99.99th=[1501561] bw ( KiB/s): min= 4096, max= 4096, per=86.41%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1933KiB/s (1979kB/s)(7168KiB/3709msec); 0 zone resets clat (msec): min=67, max=569, avg=278.34, stdev=196.99 lat (msec): min=67, max=569, avg=278.40, stdev=196.98 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 126], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 161], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 451], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1924, max= 2048, per=30.39%, avg=2017.20, stdev=52.66, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=27.00%, ctx=852, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4741KiB/s (4855kB/s), 474KiB/s-3320KiB/s (485kB/s-3400kB/s), io=20.0MiB (20.0MB), run=2159-4320msec WRITE: bw=6637KiB/s (6796kB/s), 1648KiB/s-2371KiB/s (1688kB/s-2428kB/s), io=28.0MiB (29.4MB), run=2159-4320msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184148: Sun Nov 16 23:41:19 2025 read: IOPS=2, BW=9035KiB/s (9252kB/s)(12.0MiB/1360msec) clat (msec): min=370, max=508, avg=449.53, stdev=71.25 lat (msec): min=370, max=508, avg=449.53, stdev=71.25 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7433, max= 8078, per=78.02%, avg=7755.50, stdev=456.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=51.32%, ctx=2268, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184149: Sun Nov 16 23:41:19 2025 read: IOPS=0, BW=2485KiB/s (2545kB/s)(4096KiB/1648msec) clat (nsec): min=348163k, max=348163k, avg=348162544.00, stdev= 0.00 lat (nsec): min=348165k, max=348165k, avg=348164675.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7433, max= 7433, per=74.77%, avg=7433.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4971KiB/s (5090kB/s)(8192KiB/1648msec); 0 zone resets clat (msec): min=567, max=697, avg=632.72, stdev=91.75 lat (msec): min=568, max=697, avg=633.03, stdev=91.80 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8078, max= 8078, per=48.62%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=18.46%, ctx=1129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184150: Sun Nov 16 23:41:19 2025 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=109, max=1122, avg=648.88, stdev=509.69 lat (msec): min=109, max=1122, avg=649.14, stdev=509.68 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=49.20%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.90%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184151: Sun Nov 16 23:41:19 2025 write: IOPS=2, BW=9431KiB/s (9657kB/s)(12.0MiB/1303msec); 0 zone resets clat (msec): min=290, max=511, avg=420.77, stdev=115.80 lat (msec): min=290, max=512, avg=421.02, stdev=115.88 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7433, max= 8078, per=46.67%, avg=7755.50, stdev=456.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=22.89%, ctx=125, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9942KiB/s (10.2MB/s), 2485KiB/s-9035KiB/s (2545kB/s-9252kB/s), io=16.0MiB (16.8MB), run=1360-1648msec WRITE: bw=16.2MiB/s (17.0MB/s), 4971KiB/s-9431KiB/s (5090kB/s-9657kB/s), io=32.0MiB (33.6MB), run=1303-1972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184153: Sun Nov 16 23:41:19 2025 read: IOPS=2, BW=8192KiB/s (8389kB/s)(12.0MiB/1500msec) clat (msec): min=204, max=763, avg=489.49, stdev=279.60 lat (msec): min=204, max=763, avg=489.49, stdev=279.59 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7173, max= 7173, per=82.32%, avg=7173.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.07%, sys=16.48%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184154: Sun Nov 16 23:41:19 2025 read: IOPS=0, BW=2179KiB/s (2231kB/s)(4096KiB/1880msec) clat (nsec): min=603170k, max=603170k, avg=603170442.00, stdev= 0.00 lat (nsec): min=603172k, max=603172k, avg=603172408.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=94.01%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4357KiB/s (4462kB/s)(8192KiB/1880msec); 0 zone resets clat (msec): min=557, max=661, avg=609.53, stdev=73.20 lat (msec): min=558, max=661, avg=609.80, stdev=73.24 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8143, max= 8143, per=46.72%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=18.36%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184155: Sun Nov 16 23:41:19 2025 write: IOPS=1, BW=7091KiB/s (7261kB/s)(12.0MiB/1733msec); 0 zone resets clat (msec): min=120, max=771, avg=554.60, stdev=375.61 lat (msec): min=121, max=772, avg=554.93, stdev=375.66 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=47.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.59%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184156: Sun Nov 16 23:41:19 2025 write: IOPS=1, BW=7938KiB/s (8128kB/s)(12.0MiB/1548msec); 0 zone resets clat (msec): min=151, max=714, avg=495.86, stdev=302.11 lat (msec): min=151, max=715, avg=496.18, stdev=302.08 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=47.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.06%, sys=15.19%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8715KiB/s (8924kB/s), 2179KiB/s-8192KiB/s (2231kB/s-8389kB/s), io=16.0MiB (16.8MB), run=1500-1880msec WRITE: bw=17.0MiB/s (17.8MB/s), 4357KiB/s-7938KiB/s (4462kB/s-8128kB/s), io=32.0MiB (33.6MB), run=1548-1880msec