== sanity test 398b: DIO and buffer IO race ============== 14:31:25 (1787855485) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.8083 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179379: Thu Aug 27 14:33:36 2026 read: IOPS=13, BW=53.2KiB/s (54.5kB/s)(5992KiB/112606msec) clat (usec): min=43, max=443208, avg=41651.77, stdev=29251.27 lat (usec): min=43, max=443209, avg=41656.43, stdev=29254.54 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11076], 10.00th=[ 16450], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[168821], 99.90th=[233833], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 15, max= 112, per=24.84%, avg=52.65, stdev=18.60, samples=222 iops : min= 3, max= 28, avg=12.51, stdev= 4.68, samples=222 write: IOPS=13, BW=55.9KiB/s (57.3kB/s)(6296KiB/112606msec); 0 zone resets clat (usec): min=938, max=292820, avg=31793.79, stdev=31956.14 lat (usec): min=939, max=292822, avg=31796.01, stdev=31956.47 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1418], 10.00th=[ 2089], 20.00th=[ 4490], | 30.00th=[ 8225], 40.00th=[ 16057], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[130548], 99.50th=[143655], 99.90th=[267387], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 135, per=25.05%, avg=55.61, stdev=21.49, samples=221 iops : min= 1, max= 33, avg=13.26, stdev= 5.38, samples=221 lat (usec) : 50=0.10%, 100=1.33%, 250=0.26%, 500=0.07%, 1000=0.07% lat (msec) : 2=4.69%, 4=4.46%, 10=8.01%, 20=12.83%, 50=42.74% lat (msec) : 100=21.81%, 250=3.55%, 500=0.10% cpu : usr=0.09%, sys=6.07%, ctx=6750, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179380: Thu Aug 27 14:33:36 2026 read: IOPS=13, BW=52.8KiB/s (54.1kB/s)(5940KiB/112397msec) clat (usec): min=38, max=745523, avg=41630.65, stdev=31702.96 lat (usec): min=38, max=745524, avg=41632.96, stdev=31703.69 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11600], 10.00th=[ 16319], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[149947], 99.90th=[229639], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 127, per=24.80%, avg=52.58, stdev=18.59, samples=221 iops : min= 1, max= 31, avg=12.50, stdev= 4.65, samples=221 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6348KiB/112397msec); 0 zone resets clat (usec): min=987, max=174857, avg=31777.36, stdev=30255.41 lat (usec): min=989, max=174859, avg=31779.81, stdev=30255.63 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1450], 10.00th=[ 2180], 20.00th=[ 4490], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 24511], 60.00th=[ 31589], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[130548], 99.50th=[141558], 99.90th=[164627], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 7, max= 151, per=25.26%, avg=56.09, stdev=23.86, samples=221 iops : min= 1, max= 37, avg=13.38, stdev= 6.00, samples=221 lat (usec) : 50=0.13%, 100=1.33%, 250=0.26%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.62%, 4=4.85%, 10=7.68%, 20=12.63%, 50=42.19% lat (msec) : 100=22.62%, 250=3.58%, 750=0.03% cpu : usr=0.09%, sys=6.08%, ctx=6916, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179381: Thu Aug 27 14:33:36 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6028KiB/112901msec) clat (usec): min=36, max=290084, avg=40391.65, stdev=24290.05 lat (usec): min=36, max=290085, avg=40393.41, stdev=24289.84 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11469], 10.00th=[ 16581], 20.00th=[ 21627], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 82314], | 99.00th=[114820], 99.50th=[124257], 99.90th=[175113], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=53.12, stdev=19.30, samples=222 iops : min= 1, max= 25, avg=12.64, stdev= 4.87, samples=222 write: IOPS=13, BW=55.4KiB/s (56.8kB/s)(6260KiB/112901msec); 0 zone resets clat (usec): min=1084, max=798922, avg=33135.76, stdev=36695.90 lat (usec): min=1085, max=798924, avg=33140.23, stdev=36694.67 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1467], 10.00th=[ 2311], 20.00th=[ 4228], | 30.00th=[ 8160], 40.00th=[ 17695], 50.00th=[ 25560], 60.00th=[ 33162], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[127402], 99.50th=[162530], 99.90th=[210764], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 15, max= 126, per=24.96%, avg=55.40, stdev=21.63, samples=221 iops : min= 3, max= 31, avg=13.20, stdev= 5.43, samples=221 lat (usec) : 50=0.13%, 100=1.53%, 250=0.20%, 500=0.07% lat (msec) : 2=4.43%, 4=5.18%, 10=7.10%, 20=11.00%, 50=44.34% lat (msec) : 100=23.05%, 250=2.93%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=6.05%, ctx=6994, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179382: Thu Aug 27 14:33:36 2026 read: IOPS=13, BW=54.8KiB/s (56.2kB/s)(6052KiB/110347msec) clat (usec): min=47, max=239477, avg=40210.99, stdev=26140.66 lat (usec): min=47, max=239478, avg=40215.36, stdev=26138.66 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11207], 10.00th=[ 15664], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[149947], 99.50th=[173016], 99.90th=[210764], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 103, per=25.71%, avg=54.51, stdev=18.83, samples=217 iops : min= 1, max= 25, avg=12.99, stdev= 4.74, samples=217 write: IOPS=14, BW=56.5KiB/s (57.9kB/s)(6236KiB/110347msec); 0 zone resets clat (usec): min=1034, max=825632, avg=31640.40, stdev=36814.45 lat (usec): min=1036, max=825633, avg=31642.07, stdev=36814.42 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 2147], 20.00th=[ 4228], | 30.00th=[ 7767], 40.00th=[ 15926], 50.00th=[ 23462], 60.00th=[ 31065], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 70779], 95.00th=[ 94897], | 99.00th=[129500], 99.50th=[139461], 99.90th=[274727], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 126, per=25.29%, avg=56.14, stdev=22.27, samples=217 iops : min= 1, max= 31, avg=13.40, stdev= 5.61, samples=217 lat (usec) : 50=0.03%, 100=1.40%, 250=0.36%, 1000=0.03% lat (msec) : 2=4.79%, 4=4.92%, 10=7.81%, 20=12.66%, 50=43.42% lat (msec) : 100=21.03%, 250=3.48%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=6.07%, ctx=6832, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=213KiB/s (218kB/s), 52.8KiB/s-54.8KiB/s (54.1kB/s-56.2kB/s), io=23.4MiB (24.6MB), run=110347-112901msec WRITE: bw=223KiB/s (228kB/s), 55.4KiB/s-56.5KiB/s (56.8kB/s-57.9kB/s), io=24.6MiB (25.7MB), run=110347-112901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179374: Thu Aug 27 14:34:10 2026 read: IOPS=10, BW=40.5KiB/s (41.5kB/s)(5992KiB/147852msec) clat (msec): min=5, max=659, avg=38.76, stdev=36.44 lat (msec): min=5, max=659, avg=38.76, stdev=36.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 292], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 127, per=25.01%, avg=40.52, stdev=26.25, samples=289 iops : min= 1, max= 31, avg= 9.47, stdev= 6.57, samples=289 write: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6296KiB/147852msec); 0 zone resets clat (msec): min=11, max=324, avg=56.81, stdev=39.47 lat (msec): min=11, max=324, avg=56.81, stdev=39.47 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 184], 99.50th=[ 203], 99.90th=[ 300], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 119, per=24.88%, avg=42.29, stdev=24.74, samples=291 iops : min= 1, max= 29, avg= 9.91, stdev= 6.19, samples=291 lat (msec) : 10=2.31%, 20=16.63%, 50=48.27%, 100=23.21%, 250=9.34% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=2.13%, ctx=4871, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179375: Thu Aug 27 14:34:10 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5940KiB/147189msec) clat (msec): min=5, max=966, avg=38.74, stdev=41.99 lat (msec): min=5, max=966, avg=38.75, stdev=41.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 309], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 135, per=25.09%, avg=40.65, stdev=26.95, samples=285 iops : min= 1, max= 33, avg= 9.50, stdev= 6.75, samples=285 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6348KiB/147189msec); 0 zone resets clat (msec): min=10, max=296, avg=56.25, stdev=37.25 lat (msec): min=10, max=296, avg=56.25, stdev=37.25 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 106], 95.00th=[ 128], | 99.00th=[ 182], 99.50th=[ 224], 99.90th=[ 292], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 125, per=25.22%, avg=42.88, stdev=24.94, samples=288 iops : min= 1, max= 31, avg=10.06, stdev= 6.23, samples=288 lat (msec) : 10=2.31%, 20=18.00%, 50=47.07%, 100=22.79%, 250=9.54% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=2.19%, ctx=4875, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179376: Thu Aug 27 14:34:10 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6028KiB/147573msec) clat (msec): min=5, max=292, avg=38.70, stdev=33.34 lat (msec): min=5, max=292, avg=38.71, stdev=33.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 279], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 151, per=25.17%, avg=40.77, stdev=24.96, samples=288 iops : min= 1, max= 37, avg= 9.53, stdev= 6.24, samples=288 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6260KiB/147573msec); 0 zone resets clat (msec): min=10, max=998, avg=56.79, stdev=45.59 lat (msec): min=10, max=998, avg=56.80, stdev=45.59 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 133], | 99.00th=[ 192], 99.50th=[ 230], 99.90th=[ 321], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 125, per=24.92%, avg=42.36, stdev=24.85, samples=288 iops : min= 1, max= 31, avg= 9.93, stdev= 6.23, samples=288 lat (msec) : 10=2.15%, 20=17.51%, 50=47.40%, 100=23.40%, 250=9.24% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=2.18%, ctx=4920, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179377: Thu Aug 27 14:34:10 2026 read: IOPS=10, BW=40.0KiB/s (41.9kB/s)(6052KiB/147752msec) clat (msec): min=5, max=306, avg=39.16, stdev=33.91 lat (msec): min=5, max=306, avg=39.16, stdev=33.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 157], 99.50th=[ 174], 99.90th=[ 232], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 135, per=25.66%, avg=41.56, stdev=27.14, samples=283 iops : min= 1, max= 33, avg= 9.73, stdev= 6.80, samples=283 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6236KiB/147752msec); 0 zone resets clat (msec): min=10, max=987, avg=56.53, stdev=46.36 lat (msec): min=10, max=987, avg=56.53, stdev=46.36 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 133], | 99.00th=[ 199], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 127, per=24.74%, avg=42.05, stdev=25.53, samples=288 iops : min= 1, max= 31, avg= 9.85, stdev= 6.39, samples=288 lat (msec) : 10=2.70%, 20=18.36%, 50=46.45%, 100=22.43%, 250=9.83% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=2.14%, ctx=4939, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (166kB/s), 40.4KiB/s-40.0KiB/s (41.3kB/s-41.9kB/s), io=23.4MiB (24.6MB), run=147189-147852msec WRITE: bw=170KiB/s (174kB/s), 42.2KiB/s-43.1KiB/s (43.2kB/s-44.2kB/s), io=24.6MiB (25.7MB), run=147189-147852msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179427: Thu Aug 27 14:34:47 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5920KiB/26895msec) clat (usec): min=40, max=142084, avg=37874.90, stdev=23911.83 lat (usec): min=40, max=142086, avg=37876.14, stdev=23911.70 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 161], 20.00th=[ 20579], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 45351], 80.00th=[ 55837], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[114820], 99.50th=[128451], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 571, per=24.88%, avg=220.15, stdev=77.13, samples=53 iops : min= 5, max= 35, avg=12.98, stdev= 4.85, samples=53 write: IOPS=14, BW=237KiB/s (242kB/s)(6368KiB/26895msec); 0 zone resets clat (usec): min=1635, max=216567, avg=32306.58, stdev=28944.36 lat (usec): min=1637, max=216569, avg=32308.53, stdev=28944.35 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2540], 10.00th=[ 3818], 20.00th=[ 7046], | 30.00th=[ 11731], 40.00th=[ 19006], 50.00th=[ 24773], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 55837], 90.00th=[ 69731], 95.00th=[ 81265], | 99.00th=[143655], 99.50th=[158335], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 94, max= 475, per=25.40%, avg=236.74, stdev=83.15, samples=53 iops : min= 5, max= 29, avg=14.02, stdev= 5.21, samples=53 lat (usec) : 50=0.39%, 100=3.52%, 250=0.91% lat (msec) : 2=0.78%, 4=4.69%, 10=8.72%, 20=11.85%, 50=44.66% lat (msec) : 100=22.40%, 250=2.08% cpu : usr=0.10%, sys=7.98%, ctx=1879, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179428: Thu Aug 27 14:34:47 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(5744KiB/26746msec) clat (usec): min=43, max=188746, avg=39555.37, stdev=24888.40 lat (usec): min=43, max=188747, avg=39556.47, stdev=24888.42 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 74], 10.00th=[ 11207], 20.00th=[ 22414], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[117965], 99.50th=[135267], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 50, max= 383, per=24.07%, avg=213.02, stdev=79.91, samples=52 iops : min= 3, max= 23, avg=12.54, stdev= 4.98, samples=52 write: IOPS=15, BW=245KiB/s (251kB/s)(6544KiB/26746msec); 0 zone resets clat (usec): min=1489, max=196986, avg=30595.00, stdev=29976.29 lat (usec): min=1491, max=196988, avg=30597.49, stdev=29976.64 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2343], 10.00th=[ 3523], 20.00th=[ 6063], | 30.00th=[ 9896], 40.00th=[ 16057], 50.00th=[ 22152], 60.00th=[ 28967], | 70.00th=[ 34866], 80.00th=[ 49546], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[130548], 99.50th=[141558], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 95, max= 480, per=25.84%, avg=240.81, stdev=85.45, samples=52 iops : min= 5, max= 30, avg=14.27, stdev= 5.48, samples=52 lat (usec) : 50=0.26%, 100=2.73%, 250=1.04%, 1000=0.26% lat (msec) : 2=1.82%, 4=4.69%, 10=9.77%, 20=10.55%, 50=46.74% lat (msec) : 100=19.01%, 250=3.12% cpu : usr=0.08%, sys=8.03%, ctx=1837, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179429: Thu Aug 27 14:34:47 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27037msec) clat (usec): min=22, max=123192, avg=38432.12, stdev=21942.65 lat (usec): min=22, max=123193, avg=38433.45, stdev=21942.59 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 70], 10.00th=[ 2769], 20.00th=[ 21627], | 30.00th=[ 27919], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 47449], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 74974], | 99.00th=[101188], 99.50th=[104334], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 94, max= 415, per=26.21%, avg=231.96, stdev=75.13, samples=53 iops : min= 5, max= 25, avg=13.72, stdev= 4.72, samples=53 write: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27037msec); 0 zone resets clat (usec): min=1455, max=128744, avg=31769.69, stdev=28532.72 lat (usec): min=1456, max=128746, avg=31774.17, stdev=28530.90 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2638], 10.00th=[ 3425], 20.00th=[ 6259], | 30.00th=[ 10945], 40.00th=[ 18744], 50.00th=[ 24249], 60.00th=[ 29230], | 70.00th=[ 38011], 80.00th=[ 54264], 90.00th=[ 71828], 95.00th=[ 95945], | 99.00th=[122160], 99.50th=[126354], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 95, max= 414, per=23.51%, avg=219.09, stdev=75.96, samples=53 iops : min= 5, max= 25, avg=12.91, stdev= 4.74, samples=53 lat (usec) : 50=0.52%, 100=3.12%, 250=0.78%, 500=0.39%, 750=0.13% lat (msec) : 2=1.04%, 4=4.82%, 10=7.81%, 20=11.46%, 50=44.92% lat (msec) : 100=22.40%, 250=2.60% cpu : usr=0.05%, sys=8.09%, ctx=1930, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179430: Thu Aug 27 14:34:47 2026 read: IOPS=14, BW=235KiB/s (240kB/s)(6032KiB/25709msec) clat (usec): min=49, max=179571, avg=35710.02, stdev=24022.97 lat (usec): min=50, max=179572, avg=35711.19, stdev=24022.89 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 110], 20.00th=[ 19268], | 30.00th=[ 23725], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 50594], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[124257], 99.50th=[130548], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 413, per=26.35%, avg=233.22, stdev=63.65, samples=50 iops : min= 3, max= 25, avg=13.80, stdev= 4.03, samples=50 write: IOPS=15, BW=243KiB/s (249kB/s)(6256KiB/25709msec); 0 zone resets clat (usec): min=1612, max=153556, avg=31232.98, stdev=27854.24 lat (usec): min=1614, max=153558, avg=31239.29, stdev=27860.75 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2900], 10.00th=[ 3884], 20.00th=[ 6587], | 30.00th=[ 10945], 40.00th=[ 17695], 50.00th=[ 25035], 60.00th=[ 31589], | 70.00th=[ 40633], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[129500], 99.50th=[149947], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 94, max= 414, per=26.19%, avg=244.06, stdev=75.15, samples=50 iops : min= 5, max= 25, avg=14.48, stdev= 4.71, samples=50 lat (usec) : 50=0.13%, 100=4.17%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.91%, 4=4.43%, 10=9.51%, 20=13.41%, 50=45.70% lat (msec) : 100=18.10%, 250=2.60% cpu : usr=0.10%, sys=8.23%, ctx=1828, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=886KiB/s (907kB/s), 215KiB/s-235KiB/s (220kB/s-240kB/s), io=23.4MiB (24.5MB), run=25709-27037msec WRITE: bw=932KiB/s (954kB/s), 223KiB/s-245KiB/s (228kB/s-251kB/s), io=24.6MiB (25.8MB), run=25709-27037msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179421: Thu Aug 27 14:34:58 2026 read: IOPS=9, BW=158KiB/s (161kB/s)(5920KiB/37555msec) clat (msec): min=8, max=240, avg=38.82, stdev=30.53 lat (msec): min=8, max=240, avg=38.82, stdev=30.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 78], 95.00th=[ 102], | 99.00th=[ 153], 99.50th=[ 186], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 381, per=25.18%, avg=158.14, stdev=84.83, samples=73 iops : min= 1, max= 23, avg= 9.11, stdev= 5.30, samples=73 write: IOPS=10, BW=170KiB/s (174kB/s)(6368KiB/37555msec); 0 zone resets clat (msec): min=12, max=199, avg=57.96, stdev=31.35 lat (msec): min=12, max=199, avg=57.97, stdev=31.35 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 66], 80.00th=[ 77], 90.00th=[ 99], 95.00th=[ 125], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 412, per=25.60%, avg=168.99, stdev=73.87, samples=74 iops : min= 1, max= 25, avg= 9.78, stdev= 4.65, samples=74 lat (msec) : 10=0.78%, 20=11.33%, 50=51.69%, 100=28.52%, 250=7.68% cpu : usr=0.08%, sys=2.58%, ctx=1241, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179422: Thu Aug 27 14:34:58 2026 read: IOPS=9, BW=151KiB/s (154kB/s)(5744KiB/38128msec) clat (msec): min=8, max=246, avg=39.12, stdev=31.02 lat (msec): min=8, max=246, avg=39.13, stdev=31.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 182], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 411, per=24.27%, avg=152.42, stdev=84.31, samples=73 iops : min= 1, max= 25, avg= 8.75, stdev= 5.31, samples=73 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/38128msec); 0 zone resets clat (msec): min=15, max=249, avg=58.57, stdev=34.77 lat (msec): min=15, max=249, avg=58.58, stdev=34.78 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 67], 80.00th=[ 81], 90.00th=[ 103], 95.00th=[ 128], | 99.00th=[ 182], 99.50th=[ 211], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 61, max= 445, per=25.63%, avg=169.19, stdev=77.89, samples=75 iops : min= 3, max= 27, avg= 9.80, stdev= 4.87, samples=75 lat (msec) : 10=0.65%, 20=12.24%, 50=51.82%, 100=27.08%, 250=8.20% cpu : usr=0.07%, sys=2.56%, ctx=1184, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179423: Thu Aug 27 14:34:58 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37878msec) clat (msec): min=8, max=240, avg=40.19, stdev=32.72 lat (msec): min=8, max=240, avg=40.19, stdev=32.72 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 92], 95.00th=[ 113], | 99.00th=[ 159], 99.50th=[ 192], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 445, per=26.25%, avg=164.88, stdev=90.55, samples=75 iops : min= 1, max= 27, avg= 9.53, stdev= 5.72, samples=75 write: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37878msec); 0 zone resets clat (msec): min=14, max=210, avg=58.47, stdev=32.14 lat (msec): min=14, max=210, avg=58.47, stdev=32.14 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 83], 90.00th=[ 105], 95.00th=[ 121], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 62, max= 351, per=24.36%, avg=160.76, stdev=69.44, samples=74 iops : min= 3, max= 21, avg= 9.27, stdev= 4.36, samples=74 lat (msec) : 10=0.39%, 20=12.76%, 50=53.26%, 100=23.96%, 250=9.64% cpu : usr=0.05%, sys=2.44%, ctx=1171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179424: Thu Aug 27 14:34:58 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37547msec) clat (msec): min=8, max=146, avg=38.96, stdev=27.62 lat (msec): min=8, max=146, avg=38.96, stdev=27.62 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 102], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 476, per=25.33%, avg=159.09, stdev=86.29, samples=74 iops : min= 1, max= 29, avg= 9.16, stdev= 5.43, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37547msec); 0 zone resets clat (msec): min=16, max=250, avg=58.33, stdev=34.44 lat (msec): min=16, max=250, avg=58.33, stdev=34.44 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 65], 80.00th=[ 78], 90.00th=[ 108], 95.00th=[ 125], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 319, per=25.22%, avg=166.47, stdev=67.02, samples=74 iops : min= 1, max= 19, avg= 9.62, stdev= 4.21, samples=74 lat (msec) : 10=0.78%, 20=10.94%, 50=51.69%, 100=28.13%, 250=8.33% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.50%, ctx=1226, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=628KiB/s (643kB/s), 151KiB/s-165KiB/s (154kB/s-169kB/s), io=23.4MiB (24.5MB), run=37547-38128msec WRITE: bw=661KiB/s (677kB/s), 159KiB/s-172KiB/s (163kB/s-176kB/s), io=24.6MiB (25.8MB), run=37547-38128msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179446: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1865KiB/s (1909kB/s)(7168KiB/3844msec) clat (msec): min=156, max=333, avg=254.11, stdev=54.98 lat (msec): min=156, max=333, avg=254.11, stdev=54.98 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 220], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 262], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1988, max= 4123, per=56.66%, avg=2534.25, stdev=1059.24, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1332KiB/s (1364kB/s)(5120KiB/3844msec); 0 zone resets clat (msec): min=249, max=548, avg=409.76, stdev=117.71 lat (msec): min=249, max=562, avg=412.60, stdev=121.89 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1988, max= 2043, per=32.14%, avg=2012.80, stdev=20.20, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=66.67%, 750=8.33% cpu : usr=0.16%, sys=12.96%, ctx=249, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179447: Thu Aug 27 14:35:15 2026 read: IOPS=0, BW=447KiB/s (458kB/s)(2048KiB/4578msec) clat (msec): min=167, max=198, avg=182.88, stdev=22.33 lat (msec): min=167, max=198, avg=182.88, stdev=22.33 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1841, max= 2039, per=43.37%, avg=1940.00, stdev=140.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2237KiB/s (2290kB/s)(10.0MiB/4578msec); 0 zone resets clat (msec): min=86, max=1100, avg=421.00, stdev=311.67 lat (msec): min=86, max=1100, avg=421.10, stdev=311.71 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 142], | 30.00th=[ 228], 40.00th=[ 251], 50.00th=[ 279], 60.00th=[ 384], | 70.00th=[ 426], 80.00th=[ 550], 90.00th=[ 768], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2007, max= 4047, per=45.02%, avg=2819.20, stdev=1088.77, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.26%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179448: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1370KiB/s (1402kB/s)(6144KiB/4486msec) clat (usec): min=502, max=500184, avg=110347.24, stdev=201149.61 lat (usec): min=503, max=500185, avg=110348.41, stdev=201149.47 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[ 1680], | 70.00th=[158335], 80.00th=[158335], 90.00th=[501220], 95.00th=[501220], | 99.00th=[501220], 99.50th=[501220], 99.90th=[501220], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 1988, max= 6083, per=75.34%, avg=3370.00, stdev=2349.67, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1370KiB/s (1402kB/s)(6144KiB/4486msec); 0 zone resets clat (msec): min=250, max=1289, avg=635.81, stdev=381.03 lat (msec): min=250, max=1289, avg=636.34, stdev=381.01 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 617], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1768, max= 4055, per=39.21%, avg=2455.50, stdev=1071.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=25.00% lat (msec) : 2=8.33%, 250=8.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=9.21%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179449: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1192KiB/s (1220kB/s)(5120KiB/4296msec) clat (usec): min=533, max=332477, avg=78078.78, stdev=144103.76 lat (usec): min=534, max=332478, avg=78079.84, stdev=144103.81 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 1926], 60.00th=[ 1926], | 70.00th=[ 54789], 80.00th=[ 54789], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1669KiB/s (1709kB/s)(7168KiB/4296msec); 0 zone resets clat (msec): min=274, max=952, avg=557.61, stdev=278.22 lat (msec): min=274, max=953, avg=557.69, stdev=278.23 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 296], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 464], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 844], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1882, max= 2039, per=31.86%, avg=1995.00, stdev=58.00, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 100=8.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=9.59%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4474KiB/s (4581kB/s), 447KiB/s-1865KiB/s (458kB/s-1909kB/s), io=20.0MiB (20.0MB), run=3844-4578msec WRITE: bw=6263KiB/s (6413kB/s), 1332KiB/s-2237KiB/s (1364kB/s-2290kB/s), io=28.0MiB (29.4MB), run=3844-4578msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179441: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(7168KiB/4208msec) clat (msec): min=118, max=667, avg=315.55, stdev=222.57 lat (msec): min=118, max=667, avg=315.55, stdev=222.57 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 144], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 165], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 498], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2003, max= 4557, per=85.58%, avg=3543.67, stdev=1356.20, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1217KiB/s (1246kB/s)(5120KiB/4208msec); 0 zone resets clat (msec): min=164, max=596, avg=394.26, stdev=176.13 lat (msec): min=164, max=596, avg=395.44, stdev=177.21 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1841, max= 3543, per=40.29%, avg=2336.00, stdev=807.55, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=25.00% cpu : usr=0.02%, sys=3.68%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179442: Thu Aug 27 14:35:15 2026 read: IOPS=0, BW=414KiB/s (424kB/s)(2048KiB/4945msec) clat (msec): min=98, max=219, avg=158.62, stdev=85.51 lat (msec): min=98, max=219, avg=158.62, stdev=85.51 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1400, max= 1771, per=38.29%, avg=1585.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2071KiB/s (2120kB/s)(10.0MiB/4945msec); 0 zone resets clat (msec): min=121, max=981, avg=456.86, stdev=345.92 lat (msec): min=121, max=981, avg=457.14, stdev=345.76 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 138], | 30.00th=[ 140], 40.00th=[ 228], 50.00th=[ 288], 60.00th=[ 342], | 70.00th=[ 567], 80.00th=[ 785], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1988, max= 4202, per=47.50%, avg=2754.20, stdev=1047.25, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=25.00% cpu : usr=0.02%, sys=4.43%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179443: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1324KiB/s (1356kB/s)(6144KiB/4641msec) clat (msec): min=131, max=974, avg=339.49, stdev=323.75 lat (msec): min=131, max=974, avg=339.49, stdev=323.75 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 251], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2003, max= 3915, per=76.16%, avg=3153.67, stdev=1013.72, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1324KiB/s (1356kB/s)(6144KiB/4641msec); 0 zone resets clat (msec): min=148, max=843, avg=428.66, stdev=295.05 lat (msec): min=151, max=848, avg=430.17, stdev=295.95 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 376], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2027, max= 4524, per=49.36%, avg=2862.00, stdev=1439.34, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.36%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179444: Thu Aug 27 14:35:15 2026 read: IOPS=1, BW=1323KiB/s (1355kB/s)(5120KiB/3869msec) clat (msec): min=90, max=592, avg=294.84, stdev=213.10 lat (msec): min=90, max=592, avg=294.84, stdev=213.10 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1841, max= 5314, per=86.39%, avg=3577.50, stdev=2455.78, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1853KiB/s (1897kB/s)(7168KiB/3869msec); 0 zone resets clat (msec): min=182, max=692, avg=341.55, stdev=202.41 lat (msec): min=183, max=692, avg=341.73, stdev=202.33 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 197], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 232], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 567], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1957, max= 4055, per=45.92%, avg=2662.20, stdev=951.80, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=3.90%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4142KiB/s (4241kB/s), 414KiB/s-1703KiB/s (424kB/s-1744kB/s), io=20.0MiB (20.0MB), run=3869-4945msec WRITE: bw=5798KiB/s (5937kB/s), 1217KiB/s-2071KiB/s (1246kB/s-2120kB/s), io=28.0MiB (29.4MB), run=3869-4945msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179457: Thu Aug 27 14:35:38 2026 read: IOPS=0, BW=1328KiB/s (1360kB/s)(12.0MiB/9251msec) clat (msec): min=1031, max=4091, avg=2996.17, stdev=1705.18 lat (msec): min=1031, max=4091, avg=2996.17, stdev=1705.18 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 3876], 50.00th=[ 3876], 60.00th=[ 3876], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=7.42%, ctx=1233, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179459: Thu Aug 27 14:35:38 2026 read: IOPS=0, BW=422KiB/s (432kB/s)(4096KiB/9698msec) clat (nsec): min=3865.3M, max=3865.3M, avg=3865291809.00, stdev= 0.00 lat (nsec): min=3865.3M, max=3865.3M, avg=3865293117.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3876], 5.00th=[ 3876], 10.00th=[ 3876], 20.00th=[ 3876], | 30.00th=[ 3876], 40.00th=[ 3876], 50.00th=[ 3876], 60.00th=[ 3876], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=845KiB/s (865kB/s)(8192KiB/9698msec); 0 zone resets clat (msec): min=1026, max=4690, avg=2858.57, stdev=2590.75 lat (msec): min=1026, max=4690, avg=2858.80, stdev=2590.64 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 4665], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=540, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179460: Thu Aug 27 14:35:38 2026 write: IOPS=0, BW=1380KiB/s (1413kB/s)(12.0MiB/8902msec); 0 zone resets clat (msec): min=1272, max=4173, avg=2926.60, stdev=1492.63 lat (msec): min=1276, max=4174, avg=2928.52, stdev=1490.77 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 3339], 50.00th=[ 3339], 60.00th=[ 3339], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.12%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179462: Thu Aug 27 14:35:38 2026 write: IOPS=0, BW=1249KiB/s (1279kB/s)(12.0MiB/9839msec); 0 zone resets clat (msec): min=493, max=5070, avg=3220.10, stdev=2411.18 lat (msec): min=493, max=5071, avg=3220.71, stdev=2411.13 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 4111], 50.00th=[ 4111], 60.00th=[ 4111], | 70.00th=[ 5067], 80.00th=[ 5067], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 7937, max= 8175, per=100.00%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.12%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1689KiB/s (1730kB/s), 422KiB/s-1328KiB/s (432kB/s-1360kB/s), io=16.0MiB (16.8MB), run=9251-9698msec WRITE: bw=3330KiB/s (3410kB/s), 845KiB/s-1380KiB/s (865kB/s-1413kB/s), io=32.0MiB (33.6MB), run=8902-9839msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179458: Thu Aug 27 14:35:39 2026 read: IOPS=0, BW=1238KiB/s (1268kB/s)(12.0MiB/9922msec) clat (msec): min=1334, max=4447, avg=3245.25, stdev=1673.09 lat (msec): min=1334, max=4447, avg=3245.25, stdev=1673.09 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 3943], 50.00th=[ 3943], 60.00th=[ 3943], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 7846, max= 8078, per=100.00%, avg=7962.00, stdev=164.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=1.76%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179461: Thu Aug 27 14:35:39 2026 read: IOPS=0, BW=399KiB/s (409kB/s)(4096KiB/10257msec) clat (nsec): min=4631.0M, max=4631.0M, avg=4631993916.00, stdev= 0.00 lat (nsec): min=4631.0M, max=4631.0M, avg=4631995406.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4665], 5.00th=[ 4665], 10.00th=[ 4665], 20.00th=[ 4665], | 30.00th=[ 4665], 40.00th=[ 4665], 50.00th=[ 4665], 60.00th=[ 4665], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=799KiB/s (818kB/s)(8192KiB/10257msec); 0 zone resets clat (msec): min=989, max=4544, avg=2766.68, stdev=2513.63 lat (msec): min=990, max=4545, avg=2767.87, stdev=2513.92 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 4530], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.05%, sys=1.38%, ctx=55, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179463: Thu Aug 27 14:35:39 2026 write: IOPS=0, BW=1210KiB/s (1239kB/s)(12.0MiB/10158msec); 0 zone resets clat (msec): min=332, max=4990, avg=3373.99, stdev=2635.92 lat (msec): min=332, max=4991, avg=3374.36, stdev=2635.83 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 4799], 50.00th=[ 4799], 60.00th=[ 4799], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.18%, ctx=45, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179464: Thu Aug 27 14:35:39 2026 write: IOPS=0, BW=1379KiB/s (1412kB/s)(12.0MiB/8913msec); 0 zone resets clat (msec): min=515, max=4913, avg=2920.50, stdev=2227.85 lat (msec): min=515, max=4913, avg=2920.83, stdev=2227.84 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 3339], 50.00th=[ 3339], 60.00th=[ 3339], | 70.00th=[ 4933], 80.00th=[ 4933], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=1.76%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1597KiB/s (1636kB/s), 399KiB/s-1238KiB/s (409kB/s-1268kB/s), io=16.0MiB (16.8MB), run=9922-10257msec WRITE: bw=3195KiB/s (3271kB/s), 799KiB/s-1379KiB/s (818kB/s-1412kB/s), io=32.0MiB (33.6MB), run=8913-10257msec