== sanity test 398b: DIO and buffer IO race ============== 23:22:29 (1763353349) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.97322 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146829: Sun Nov 16 23:23:33 2025 read: IOPS=27, BW=112KiB/s (114kB/s)(5992KiB/53686msec) clat (usec): min=98, max=738876, avg=18274.69, stdev=22122.81 lat (usec): min=99, max=738876, avg=18275.79, stdev=22122.86 clat percentiles (usec): | 1.00th=[ 255], 5.00th=[ 594], 10.00th=[ 7701], 20.00th=[ 10028], | 30.00th=[ 11469], 40.00th=[ 13304], 50.00th=[ 15270], 60.00th=[ 17695], | 70.00th=[ 21103], 80.00th=[ 24773], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 64226], 99.50th=[ 82314], 99.90th=[119014], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 6, max= 192, per=25.24%, avg=111.30, stdev=28.78, samples=106 iops : min= 1, max= 48, avg=27.50, stdev= 7.18, samples=106 write: IOPS=29, BW=117KiB/s (120kB/s)(6296KiB/53686msec); 0 zone resets clat (usec): min=801, max=109408, avg=16598.64, stdev=14008.38 lat (usec): min=802, max=109410, avg=16600.19, stdev=14008.72 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2057], 10.00th=[ 2671], 20.00th=[ 3818], | 30.00th=[ 6128], 40.00th=[ 10290], 50.00th=[ 13829], 60.00th=[ 17433], | 70.00th=[ 21627], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 60031], 99.50th=[ 81265], 99.90th=[102237], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 39, max= 192, per=25.55%, avg=117.77, stdev=31.31, samples=105 iops : min= 9, max= 48, avg=29.12, stdev= 7.87, samples=105 lat (usec) : 100=0.03%, 250=0.36%, 500=1.66%, 750=0.72%, 1000=0.52% lat (msec) : 2=2.38%, 4=8.69%, 10=15.40%, 20=36.65%, 50=31.32% lat (msec) : 100=2.12%, 250=0.13%, 750=0.03% cpu : usr=0.15%, sys=24.23%, ctx=8223, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146830: Sun Nov 16 23:23:33 2025 read: IOPS=27, BW=110KiB/s (112kB/s)(5940KiB/54095msec) clat (usec): min=109, max=121014, avg=17949.38, stdev=10849.16 lat (usec): min=110, max=121015, avg=17950.74, stdev=10849.29 clat percentiles (usec): | 1.00th=[ 260], 5.00th=[ 938], 10.00th=[ 8356], 20.00th=[ 9896], | 30.00th=[ 11863], 40.00th=[ 13829], 50.00th=[ 16057], 60.00th=[ 18482], | 70.00th=[ 21103], 80.00th=[ 25035], 90.00th=[ 30540], 95.00th=[ 34866], | 99.00th=[ 58459], 99.50th=[ 64750], 99.90th=[ 84411], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 6, max= 183, per=24.78%, avg=109.29, stdev=29.95, samples=107 iops : min= 1, max= 45, avg=27.00, stdev= 7.51, samples=107 write: IOPS=29, BW=117KiB/s (120kB/s)(6348KiB/54095msec); 0 zone resets clat (usec): min=728, max=732214, avg=17171.62, stdev=23658.87 lat (usec): min=729, max=732215, avg=17173.02, stdev=23658.89 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1893], 10.00th=[ 2507], 20.00th=[ 3556], | 30.00th=[ 5604], 40.00th=[ 9765], 50.00th=[ 13435], 60.00th=[ 16712], | 70.00th=[ 21103], 80.00th=[ 27657], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 66323], 99.50th=[ 71828], 99.90th=[177210], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 55, max= 264, per=25.44%, avg=117.26, stdev=35.99, samples=106 iops : min= 13, max= 66, avg=29.00, stdev= 8.99, samples=106 lat (usec) : 250=0.42%, 500=1.24%, 750=0.68%, 1000=0.59% lat (msec) : 2=2.57%, 4=8.89%, 10=16.37%, 20=35.87%, 50=30.83% lat (msec) : 100=2.34%, 250=0.16%, 750=0.03% cpu : usr=0.14%, sys=24.32%, ctx=8278, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146831: Sun Nov 16 23:23:33 2025 read: IOPS=27, BW=111KiB/s (113kB/s)(6028KiB/54419msec) clat (usec): min=105, max=114801, avg=17535.10, stdev=11923.19 lat (usec): min=105, max=114803, avg=17536.94, stdev=11922.68 clat percentiles (usec): | 1.00th=[ 217], 5.00th=[ 519], 10.00th=[ 7308], 20.00th=[ 9503], | 30.00th=[ 11076], 40.00th=[ 12911], 50.00th=[ 15008], 60.00th=[ 17695], | 70.00th=[ 21103], 80.00th=[ 24773], 90.00th=[ 30278], 95.00th=[ 35914], | 99.00th=[ 60556], 99.50th=[ 76022], 99.90th=[110625], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 48, max= 223, per=25.50%, avg=112.45, stdev=34.49, samples=106 iops : min= 12, max= 55, avg=27.78, stdev= 8.66, samples=106 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54419msec); 0 zone resets clat (usec): min=569, max=833308, avg=17767.55, stdev=25777.44 lat (usec): min=569, max=833310, avg=17769.02, stdev=25777.45 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1958], 10.00th=[ 2704], 20.00th=[ 3916], | 30.00th=[ 6259], 40.00th=[ 10814], 50.00th=[ 13960], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 35914], 95.00th=[ 45876], | 99.00th=[ 72877], 99.50th=[ 85459], 99.90th=[183501], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 24, max= 239, per=25.07%, avg=115.56, stdev=32.67, samples=107 iops : min= 6, max= 59, avg=28.57, stdev= 8.16, samples=107 lat (usec) : 250=0.62%, 500=1.82%, 750=0.59%, 1000=0.49% lat (msec) : 2=2.44%, 4=7.88%, 10=16.80%, 20=35.64%, 50=30.96% lat (msec) : 100=2.51%, 250=0.23%, 1000=0.03% cpu : usr=0.15%, sys=23.81%, ctx=8277, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146832: Sun Nov 16 23:23:33 2025 read: IOPS=27, BW=111KiB/s (114kB/s)(6052KiB/54339msec) clat (usec): min=128, max=140106, avg=17355.35, stdev=11199.40 lat (usec): min=129, max=140107, avg=17356.49, stdev=11199.48 clat percentiles (usec): | 1.00th=[ 255], 5.00th=[ 603], 10.00th=[ 7701], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13435], 50.00th=[ 15401], 60.00th=[ 17433], | 70.00th=[ 20055], 80.00th=[ 23987], 90.00th=[ 29492], 95.00th=[ 35390], | 99.00th=[ 56886], 99.50th=[ 63701], 99.90th=[110625], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 48, max= 207, per=25.44%, avg=112.20, stdev=31.09, samples=107 iops : min= 12, max= 51, avg=27.73, stdev= 7.76, samples=107 write: IOPS=28, BW=115KiB/s (118kB/s)(6236KiB/54339msec); 0 zone resets clat (usec): min=610, max=762683, avg=17904.57, stdev=24774.26 lat (usec): min=611, max=762684, avg=17905.98, stdev=24774.25 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2040], 10.00th=[ 2671], 20.00th=[ 3752], | 30.00th=[ 5604], 40.00th=[ 10290], 50.00th=[ 13566], 60.00th=[ 17695], | 70.00th=[ 22676], 80.00th=[ 28181], 90.00th=[ 37487], 95.00th=[ 44827], | 99.00th=[ 70779], 99.50th=[100140], 99.90th=[177210], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 20, max= 200, per=24.78%, avg=114.24, stdev=31.04, samples=108 iops : min= 5, max= 50, avg=28.24, stdev= 7.73, samples=108 lat (usec) : 250=0.42%, 500=1.66%, 750=0.88%, 1000=0.36% lat (msec) : 2=2.18%, 4=8.59%, 10=16.28%, 20=36.82%, 50=30.57% lat (msec) : 100=1.89%, 250=0.33%, 1000=0.03% cpu : usr=0.18%, sys=23.78%, ctx=8215, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=441KiB/s (452kB/s), 110KiB/s-112KiB/s (112kB/s-114kB/s), io=23.4MiB (24.6MB), run=53686-54419msec WRITE: bw=462KiB/s (473kB/s), 115KiB/s-117KiB/s (118kB/s-120kB/s), io=24.6MiB (25.7MB), run=53686-54419msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146824: Sun Nov 16 23:24:16 2025 read: IOPS=15, BW=61.7KiB/s (63.2kB/s)(5992KiB/97125msec) clat (msec): min=3, max=747, avg=15.94, stdev=24.01 lat (msec): min=3, max=747, avg=15.94, stdev=24.01 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 79], 99.50th=[ 103], 99.90th=[ 186], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 168, per=25.10%, avg=61.74, stdev=33.81, samples=192 iops : min= 1, max= 42, avg=15.15, stdev= 8.52, samples=192 write: IOPS=16, BW=64.8KiB/s (66.4kB/s)(6296KiB/97125msec); 0 zone resets clat (msec): min=17, max=179, avg=46.38, stdev=20.42 lat (msec): min=17, max=179, avg=46.39, stdev=20.42 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 38], 50.00th=[ 42], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 60], 90.00th=[ 73], 95.00th=[ 87], | 99.00th=[ 125], 99.50th=[ 134], 99.90th=[ 167], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 15, max= 120, per=25.24%, avg=64.86, stdev=25.20, samples=192 iops : min= 3, max= 30, avg=15.93, stdev= 6.41, samples=192 lat (msec) : 4=0.16%, 10=23.70%, 20=14.19%, 50=44.01%, 100=16.60% lat (msec) : 250=1.30%, 750=0.03% cpu : usr=0.10%, sys=6.12%, ctx=5789, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146825: Sun Nov 16 23:24:16 2025 read: IOPS=15, BW=61.3KiB/s (62.7kB/s)(5940KiB/96948msec) clat (msec): min=3, max=769, avg=15.82, stdev=23.89 lat (msec): min=3, max=769, avg=15.82, stdev=23.89 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 72], 99.50th=[ 104], 99.90th=[ 140], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 144, per=24.94%, avg=61.36, stdev=33.43, samples=192 iops : min= 1, max= 36, avg=15.05, stdev= 8.41, samples=192 write: IOPS=16, BW=65.5KiB/s (67.0kB/s)(6348KiB/96948msec); 0 zone resets clat (msec): min=17, max=193, avg=46.14, stdev=19.95 lat (msec): min=17, max=193, avg=46.14, stdev=19.95 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 72], 95.00th=[ 85], | 99.00th=[ 109], 99.50th=[ 126], 99.90th=[ 182], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 16, max= 112, per=25.55%, avg=65.66, stdev=25.16, samples=192 iops : min= 4, max= 28, avg=16.12, stdev= 6.39, samples=192 lat (msec) : 4=0.07%, 10=22.82%, 20=15.01%, 50=44.47%, 100=16.67% lat (msec) : 250=0.94%, 1000=0.03% cpu : usr=0.11%, sys=6.04%, ctx=5734, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146826: Sun Nov 16 23:24:16 2025 read: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6028KiB/96928msec) clat (msec): min=3, max=154, avg=16.02, stdev=15.43 lat (msec): min=3, max=154, avg=16.02, stdev=15.43 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 44], | 99.00th=[ 79], 99.50th=[ 115], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 15, max= 160, per=25.47%, avg=62.65, stdev=32.38, samples=191 iops : min= 3, max= 40, avg=15.37, stdev= 8.18, samples=191 write: IOPS=16, BW=64.6KiB/s (66.1kB/s)(6260KiB/96928msec); 0 zone resets clat (msec): min=16, max=823, avg=46.36, stdev=27.91 lat (msec): min=16, max=823, avg=46.36, stdev=27.91 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 61], 90.00th=[ 73], 95.00th=[ 83], | 99.00th=[ 110], 99.50th=[ 127], 99.90th=[ 215], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 16, max= 120, per=25.19%, avg=64.74, stdev=25.55, samples=192 iops : min= 4, max= 30, avg=15.90, stdev= 6.47, samples=192 lat (msec) : 4=0.13%, 10=22.40%, 20=15.23%, 50=44.34%, 100=16.60% lat (msec) : 250=1.27%, 1000=0.03% cpu : usr=0.09%, sys=6.24%, ctx=5822, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146827: Sun Nov 16 23:24:16 2025 read: IOPS=15, BW=62.1KiB/s (63.6kB/s)(6052KiB/97444msec) clat (msec): min=3, max=145, avg=15.85, stdev=14.61 lat (msec): min=3, max=145, avg=15.86, stdev=14.61 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 42], | 99.00th=[ 74], 99.50th=[ 106], 99.90th=[ 134], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 7, max= 160, per=25.59%, avg=62.94, stdev=33.16, samples=191 iops : min= 1, max= 40, avg=15.45, stdev= 8.35, samples=191 write: IOPS=15, BW=63.0KiB/s (65.5kB/s)(6236KiB/97444msec); 0 zone resets clat (msec): min=19, max=781, avg=46.96, stdev=28.07 lat (msec): min=19, max=781, avg=46.97, stdev=28.07 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 60], 90.00th=[ 74], 95.00th=[ 87], | 99.00th=[ 122], 99.50th=[ 150], 99.90th=[ 215], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 23, max= 120, per=24.95%, avg=64.11, stdev=25.27, samples=193 iops : min= 5, max= 30, avg=15.74, stdev= 6.41, samples=193 lat (msec) : 4=0.16%, 10=22.30%, 20=15.43%, 50=44.69%, 100=16.08% lat (msec) : 250=1.30%, 1000=0.03% cpu : usr=0.09%, sys=6.19%, ctx=5819, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=246KiB/s (252kB/s), 61.3KiB/s-62.2KiB/s (62.7kB/s-63.7kB/s), io=23.4MiB (24.6MB), run=96928-97444msec WRITE: bw=258KiB/s (264kB/s), 63.0KiB/s-65.5KiB/s (65.5kB/s-67.0kB/s), io=24.6MiB (25.7MB), run=96928-97444msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146860: Sun Nov 16 23:24:34 2025 read: IOPS=30, BW=483KiB/s (495kB/s)(5920KiB/12254msec) clat (usec): min=93, max=55869, avg=15692.38, stdev=10151.16 lat (usec): min=93, max=55870, avg=15693.46, stdev=10151.15 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 322], 10.00th=[ 420], 20.00th=[ 8848], | 30.00th=[11207], 40.00th=[12911], 50.00th=[14615], 60.00th=[17171], | 70.00th=[20055], 80.00th=[23462], 90.00th=[28705], 95.00th=[34341], | 99.00th=[44303], 99.50th=[47973], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 256, max= 672, per=25.31%, avg=483.33, stdev=131.66, samples=24 iops : min= 16, max= 42, avg=29.92, stdev= 8.18, samples=24 write: IOPS=32, BW=520KiB/s (532kB/s)(6368KiB/12254msec); 0 zone resets clat (usec): min=1649, max=93548, avg=15957.67, stdev=14375.64 lat (usec): min=1650, max=93551, avg=15959.67, stdev=14375.67 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2769], 10.00th=[ 3490], 20.00th=[ 4555], | 30.00th=[ 5800], 40.00th=[ 8455], 50.00th=[11731], 60.00th=[15270], | 70.00th=[20317], 80.00th=[25297], 90.00th=[34341], 95.00th=[41681], | 99.00th=[74974], 99.50th=[91751], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 328, max= 795, per=25.99%, avg=522.13, stdev=104.89, samples=24 iops : min= 20, max= 49, avg=32.33, stdev= 6.64, samples=24 lat (usec) : 100=0.26%, 250=1.30%, 500=4.82%, 750=0.91%, 1000=0.13% lat (msec) : 2=1.17%, 4=6.77%, 10=20.05%, 20=34.24%, 50=28.65% lat (msec) : 100=1.69% cpu : usr=0.19%, sys=30.07%, ctx=2261, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146863: Sun Nov 16 23:24:34 2025 read: IOPS=30, BW=483KiB/s (495kB/s)(5744KiB/11887msec) clat (usec): min=111, max=71220, avg=16918.56, stdev=10652.56 lat (usec): min=111, max=71221, avg=16919.62, stdev=10652.48 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 367], 10.00th=[ 490], 20.00th=[10028], | 30.00th=[11863], 40.00th=[13435], 50.00th=[15401], 60.00th=[17695], | 70.00th=[20579], 80.00th=[24511], 90.00th=[29230], 95.00th=[36439], | 99.00th=[53740], 99.50th=[56361], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 255, max= 731, per=25.37%, avg=484.48, stdev=113.74, samples=23 iops : min= 15, max= 45, avg=29.96, stdev= 7.10, samples=23 write: IOPS=34, BW=551KiB/s (564kB/s)(6544KiB/11887msec); 0 zone resets clat (usec): min=1361, max=93230, avg=14082.60, stdev=11735.62 lat (usec): min=1363, max=93232, avg=14084.68, stdev=11735.59 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2409], 10.00th=[ 3359], 20.00th=[ 4621], | 30.00th=[ 5866], 40.00th=[ 8160], 50.00th=[10552], 60.00th=[13566], | 70.00th=[17433], 80.00th=[22676], 90.00th=[30278], 95.00th=[35390], | 99.00th=[54264], 99.50th=[60031], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 352, max= 812, per=27.27%, avg=547.78, stdev=131.44, samples=23 iops : min= 22, max= 50, avg=33.91, stdev= 8.08, samples=23 lat (usec) : 250=1.04%, 500=3.65%, 750=0.39%, 1000=0.26% lat (msec) : 2=2.21%, 4=5.99%, 10=20.96%, 20=38.02%, 50=26.17% lat (msec) : 100=1.30% cpu : usr=0.15%, sys=31.49%, ctx=2209, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146864: Sun Nov 16 23:24:34 2025 read: IOPS=31, BW=499KiB/s (511kB/s)(6256KiB/12540msec) clat (usec): min=138, max=49927, avg=16650.55, stdev=10682.70 lat (usec): min=139, max=49928, avg=16651.76, stdev=10682.70 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 359], 10.00th=[ 482], 20.00th=[ 8717], | 30.00th=[11207], 40.00th=[12911], 50.00th=[15533], 60.00th=[18744], | 70.00th=[21103], 80.00th=[25560], 90.00th=[30540], 95.00th=[35914], | 99.00th=[45876], 99.50th=[47973], 99.90th=[50070], 99.95th=[50070], | 99.99th=[50070] bw ( KiB/s): min= 210, max= 768, per=25.41%, avg=485.42, stdev=113.12, samples=24 iops : min= 13, max= 48, avg=30.04, stdev= 7.21, samples=24 write: IOPS=30, BW=481KiB/s (493kB/s)(6032KiB/12540msec); 0 zone resets clat (usec): min=1256, max=61316, avg=15659.52, stdev=12528.13 lat (usec): min=1257, max=61319, avg=15661.49, stdev=12528.24 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2606], 10.00th=[ 3589], 20.00th=[ 4555], | 30.00th=[ 5735], 40.00th=[ 8356], 50.00th=[11863], 60.00th=[16450], | 70.00th=[20579], 80.00th=[26870], 90.00th=[34866], 95.00th=[40109], | 99.00th=[52167], 99.50th=[56886], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 224, max= 640, per=22.82%, avg=458.38, stdev=113.71, samples=24 iops : min= 14, max= 40, avg=28.33, stdev= 6.96, samples=24 lat (usec) : 250=0.78%, 500=4.69%, 750=1.56% lat (msec) : 2=1.56%, 4=5.47%, 10=20.18%, 20=33.72%, 50=31.51% lat (msec) : 100=0.52% cpu : usr=0.19%, sys=29.28%, ctx=2325, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146867: Sun Nov 16 23:24:34 2025 read: IOPS=31, BW=497KiB/s (509kB/s)(6032KiB/12129msec) clat (usec): min=155, max=55036, avg=16226.60, stdev=10515.28 lat (usec): min=156, max=55037, avg=16227.61, stdev=10515.32 clat percentiles (usec): | 1.00th=[ 196], 5.00th=[ 334], 10.00th=[ 408], 20.00th=[ 9372], | 30.00th=[11469], 40.00th=[12911], 50.00th=[15139], 60.00th=[18220], | 70.00th=[20841], 80.00th=[24249], 90.00th=[28967], 95.00th=[33817], | 99.00th=[49021], 99.50th=[54789], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 120, max= 736, per=25.84%, avg=493.46, stdev=156.59, samples=24 iops : min= 7, max= 46, avg=30.54, stdev= 9.81, samples=24 write: IOPS=32, BW=516KiB/s (528kB/s)(6256KiB/12129msec); 0 zone resets clat (usec): min=1488, max=80348, avg=15027.30, stdev=13478.71 lat (usec): min=1490, max=80350, avg=15029.34, stdev=13478.76 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 3032], 10.00th=[ 3556], 20.00th=[ 4359], | 30.00th=[ 5342], 40.00th=[ 7635], 50.00th=[11207], 60.00th=[13829], | 70.00th=[17957], 80.00th=[24511], 90.00th=[32900], 95.00th=[40109], | 99.00th=[65799], 99.50th=[74974], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 180, max= 736, per=25.68%, avg=515.92, stdev=146.22, samples=24 iops : min= 11, max= 46, avg=31.96, stdev= 9.13, samples=24 lat (usec) : 250=0.78%, 500=5.21%, 750=1.17%, 1000=0.13% lat (msec) : 2=1.69%, 4=6.77%, 10=19.66%, 20=35.03%, 50=27.73% lat (msec) : 100=1.82% cpu : usr=0.14%, sys=30.17%, ctx=2152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1910KiB/s (1956kB/s), 483KiB/s-499KiB/s (495kB/s-511kB/s), io=23.4MiB (24.5MB), run=11887-12540msec WRITE: bw=2010KiB/s (2058kB/s), 481KiB/s-551KiB/s (493kB/s-564kB/s), io=24.6MiB (25.8MB), run=11887-12540msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146861: Sun Nov 16 23:24:47 2025 read: IOPS=14, BW=239KiB/s (245kB/s)(5920KiB/24788msec) clat (usec): min=4737, max=96616, avg=15713.98, stdev=14193.72 lat (usec): min=4739, max=96617, avg=15715.54, stdev=14193.58 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5604], 10.00th=[ 5997], 20.00th=[ 6849], | 30.00th=[ 7635], 40.00th=[ 8848], 50.00th=[10159], 60.00th=[12125], | 70.00th=[15926], 80.00th=[22414], 90.00th=[31851], 95.00th=[45876], | 99.00th=[81265], 99.50th=[83362], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 542, per=25.01%, avg=237.37, stdev=104.24, samples=49 iops : min= 3, max= 33, avg=14.47, stdev= 6.52, samples=49 write: IOPS=16, BW=257KiB/s (263kB/s)(6368KiB/24788msec); 0 zone resets clat (msec): min=22, max=148, avg=47.56, stdev=18.13 lat (msec): min=22, max=148, avg=47.57, stdev=18.13 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 40], 50.00th=[ 43], 60.00th=[ 47], | 70.00th=[ 52], 80.00th=[ 59], 90.00th=[ 73], 95.00th=[ 85], | 99.00th=[ 110], 99.50th=[ 114], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 96, max= 416, per=25.71%, avg=256.57, stdev=88.67, samples=49 iops : min= 6, max= 26, avg=15.67, stdev= 5.66, samples=49 lat (msec) : 10=22.92%, 20=15.10%, 50=43.49%, 100=17.58%, 250=0.91% cpu : usr=0.09%, sys=6.85%, ctx=1505, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146862: Sun Nov 16 23:24:47 2025 read: IOPS=14, BW=228KiB/s (233kB/s)(5744KiB/25236msec) clat (msec): min=4, max=132, avg=16.44, stdev=17.06 lat (msec): min=4, max=132, avg=16.44, stdev=17.06 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 51], | 99.00th=[ 92], 99.50th=[ 105], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 59, max= 544, per=24.37%, avg=231.27, stdev=119.51, samples=49 iops : min= 3, max= 34, avg=14.08, stdev= 7.58, samples=49 write: IOPS=16, BW=259KiB/s (266kB/s)(6544KiB/25236msec); 0 zone resets clat (msec): min=18, max=111, avg=47.05, stdev=17.92 lat (msec): min=18, max=111, avg=47.06, stdev=17.92 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 44], 60.00th=[ 48], | 70.00th=[ 53], 80.00th=[ 61], 90.00th=[ 71], 95.00th=[ 85], | 99.00th=[ 102], 99.50th=[ 107], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 95, max= 576, per=25.83%, avg=257.76, stdev=97.19, samples=50 iops : min= 5, max= 36, avg=15.76, stdev= 6.18, samples=50 lat (msec) : 10=24.35%, 20=12.24%, 50=41.93%, 100=20.44%, 250=1.04% cpu : usr=0.11%, sys=6.63%, ctx=1530, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146865: Sun Nov 16 23:24:47 2025 read: IOPS=16, BW=262KiB/s (269kB/s)(6256KiB/23843msec) clat (usec): min=4404, max=96243, avg=15759.40, stdev=15075.00 lat (usec): min=4405, max=96243, avg=15760.79, stdev=15074.91 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5604], 10.00th=[ 5932], 20.00th=[ 6849], | 30.00th=[ 7701], 40.00th=[ 8586], 50.00th=[ 9634], 60.00th=[11338], | 70.00th=[14353], 80.00th=[20841], 90.00th=[33424], 95.00th=[51119], | 99.00th=[81265], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 63, max= 576, per=27.89%, avg=264.70, stdev=134.78, samples=47 iops : min= 3, max= 36, avg=16.17, stdev= 8.52, samples=47 write: IOPS=15, BW=253KiB/s (259kB/s)(6032KiB/23843msec); 0 zone resets clat (msec): min=21, max=184, avg=46.61, stdev=17.80 lat (msec): min=21, max=184, avg=46.61, stdev=17.80 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 40], 50.00th=[ 43], 60.00th=[ 48], | 70.00th=[ 53], 80.00th=[ 57], 90.00th=[ 67], 95.00th=[ 81], | 99.00th=[ 101], 99.50th=[ 112], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 96, max= 416, per=25.22%, avg=251.72, stdev=91.14, samples=47 iops : min= 6, max= 26, avg=15.34, stdev= 5.81, samples=47 lat (msec) : 10=26.82%, 20=13.41%, 50=40.10%, 100=19.01%, 250=0.65% cpu : usr=0.11%, sys=6.89%, ctx=1495, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146866: Sun Nov 16 23:24:47 2025 read: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24690msec) clat (msec): min=3, max=103, avg=15.85, stdev=14.30 lat (msec): min=3, max=103, avg=15.85, stdev=14.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 72], 99.50th=[ 102], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 64, max= 512, per=25.60%, avg=242.94, stdev=120.00, samples=49 iops : min= 4, max= 32, avg=14.82, stdev= 7.65, samples=49 write: IOPS=15, BW=253KiB/s (259kB/s)(6256KiB/24690msec); 0 zone resets clat (msec): min=21, max=182, avg=47.58, stdev=17.88 lat (msec): min=21, max=182, avg=47.58, stdev=17.88 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 41], 50.00th=[ 44], 60.00th=[ 48], | 70.00th=[ 52], 80.00th=[ 57], 90.00th=[ 70], 95.00th=[ 86], | 99.00th=[ 105], 99.50th=[ 111], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 96, max= 416, per=25.38%, avg=253.33, stdev=88.64, samples=49 iops : min= 6, max= 26, avg=15.47, stdev= 5.59, samples=49 lat (msec) : 4=0.13%, 10=23.70%, 20=14.06%, 50=42.97%, 100=18.10% lat (msec) : 250=1.04% cpu : usr=0.13%, sys=6.89%, ctx=1567, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=949KiB/s (972kB/s), 228KiB/s-262KiB/s (233kB/s-269kB/s), io=23.4MiB (24.5MB), run=23843-25236msec WRITE: bw=999KiB/s (1023kB/s), 253KiB/s-259KiB/s (259kB/s-266kB/s), io=24.6MiB (25.8MB), run=23843-25236msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146880: Sun Nov 16 23:24:56 2025 read: IOPS=2, BW=2652KiB/s (2716kB/s)(7168KiB/2703msec) clat (usec): min=845, max=278824, avg=160983.69, stdev=86920.01 lat (usec): min=847, max=278825, avg=160985.19, stdev=86919.91 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[122160], | 30.00th=[154141], 40.00th=[154141], 50.00th=[164627], 60.00th=[183501], | 70.00th=[183501], 80.00th=[221250], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1831, max= 3856, per=45.31%, avg=2859.50, stdev=1067.84, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1894KiB/s (1940kB/s)(5120KiB/2703msec); 0 zone resets clat (msec): min=182, max=521, avg=295.93, stdev=133.75 lat (msec): min=182, max=521, avg=295.99, stdev=133.74 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1831, max= 4087, per=29.60%, avg=2615.33, stdev=1275.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=49.85%, ctx=1012, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146881: Sun Nov 16 23:24:56 2025 read: IOPS=0, BW=658KiB/s (673kB/s)(2048KiB/3114msec) clat (usec): min=875, max=262920, avg=131898.11, stdev=185294.22 lat (usec): min=876, max=262924, avg=131900.40, stdev=185295.80 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 873], 60.00th=[263193], | 70.00th=[263193], 80.00th=[263193], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 1845, max= 2043, per=30.80%, avg=1944.00, stdev=140.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3288KiB/s (3367kB/s)(10.0MiB/3114msec); 0 zone resets clat (msec): min=117, max=501, avg=275.79, stdev=143.91 lat (msec): min=117, max=501, avg=275.87, stdev=143.89 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 140], | 30.00th=[ 190], 40.00th=[ 205], 50.00th=[ 209], 60.00th=[ 226], | 70.00th=[ 245], 80.00th=[ 439], 90.00th=[ 485], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2043, max= 4096, per=38.65%, avg=3414.50, stdev=931.33, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.10%, sys=44.97%, ctx=272, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146882: Sun Nov 16 23:24:56 2025 read: IOPS=1, BW=1893KiB/s (1939kB/s)(6144KiB/3245msec) clat (usec): min=849, max=176398, avg=75911.89, stdev=85688.80 lat (usec): min=851, max=176399, avg=75913.12, stdev=85688.40 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 857], | 30.00th=[ 857], 40.00th=[ 873], 50.00th=[ 873], 60.00th=[107480], | 70.00th=[168821], 80.00th=[168821], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 4087, max= 6059, per=80.38%, avg=5073.00, stdev=1394.41, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1893KiB/s (1939kB/s)(6144KiB/3245msec); 0 zone resets clat (msec): min=96, max=1161, avg=451.77, stdev=394.92 lat (msec): min=96, max=1162, avg=451.85, stdev=394.96 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 368], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1831, max= 4039, per=26.48%, avg=2339.20, stdev=953.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=25.00% lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.06%, sys=29.35%, ctx=556, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146883: Sun Nov 16 23:24:56 2025 read: IOPS=1, BW=1959KiB/s (2006kB/s)(5120KiB/2614msec) clat (usec): min=801, max=235669, avg=113694.04, stdev=107326.64 lat (usec): min=802, max=235670, avg=113695.05, stdev=107326.31 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 4047], 40.00th=[ 4047], 50.00th=[137364], 60.00th=[137364], | 70.00th=[189793], 80.00th=[189793], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 2048, max= 6131, per=64.80%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2742KiB/s (2808kB/s)(7168KiB/2614msec); 0 zone resets clat (msec): min=163, max=655, avg=289.28, stdev=177.87 lat (msec): min=163, max=655, avg=289.36, stdev=177.89 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 169], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 190], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 338], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1835, max= 3856, per=29.20%, avg=2579.67, stdev=1110.46, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=48.18%, ctx=314, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6311KiB/s (6463kB/s), 658KiB/s-2652KiB/s (673kB/s-2716kB/s), io=20.0MiB (20.0MB), run=2614-3245msec WRITE: bw=8836KiB/s (9048kB/s), 1893KiB/s-3288KiB/s (1939kB/s-3367kB/s), io=28.0MiB (29.4MB), run=2614-3245msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146876: Sun Nov 16 23:24:56 2025 read: IOPS=3, BW=3099KiB/s (3173kB/s)(7168KiB/2313msec) clat (msec): min=62, max=302, avg=147.39, stdev=85.86 lat (msec): min=62, max=302, avg=147.39, stdev=85.86 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 213], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2048, max= 5466, per=64.03%, avg=3754.67, stdev=1709.00, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2214KiB/s (2267kB/s)(5120KiB/2313msec); 0 zone resets clat (msec): min=97, max=331, avg=245.13, stdev=94.40 lat (msec): min=97, max=331, avg=245.22, stdev=94.39 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1822, max= 4079, per=32.27%, avg=2649.67, stdev=1242.99, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 500=25.00% cpu : usr=0.00%, sys=17.78%, ctx=169, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146877: Sun Nov 16 23:24:56 2025 read: IOPS=0, BW=611KiB/s (626kB/s)(2048KiB/3351msec) clat (msec): min=123, max=405, avg=264.66, stdev=199.86 lat (msec): min=123, max=405, avg=264.66, stdev=199.86 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1815, max= 2048, per=32.94%, avg=1931.50, stdev=164.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=3056KiB/s (3129kB/s)(10.0MiB/3351msec); 0 zone resets clat (msec): min=94, max=701, avg=276.82, stdev=200.97 lat (msec): min=94, max=702, avg=276.91, stdev=200.98 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 99], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 150], 60.00th=[ 279], | 70.00th=[ 330], 80.00th=[ 422], 90.00th=[ 451], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2048, max= 4096, per=43.43%, avg=3565.50, stdev=1011.95, samples=4 iops : min= 2, max= 4, avg= 3.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=16.57%, ctx=255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146878: Sun Nov 16 23:24:56 2025 read: IOPS=1, BW=2026KiB/s (2075kB/s)(6144KiB/3032msec) clat (msec): min=106, max=330, avg=207.65, stdev=92.07 lat (msec): min=106, max=330, avg=207.65, stdev=92.07 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 245], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2039, max= 4096, per=46.52%, avg=2727.67, stdev=1185.02, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=2026KiB/s (2075kB/s)(6144KiB/3032msec); 0 zone resets clat (msec): min=73, max=704, avg=293.76, stdev=225.25 lat (msec): min=73, max=704, avg=293.89, stdev=225.23 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 215], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2039, max= 3631, per=29.74%, avg=2441.50, stdev=793.01, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=14.12%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146879: Sun Nov 16 23:24:56 2025 read: IOPS=1, BW=1466KiB/s (1501kB/s)(5120KiB/3492msec) clat (msec): min=24, max=432, avg=252.04, stdev=161.11 lat (msec): min=24, max=432, avg=252.04, stdev=161.11 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 25], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2019, max= 4096, per=52.14%, avg=3057.50, stdev=1468.66, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2053KiB/s (2102kB/s)(7168KiB/3492msec); 0 zone resets clat (msec): min=43, max=1071, avg=308.16, stdev=367.74 lat (msec): min=44, max=1071, avg=308.25, stdev=367.74 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 66], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 184], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 472], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1828, max= 6144, per=48.55%, avg=3986.00, stdev=3051.87, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=10.71%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5865KiB/s (6006kB/s), 611KiB/s-3099KiB/s (626kB/s-3173kB/s), io=20.0MiB (20.0MB), run=2313-3492msec WRITE: bw=8211KiB/s (8408kB/s), 2026KiB/s-3056KiB/s (2075kB/s-3129kB/s), io=28.0MiB (29.4MB), run=2313-3492msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146890: Sun Nov 16 23:25:07 2025 read: IOPS=0, BW=3404KiB/s (3486kB/s)(12.0MiB/3610msec) clat (msec): min=488, max=1561, avg=1176.43, stdev=597.18 lat (msec): min=488, max=1561, avg=1176.43, stdev=597.18 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=30.29%, ctx=2477, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146892: Sun Nov 16 23:25:07 2025 read: IOPS=0, BW=1175KiB/s (1204kB/s)(4096KiB/3485msec) clat (nsec): min=350613k, max=350613k, avg=350613416.00, stdev= 0.00 lat (nsec): min=350616k, max=350616k, avg=350616328.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 6781, max= 6781, per=100.00%, avg=6781.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2351KiB/s (2407kB/s)(8192KiB/3485msec); 0 zone resets clat (msec): min=1487, max=1556, avg=1521.98, stdev=48.96 lat (msec): min=1487, max=1557, avg=1522.47, stdev=48.93 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8126, max= 8126, per=98.33%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.06%, sys=10.13%, ctx=796, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146894: Sun Nov 16 23:25:07 2025 write: IOPS=0, BW=3099KiB/s (3173kB/s)(12.0MiB/3965msec); 0 zone resets clat (msec): min=205, max=2142, avg=1299.90, stdev=992.95 lat (msec): min=205, max=2142, avg=1300.28, stdev=993.10 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8192, max= 8192, per=99.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=10.97%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146896: Sun Nov 16 23:25:07 2025 write: IOPS=0, BW=3547KiB/s (3632kB/s)(12.0MiB/3464msec); 0 zone resets clat (msec): min=265, max=1876, avg=1124.45, stdev=810.79 lat (msec): min=265, max=1876, avg=1124.91, stdev=810.79 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.21%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4539KiB/s (4647kB/s), 1175KiB/s-3404KiB/s (1204kB/s-3486kB/s), io=16.0MiB (16.8MB), run=3485-3610msec WRITE: bw=8264KiB/s (8463kB/s), 2351KiB/s-3547KiB/s (2407kB/s-3632kB/s), io=32.0MiB (33.6MB), run=3464-3965msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146891: Sun Nov 16 23:25:07 2025 read: IOPS=0, BW=3310KiB/s (3390kB/s)(12.0MiB/3712msec) clat (msec): min=417, max=1800, avg=1206.81, stdev=711.66 lat (msec): min=417, max=1800, avg=1206.81, stdev=711.66 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.08%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146893: Sun Nov 16 23:25:07 2025 read: IOPS=0, BW=1043KiB/s (1068kB/s)(4096KiB/3929msec) clat (nsec): min=1933.8M, max=1933.8M, avg=1933767502.00, stdev= 0.00 lat (nsec): min=1933.8M, max=1933.8M, avg=1933769939.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1938], 5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938], | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2085KiB/s (2135kB/s)(8192KiB/3929msec); 0 zone resets clat (msec): min=427, max=1464, avg=945.97, stdev=732.67 lat (msec): min=428, max=1464, avg=946.30, stdev=732.64 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.79%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146895: Sun Nov 16 23:25:07 2025 write: IOPS=0, BW=2993KiB/s (3065kB/s)(12.0MiB/4106msec); 0 zone resets clat (msec): min=88, max=3442, avg=1346.21, stdev=1827.85 lat (msec): min=88, max=3443, avg=1346.82, stdev=1827.98 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 100=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=6.14%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146897: Sun Nov 16 23:25:07 2025 write: IOPS=0, BW=3307KiB/s (3386kB/s)(12.0MiB/3716msec); 0 zone resets clat (msec): min=624, max=1552, avg=1215.46, stdev=513.42 lat (msec): min=625, max=1552, avg=1215.96, stdev=513.38 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.99%, ctx=164, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4170KiB/s (4270kB/s), 1043KiB/s-3310KiB/s (1068kB/s-3390kB/s), io=16.0MiB (16.8MB), run=3712-3929msec WRITE: bw=7981KiB/s (8172kB/s), 2085KiB/s-3307KiB/s (2135kB/s-3386kB/s), io=32.0MiB (33.6MB), run=3716-4106msec