== sanity test 398b: DIO and buffer IO race ============== 02:09:44 (1784700584) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.52821 s, 11.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183685: Wed Jul 22 02:11:23 2026 read: IOPS=17, BW=69.5KiB/s (71.1kB/s)(5992KiB/86248msec) clat (usec): min=48, max=450833, avg=32302.09, stdev=22221.46 lat (usec): min=48, max=450834, avg=32303.64, stdev=22221.33 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 9896], 10.00th=[ 13304], 20.00th=[ 17171], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 28443], 60.00th=[ 32900], | 70.00th=[ 38011], 80.00th=[ 44827], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 96994], 99.50th=[110625], 99.90th=[183501], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 135, per=24.83%, avg=69.03, stdev=21.29, samples=171 iops : min= 1, max= 33, avg=16.65, stdev= 5.36, samples=171 write: IOPS=18, BW=72.0KiB/s (74.8kB/s)(6296KiB/86248msec); 0 zone resets clat (usec): min=1050, max=141187, avg=23807.59, stdev=23026.20 lat (usec): min=1052, max=141189, avg=23812.80, stdev=23028.21 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1565], 10.00th=[ 2180], 20.00th=[ 3556], | 30.00th=[ 6063], 40.00th=[ 12387], 50.00th=[ 17957], 60.00th=[ 23462], | 70.00th=[ 30278], 80.00th=[ 39584], 90.00th=[ 54789], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[112722], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 7, max= 151, per=25.04%, avg=72.88, stdev=25.08, samples=170 iops : min= 1, max= 37, avg=17.62, stdev= 6.33, samples=170 lat (usec) : 50=0.03%, 100=1.24%, 250=0.26%, 500=0.10% lat (msec) : 2=4.52%, 4=7.06%, 10=7.91%, 20=20.51%, 50=44.66% lat (msec) : 100=12.66%, 250=1.01%, 500=0.03% cpu : usr=0.13%, sys=8.76%, ctx=7520, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183687: Wed Jul 22 02:11:23 2026 read: IOPS=17, BW=69.1KiB/s (70.7kB/s)(5940KiB/86004msec) clat (usec): min=47, max=176197, avg=32209.76, stdev=18654.35 lat (usec): min=48, max=176199, avg=32212.21, stdev=18654.03 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 10683], 10.00th=[ 13566], 20.00th=[ 17171], | 30.00th=[ 21103], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 32637], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 55313], 95.00th=[ 65274], | 99.00th=[ 95945], 99.50th=[106431], 99.90th=[133694], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 7, max= 151, per=24.63%, avg=68.46, stdev=21.61, samples=170 iops : min= 1, max= 37, avg=16.51, stdev= 5.44, samples=170 write: IOPS=18, BW=73.8KiB/s (75.6kB/s)(6348KiB/86004msec); 0 zone resets clat (usec): min=889, max=370971, avg=23832.27, stdev=24339.07 lat (usec): min=889, max=370972, avg=23834.89, stdev=24338.46 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1631], 10.00th=[ 2089], 20.00th=[ 3523], | 30.00th=[ 6194], 40.00th=[ 12780], 50.00th=[ 18220], 60.00th=[ 23725], | 70.00th=[ 30540], 80.00th=[ 39584], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[ 98042], 99.50th=[128451], 99.90th=[164627], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 15, max= 199, per=25.10%, avg=73.05, stdev=26.44, samples=170 iops : min= 3, max= 49, avg=17.66, stdev= 6.63, samples=170 lat (usec) : 50=0.10%, 100=0.59%, 250=0.23%, 500=0.07%, 1000=0.13% lat (msec) : 2=4.65%, 4=6.97%, 10=8.33%, 20=20.31%, 50=44.95% lat (msec) : 100=12.92%, 250=0.72%, 500=0.03% cpu : usr=0.12%, sys=8.68%, ctx=7400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183688: Wed Jul 22 02:11:23 2026 read: IOPS=17, BW=69.9KiB/s (71.6kB/s)(6028KiB/86262msec) clat (usec): min=37, max=165299, avg=31671.74, stdev=18853.31 lat (usec): min=37, max=165300, avg=31675.48, stdev=18854.66 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 9896], 10.00th=[ 13173], 20.00th=[ 16909], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 28181], 60.00th=[ 32637], | 70.00th=[ 38536], 80.00th=[ 44827], 90.00th=[ 53740], 95.00th=[ 64226], | 99.00th=[ 95945], 99.50th=[109577], 99.90th=[152044], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 23, max= 127, per=25.08%, avg=69.74, stdev=19.77, samples=170 iops : min= 5, max= 31, avg=16.82, stdev= 4.96, samples=170 write: IOPS=18, BW=72.6KiB/s (74.3kB/s)(6260KiB/86262msec); 0 zone resets clat (usec): min=889, max=397371, avg=24380.28, stdev=24112.24 lat (usec): min=891, max=397372, avg=24386.62, stdev=24109.21 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1614], 10.00th=[ 2147], 20.00th=[ 3687], | 30.00th=[ 6521], 40.00th=[ 12911], 50.00th=[ 18482], 60.00th=[ 24249], | 70.00th=[ 31851], 80.00th=[ 41681], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[ 93848], 99.50th=[108528], 99.90th=[122160], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 15, max= 151, per=24.89%, avg=72.44, stdev=25.70, samples=170 iops : min= 3, max= 37, avg=17.51, stdev= 6.45, samples=170 lat (usec) : 50=0.10%, 100=1.20%, 250=0.33%, 500=0.03%, 1000=0.07% lat (msec) : 2=4.65%, 4=6.38%, 10=7.65%, 20=20.51%, 50=45.54% lat (msec) : 100=12.79%, 250=0.72%, 500=0.03% cpu : usr=0.12%, sys=8.52%, ctx=7456, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183689: Wed Jul 22 02:11:23 2026 read: IOPS=17, BW=70.5KiB/s (72.2kB/s)(6052KiB/85784msec) clat (usec): min=45, max=143272, avg=31022.22, stdev=18723.65 lat (usec): min=46, max=143273, avg=31035.65, stdev=18721.32 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 9503], 10.00th=[ 13042], 20.00th=[ 16581], | 30.00th=[ 20317], 40.00th=[ 24249], 50.00th=[ 27657], 60.00th=[ 32113], | 70.00th=[ 36963], 80.00th=[ 42730], 90.00th=[ 53216], 95.00th=[ 64226], | 99.00th=[ 95945], 99.50th=[116917], 99.90th=[137364], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 15, max= 143, per=25.21%, avg=70.07, stdev=22.50, samples=169 iops : min= 3, max= 35, avg=16.90, stdev= 5.63, samples=169 write: IOPS=18, BW=72.7KiB/s (74.4kB/s)(6236KiB/85784msec); 0 zone resets clat (usec): min=918, max=379250, avg=24682.50, stdev=25624.00 lat (usec): min=920, max=379251, avg=24684.70, stdev=25624.22 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1565], 10.00th=[ 2114], 20.00th=[ 3589], | 30.00th=[ 6456], 40.00th=[ 12256], 50.00th=[ 18482], 60.00th=[ 24511], | 70.00th=[ 31327], 80.00th=[ 41681], 90.00th=[ 56361], 95.00th=[ 70779], | 99.00th=[103285], 99.50th=[115868], 99.90th=[254804], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 15, max= 160, per=24.81%, avg=72.20, stdev=25.23, samples=169 iops : min= 3, max= 40, avg=17.43, stdev= 6.33, samples=169 lat (usec) : 50=0.07%, 100=1.50%, 250=0.33%, 500=0.03%, 1000=0.07% lat (msec) : 2=4.39%, 4=6.77%, 10=7.58%, 20=20.57%, 50=45.70% lat (msec) : 100=12.01%, 250=0.91%, 500=0.07% cpu : usr=0.12%, sys=8.59%, ctx=7385, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=278KiB/s (285kB/s), 69.1KiB/s-70.5KiB/s (70.7kB/s-72.2kB/s), io=23.4MiB (24.6MB), run=85784-86262msec WRITE: bw=291KiB/s (298kB/s), 72.6KiB/s-73.8KiB/s (74.3kB/s-75.6kB/s), io=24.6MiB (25.7MB), run=85784-86262msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183682: Wed Jul 22 02:11:47 2026 read: IOPS=13, BW=54.8KiB/s (56.1kB/s)(5992KiB/109284msec) clat (msec): min=3, max=466, avg=29.46, stdev=26.65 lat (msec): min=3, max=466, avg=29.46, stdev=26.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 120], 99.50th=[ 134], 99.90th=[ 178], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 175, per=24.97%, avg=54.68, stdev=35.56, samples=214 iops : min= 1, max= 43, avg=13.06, stdev= 8.96, samples=214 write: IOPS=14, BW=57.6KiB/s (58.0kB/s)(6296KiB/109284msec); 0 zone resets clat (msec): min=6, max=200, avg=41.17, stdev=27.98 lat (msec): min=6, max=200, avg=41.17, stdev=27.98 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 142], 99.50th=[ 157], 99.90th=[ 182], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 7, max= 174, per=24.99%, avg=57.22, stdev=34.46, samples=215 iops : min= 1, max= 43, avg=13.70, stdev= 8.68, samples=215 lat (msec) : 4=0.07%, 10=7.13%, 20=28.71%, 50=41.08%, 100=19.73% lat (msec) : 250=3.26%, 500=0.03% cpu : usr=0.09%, sys=3.94%, ctx=5286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183683: Wed Jul 22 02:11:47 2026 read: IOPS=13, BW=54.3KiB/s (55.6kB/s)(5940KiB/109489msec) clat (msec): min=4, max=388, avg=29.27, stdev=27.11 lat (msec): min=4, max=388, avg=29.27, stdev=27.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 86], | 99.00th=[ 128], 99.50th=[ 133], 99.90th=[ 178], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 207, per=24.89%, avg=54.50, stdev=37.21, samples=214 iops : min= 1, max= 51, avg=13.01, stdev= 9.36, samples=214 write: IOPS=14, BW=57.0KiB/s (59.4kB/s)(6348KiB/109489msec); 0 zone resets clat (msec): min=8, max=206, avg=41.38, stdev=28.90 lat (msec): min=8, max=206, avg=41.39, stdev=28.90 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 99], | 99.00th=[ 146], 99.50th=[ 167], 99.90th=[ 197], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 15, max= 168, per=25.15%, avg=57.58, stdev=34.33, samples=216 iops : min= 3, max= 42, avg=13.79, stdev= 8.64, samples=216 lat (msec) : 10=7.88%, 20=28.03%, 50=41.80%, 100=18.55%, 250=3.71% lat (msec) : 500=0.03% cpu : usr=0.11%, sys=3.81%, ctx=5301, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183684: Wed Jul 22 02:11:47 2026 read: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6028KiB/109471msec) clat (msec): min=3, max=184, avg=29.61, stdev=26.42 lat (msec): min=3, max=184, avg=29.62, stdev=26.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 89], | 99.00th=[ 129], 99.50th=[ 157], 99.90th=[ 178], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 183, per=25.14%, avg=55.05, stdev=34.82, samples=215 iops : min= 1, max= 45, avg=13.15, stdev= 8.78, samples=215 write: IOPS=14, BW=57.2KiB/s (58.6kB/s)(6260KiB/109471msec); 0 zone resets clat (msec): min=7, max=393, avg=41.20, stdev=29.00 lat (msec): min=7, max=393, avg=41.20, stdev=29.00 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 79], 95.00th=[ 97], | 99.00th=[ 134], 99.50th=[ 157], 99.90th=[ 186], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 182, per=24.95%, avg=57.13, stdev=35.08, samples=215 iops : min= 1, max= 45, avg=13.67, stdev= 8.85, samples=215 lat (msec) : 4=0.03%, 10=7.45%, 20=28.71%, 50=41.21%, 100=18.75% lat (msec) : 250=3.81%, 500=0.03% cpu : usr=0.08%, sys=3.88%, ctx=5312, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183686: Wed Jul 22 02:11:47 2026 read: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6052KiB/109524msec) clat (msec): min=4, max=168, avg=29.37, stdev=25.37 lat (msec): min=4, max=168, avg=29.37, stdev=25.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 83], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 165], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 7, max= 231, per=25.32%, avg=55.46, stdev=36.23, samples=214 iops : min= 1, max= 57, avg=13.26, stdev= 9.12, samples=214 write: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6236KiB/109524msec); 0 zone resets clat (msec): min=8, max=391, avg=41.53, stdev=30.64 lat (msec): min=8, max=391, avg=41.53, stdev=30.64 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 83], 95.00th=[ 102], | 99.00th=[ 150], 99.50th=[ 178], 99.90th=[ 197], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 15, max= 174, per=24.71%, avg=56.60, stdev=34.55, samples=216 iops : min= 3, max= 43, avg=13.54, stdev= 8.71, samples=216 lat (msec) : 10=7.78%, 20=29.23%, 50=40.40%, 100=18.82%, 250=3.74% lat (msec) : 500=0.03% cpu : usr=0.09%, sys=3.84%, ctx=5220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (225kB/s), 54.3KiB/s-55.3KiB/s (55.6kB/s-56.6kB/s), io=23.4MiB (24.6MB), run=109284-109524msec WRITE: bw=230KiB/s (235kB/s), 56.9KiB/s-57.0KiB/s (58.3kB/s-59.4kB/s), io=24.6MiB (25.7MB), run=109284-109524msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183721: Wed Jul 22 02:12:36 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37192msec) clat (usec): min=27, max=384039, avg=50406.02, stdev=45626.31 lat (usec): min=27, max=384040, avg=50407.47, stdev=45626.31 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 74], 10.00th=[ 10290], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 46400], | 70.00th=[ 60556], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[131597], | 99.00th=[219153], 99.50th=[325059], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 31, max= 382, per=30.37%, avg=170.96, stdev=90.08, samples=67 iops : min= 1, max= 23, avg= 9.88, stdev= 5.65, samples=67 write: IOPS=10, BW=171KiB/s (175kB/s)(6368KiB/37192msec); 0 zone resets clat (usec): min=1746, max=2059.1k, avg=46502.34, stdev=113396.77 lat (usec): min=1761, max=2059.1k, avg=46505.01, stdev=113396.69 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2474], 10.00th=[ 3752], | 20.00th=[ 6915], 30.00th=[ 11731], 40.00th=[ 17695], | 50.00th=[ 24249], 60.00th=[ 34341], 70.00th=[ 46400], | 80.00th=[ 60556], 90.00th=[ 100140], 95.00th=[ 141558], | 99.00th=[ 312476], 99.50th=[ 325059], 99.90th=[2055209], | 99.95th=[2055209], 99.99th=[2055209] bw ( KiB/s): min= 31, max= 383, per=30.71%, avg=182.09, stdev=104.68, samples=68 iops : min= 1, max= 23, avg=10.60, stdev= 6.54, samples=68 lat (usec) : 50=0.65%, 100=2.47%, 250=1.04%, 750=0.13% lat (msec) : 2=0.65%, 4=4.95%, 10=8.85%, 20=13.80%, 50=35.55% lat (msec) : 100=21.35%, 250=9.38%, 500=1.04%, >=2000=0.13% cpu : usr=0.06%, sys=5.31%, ctx=1880, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183722: Wed Jul 22 02:12:36 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34554msec) clat (usec): min=44, max=1618.7k, avg=51758.10, stdev=93562.05 lat (usec): min=44, max=1618.7k, avg=51760.81, stdev=93562.48 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 77], 10.00th=[ 165], | 20.00th=[ 17957], 30.00th=[ 23725], 40.00th=[ 29754], | 50.00th=[ 35914], 60.00th=[ 44827], 70.00th=[ 55313], | 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[ 131597], | 99.00th=[ 244319], 99.50th=[ 341836], 99.90th=[1619002], | 99.95th=[1619002], 99.99th=[1619002] bw ( KiB/s): min= 31, max= 380, per=32.42%, avg=182.51, stdev=87.10, samples=61 iops : min= 1, max= 23, avg=10.61, stdev= 5.46, samples=61 write: IOPS=11, BW=189KiB/s (194kB/s)(6544KiB/34554msec); 0 zone resets clat (usec): min=1694, max=399929, avg=38905.02, stdev=49866.65 lat (usec): min=1695, max=399930, avg=38914.56, stdev=49871.37 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2114], 10.00th=[ 3294], 20.00th=[ 6718], | 30.00th=[ 11469], 40.00th=[ 17695], 50.00th=[ 23462], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 54789], 90.00th=[ 85459], 95.00th=[131597], | 99.00th=[248513], 99.50th=[299893], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 31, max= 508, per=34.61%, avg=205.24, stdev=101.53, samples=62 iops : min= 1, max= 31, avg=12.02, stdev= 6.35, samples=62 lat (usec) : 50=0.13%, 100=3.39%, 250=1.56% lat (msec) : 2=1.82%, 4=4.56%, 10=8.33%, 20=15.23%, 50=36.59% lat (msec) : 100=20.44%, 250=7.16%, 500=0.65%, 2000=0.13% cpu : usr=0.06%, sys=5.92%, ctx=1766, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183723: Wed Jul 22 02:12:36 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42479msec) clat (usec): min=41, max=1547.5k, avg=60489.60, stdev=97714.77 lat (usec): min=42, max=1547.5k, avg=60492.69, stdev=97714.41 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 1385], | 20.00th=[ 22152], 30.00th=[ 29230], 40.00th=[ 34866], | 50.00th=[ 41681], 60.00th=[ 46924], 70.00th=[ 57410], | 80.00th=[ 72877], 90.00th=[ 115868], 95.00th=[ 164627], | 99.00th=[ 450888], 99.50th=[ 505414], 99.90th=[1551893], | 99.95th=[1551893], 99.99th=[1551893] bw ( KiB/s): min= 29, max= 378, per=28.47%, avg=160.26, stdev=94.84, samples=76 iops : min= 1, max= 23, avg= 9.25, stdev= 5.92, samples=76 write: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42479msec); 0 zone resets clat (usec): min=1600, max=917966, avg=49794.35, stdev=71866.25 lat (usec): min=1604, max=917969, avg=49798.09, stdev=71866.06 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 3163], 10.00th=[ 4146], 20.00th=[ 8979], | 30.00th=[ 16057], 40.00th=[ 21890], 50.00th=[ 30278], 60.00th=[ 39584], | 70.00th=[ 50070], 80.00th=[ 73925], 90.00th=[119014], 95.00th=[152044], | 99.00th=[333448], 99.50th=[459277], 99.90th=[918553], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 30, max= 383, per=26.80%, avg=158.90, stdev=89.17, samples=73 iops : min= 1, max= 23, avg= 9.12, stdev= 5.56, samples=73 lat (usec) : 50=0.26%, 100=3.52%, 250=0.65%, 500=0.26%, 750=0.26% lat (msec) : 2=1.04%, 4=3.52%, 10=6.77%, 20=10.03%, 50=39.45% lat (msec) : 100=21.09%, 250=11.07%, 500=1.69%, 750=0.13%, 1000=0.13% lat (msec) : 2000=0.13% cpu : usr=0.06%, sys=5.01%, ctx=1911, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183724: Wed Jul 22 02:12:36 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42170msec) clat (usec): min=41, max=313516, avg=52360.56, stdev=51641.89 lat (usec): min=42, max=313517, avg=52362.24, stdev=51641.97 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 95], 20.00th=[ 18482], | 30.00th=[ 25297], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[114820], 95.00th=[168821], | 99.00th=[267387], 99.50th=[308282], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 27, max= 414, per=28.17%, avg=158.58, stdev=92.63, samples=73 iops : min= 1, max= 25, avg= 9.12, stdev= 5.80, samples=73 write: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42170msec); 0 zone resets clat (usec): min=1691, max=2152.7k, avg=57244.70, stdev=125739.70 lat (usec): min=1693, max=2152.7k, avg=57260.46, stdev=125735.22 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2671], 10.00th=[ 4113], | 20.00th=[ 8717], 30.00th=[ 15533], 40.00th=[ 23987], | 50.00th=[ 31589], 60.00th=[ 45876], 70.00th=[ 56886], | 80.00th=[ 72877], 90.00th=[ 112722], 95.00th=[ 177210], | 99.00th=[ 404751], 99.50th=[ 666895], 99.90th=[2164261], | 99.95th=[2164261], 99.99th=[2164261] bw ( KiB/s): min= 29, max= 380, per=27.27%, avg=161.69, stdev=83.27, samples=75 iops : min= 1, max= 23, avg= 9.31, stdev= 5.24, samples=75 lat (usec) : 50=0.39%, 100=4.69%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.30%, 10=6.90%, 20=9.90%, 50=35.16% lat (msec) : 100=23.83%, 250=10.94%, 500=1.69%, 750=0.13%, >=2000=0.13% cpu : usr=0.06%, sys=5.13%, ctx=1855, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=564KiB/s (577kB/s), 143KiB/s-166KiB/s (146kB/s-170kB/s), io=23.4MiB (24.5MB), run=34554-42479msec WRITE: bw=593KiB/s (607kB/s), 142KiB/s-189KiB/s (145kB/s-194kB/s), io=24.6MiB (25.8MB), run=34554-42479msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183716: Wed Jul 22 02:12:56 2026 read: IOPS=5, BW=94.3KiB/s (96.6kB/s)(5920KiB/62745msec) clat (msec): min=8, max=2126, avg=71.72, stdev=138.02 lat (msec): min=8, max=2126, avg=71.72, stdev=138.02 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 81], 90.00th=[ 136], 95.00th=[ 220], | 99.00th=[ 625], 99.50th=[ 852], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 28, max= 412, per=29.36%, avg=111.26, stdev=81.03, samples=103 iops : min= 1, max= 25, avg= 6.17, stdev= 5.13, samples=103 write: IOPS=6, BW=101KiB/s (104kB/s)(6368KiB/62745msec); 0 zone resets clat (msec): min=13, max=1594, avg=90.74, stdev=102.82 lat (msec): min=13, max=1594, avg=90.75, stdev=102.82 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 38], | 30.00th=[ 47], 40.00th=[ 55], 50.00th=[ 66], 60.00th=[ 82], | 70.00th=[ 96], 80.00th=[ 121], 90.00th=[ 169], 95.00th=[ 226], | 99.00th=[ 401], 99.50th=[ 527], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 10, max= 383, per=28.99%, avg=115.68, stdev=66.18, samples=107 iops : min= 0, max= 23, avg= 6.45, stdev= 4.16, samples=107 lat (msec) : 10=0.39%, 20=6.12%, 50=39.71%, 100=32.68%, 250=17.32% lat (msec) : 500=2.86%, 750=0.52%, 1000=0.13%, 2000=0.13%, >=2000=0.13% cpu : usr=0.04%, sys=1.58%, ctx=1189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183717: Wed Jul 22 02:12:56 2026 read: IOPS=5, BW=91.6KiB/s (93.8kB/s)(5744KiB/62700msec) clat (msec): min=8, max=1629, avg=68.39, stdev=108.38 lat (msec): min=8, max=1629, avg=68.39, stdev=108.38 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 87], 90.00th=[ 136], 95.00th=[ 192], | 99.00th=[ 388], 99.50th=[ 693], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 28, max= 319, per=27.92%, avg=105.82, stdev=65.78, samples=105 iops : min= 1, max= 19, avg= 5.83, stdev= 4.11, samples=105 write: IOPS=6, BW=104KiB/s (107kB/s)(6544KiB/62700msec); 0 zone resets clat (msec): min=16, max=1539, avg=92.90, stdev=112.71 lat (msec): min=16, max=1539, avg=92.94, stdev=112.70 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 89], 80.00th=[ 111], 90.00th=[ 167], 95.00th=[ 275], | 99.00th=[ 477], 99.50th=[ 567], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 28, max= 380, per=29.68%, avg=118.44, stdev=76.57, samples=107 iops : min= 1, max= 23, avg= 6.64, stdev= 4.86, samples=107 lat (msec) : 10=0.52%, 20=6.51%, 50=39.32%, 100=33.98%, 250=14.97% lat (msec) : 500=3.91%, 750=0.39%, 1000=0.13%, 2000=0.26% cpu : usr=0.03%, sys=1.61%, ctx=1246, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183718: Wed Jul 22 02:12:56 2026 read: IOPS=6, BW=99.9KiB/s (102kB/s)(6256KiB/62615msec) clat (msec): min=9, max=1554, avg=68.38, stdev=102.23 lat (msec): min=9, max=1554, avg=68.38, stdev=102.23 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 134], 95.00th=[ 184], | 99.00th=[ 447], 99.50th=[ 493], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 25, max= 380, per=30.33%, avg=114.95, stdev=76.71, samples=107 iops : min= 1, max= 23, avg= 6.40, stdev= 4.82, samples=107 write: IOPS=6, BW=96.3KiB/s (98.6kB/s)(6032KiB/62615msec); 0 zone resets clat (msec): min=15, max=1775, avg=94.96, stdev=130.60 lat (msec): min=15, max=1775, avg=94.96, stdev=130.60 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 93], 80.00th=[ 110], 90.00th=[ 161], 95.00th=[ 253], | 99.00th=[ 776], 99.50th=[ 860], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 20, max= 351, per=27.55%, avg=109.93, stdev=68.00, samples=106 iops : min= 1, max= 21, avg= 6.08, stdev= 4.28, samples=106 lat (msec) : 10=0.13%, 20=7.29%, 50=38.67%, 100=33.46%, 250=16.02% lat (msec) : 500=3.65%, 750=0.13%, 1000=0.39%, 2000=0.26% cpu : usr=0.05%, sys=1.77%, ctx=1192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183719: Wed Jul 22 02:12:56 2026 read: IOPS=5, BW=95.6KiB/s (97.9kB/s)(6032KiB/63097msec) clat (msec): min=9, max=659, avg=62.50, stdev=71.42 lat (msec): min=9, max=659, avg=62.50, stdev=71.42 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 118], 95.00th=[ 188], | 99.00th=[ 376], 99.50th=[ 510], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 22, max= 383, per=30.27%, avg=114.74, stdev=78.95, samples=102 iops : min= 1, max= 23, avg= 6.38, stdev= 4.97, samples=102 write: IOPS=6, BW=99.1KiB/s (102kB/s)(6256KiB/63097msec); 0 zone resets clat (msec): min=12, max=1665, avg=100.65, stdev=148.81 lat (msec): min=12, max=1665, avg=100.66, stdev=148.81 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 41], | 30.00th=[ 49], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 77], | 70.00th=[ 92], 80.00th=[ 116], 90.00th=[ 159], 95.00th=[ 309], | 99.00th=[ 802], 99.50th=[ 1636], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 22, max= 319, per=27.91%, avg=111.35, stdev=70.38, samples=110 iops : min= 1, max= 19, avg= 6.19, stdev= 4.46, samples=110 lat (msec) : 10=0.26%, 20=7.81%, 50=38.15%, 100=33.33%, 250=15.63% lat (msec) : 500=3.65%, 750=0.65%, 1000=0.26%, 2000=0.26% cpu : usr=0.04%, sys=1.71%, ctx=1224, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=380KiB/s (389kB/s), 91.6KiB/s-99.9KiB/s (93.8kB/s-102kB/s), io=23.4MiB (24.5MB), run=62615-63097msec WRITE: bw=399KiB/s (409kB/s), 96.3KiB/s-104KiB/s (98.6kB/s-107kB/s), io=24.6MiB (25.8MB), run=62615-63097msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183744: Wed Jul 22 02:13:15 2026 read: IOPS=1, BW=1749KiB/s (1791kB/s)(7168KiB/4099msec) clat (usec): min=980, max=518302, avg=302182.42, stdev=171089.54 lat (usec): min=981, max=518303, avg=302183.85, stdev=171089.59 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 979], 10.00th=[ 979], 20.00th=[238027], | 30.00th=[248513], 40.00th=[248513], 50.00th=[270533], 60.00th=[383779], | 70.00th=[383779], 80.00th=[455082], 90.00th=[517997], 95.00th=[517997], | 99.00th=[517997], 99.50th=[517997], 99.90th=[517997], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 1756, max= 3065, per=54.08%, avg=2169.50, stdev=608.76, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1249KiB/s (1279kB/s)(5120KiB/4099msec); 0 zone resets clat (msec): min=82, max=919, avg=396.31, stdev=321.58 lat (msec): min=82, max=919, avg=396.39, stdev=321.59 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1822, max= 2011, per=34.72%, avg=1950.25, stdev=86.44, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=10.18%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183745: Wed Jul 22 02:13:15 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5021msec) clat (usec): min=695, max=912967, avg=456831.45, stdev=645073.91 lat (usec): min=696, max=912968, avg=456832.60, stdev=645073.40 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[910164], | 70.00th=[910164], 80.00th=[910164], 90.00th=[910164], 95.00th=[910164], | 99.00th=[910164], 99.50th=[910164], 99.90th=[910164], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 1984, max= 2035, per=50.09%, avg=2009.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2039KiB/s (2088kB/s)(10.0MiB/5021msec); 0 zone resets clat (msec): min=129, max=1010, avg=410.50, stdev=273.52 lat (msec): min=130, max=1010, avg=410.60, stdev=273.51 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 153], | 30.00th=[ 209], 40.00th=[ 251], 50.00th=[ 279], 60.00th=[ 426], | 70.00th=[ 481], 80.00th=[ 489], 90.00th=[ 684], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1822, max= 5953, per=52.47%, avg=2947.50, stdev=1669.67, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.97%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183746: Wed Jul 22 02:13:15 2026 read: IOPS=1, BW=1204KiB/s (1233kB/s)(6144KiB/5104msec) clat (usec): min=843, max=701168, avg=118780.79, stdev=285311.80 lat (usec): min=844, max=701169, avg=118782.17, stdev=285311.60 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[ 2212], | 30.00th=[ 2212], 40.00th=[ 2376], 50.00th=[ 2376], 60.00th=[ 2704], | 70.00th=[ 3392], 80.00th=[ 3392], 90.00th=[700449], 95.00th=[700449], | 99.00th=[700449], 99.50th=[700449], 99.90th=[700449], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 1822, max= 5873, per=80.64%, avg=3235.33, stdev=2286.24, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1204KiB/s (1233kB/s)(6144KiB/5104msec); 0 zone resets clat (msec): min=191, max=1606, avg=725.16, stdev=562.55 lat (msec): min=191, max=1609, avg=725.90, stdev=563.39 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 818], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1822, max= 4071, per=58.20%, avg=3269.33, stdev=1255.85, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=33.33%, 250=8.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=6.78%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183747: Wed Jul 22 02:13:15 2026 read: IOPS=1, BW=1248KiB/s (1278kB/s)(5120KiB/4103msec) clat (usec): min=489, max=240659, avg=87713.60, stdev=119497.92 lat (usec): min=490, max=240659, avg=87714.88, stdev=119497.47 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 963], 40.00th=[ 963], 50.00th=[ 2376], 60.00th=[ 2376], | 70.00th=[193987], 80.00th=[193987], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7288, max= 7288, per=100.00%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1747KiB/s (1789kB/s)(7168KiB/4103msec); 0 zone resets clat (msec): min=270, max=1278, avg=522.92, stdev=352.34 lat (msec): min=270, max=1278, avg=523.00, stdev=352.33 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 296], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 409], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 584], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1675, max= 2011, per=33.33%, avg=1872.00, stdev=140.84, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.07%, sys=11.68%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4013KiB/s (4109kB/s), 408KiB/s-1749KiB/s (418kB/s-1791kB/s), io=20.0MiB (20.0MB), run=4099-5104msec WRITE: bw=5618KiB/s (5752kB/s), 1204KiB/s-2039KiB/s (1233kB/s-2088kB/s), io=28.0MiB (29.4MB), run=4099-5104msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183739: Wed Jul 22 02:13:16 2026 read: IOPS=1, BW=1652KiB/s (1692kB/s)(7168KiB/4339msec) clat (msec): min=122, max=658, avg=319.21, stdev=215.77 lat (msec): min=122, max=658, avg=319.22, stdev=215.77 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 140], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 203], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 531], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1756, max= 2035, per=58.90%, avg=1929.00, stdev=131.17, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1180KiB/s (1208kB/s)(5120KiB/4339msec); 0 zone resets clat (msec): min=185, max=943, avg=378.26, stdev=319.45 lat (msec): min=185, max=943, avg=378.35, stdev=319.44 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1756, max= 4071, per=53.52%, avg=2453.75, stdev=1083.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.78%, ctx=54, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183740: Wed Jul 22 02:13:16 2026 read: IOPS=0, BW=333KiB/s (341kB/s)(2048KiB/6154msec) clat (msec): min=217, max=264, avg=241.33, stdev=33.03 lat (msec): min=217, max=264, avg=241.33, stdev=33.03 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 1796, max= 2035, per=58.49%, avg=1915.50, stdev=169.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1664KiB/s (1704kB/s)(10.0MiB/6154msec); 0 zone resets clat (msec): min=130, max=1211, avg=547.10, stdev=404.89 lat (msec): min=131, max=1211, avg=547.23, stdev=404.88 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 150], | 30.00th=[ 232], 40.00th=[ 279], 50.00th=[ 363], 60.00th=[ 460], | 70.00th=[ 600], 80.00th=[ 894], 90.00th=[ 1150], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1957, max= 5466, per=56.22%, avg=2577.50, stdev=1415.33, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=4.42%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183741: Wed Jul 22 02:13:16 2026 read: IOPS=0, BW=983KiB/s (1006kB/s)(6144KiB/6253msec) clat (msec): min=82, max=816, avg=288.13, stdev=274.57 lat (msec): min=82, max=816, avg=288.13, stdev=274.57 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 249], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1992, max= 4047, per=82.22%, avg=2692.67, stdev=1173.12, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=983KiB/s (1006kB/s)(6144KiB/6253msec); 0 zone resets clat (msec): min=121, max=1524, avg=733.94, stdev=655.39 lat (msec): min=121, max=1525, avg=734.21, stdev=655.64 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 911], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1359, max= 2027, per=40.07%, avg=1837.40, stdev=290.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 1000=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.19%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183742: Wed Jul 22 02:13:16 2026 read: IOPS=0, BW=999KiB/s (1023kB/s)(5120KiB/5126msec) clat (msec): min=139, max=581, avg=345.53, stdev=194.85 lat (msec): min=139, max=581, avg=345.53, stdev=194.85 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1822, max= 3512, per=74.56%, avg=2442.00, stdev=930.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1398KiB/s (1432kB/s)(7168KiB/5126msec); 0 zone resets clat (msec): min=206, max=800, avg=476.34, stdev=236.02 lat (msec): min=206, max=800, avg=476.43, stdev=236.02 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 213], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 514], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 726], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1957, max= 3574, per=50.50%, avg=2315.40, stdev=704.17, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=16.67%, 750=41.67%, 1000=8.33% cpu : usr=0.00%, sys=4.41%, ctx=113, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3275KiB/s (3354kB/s), 333KiB/s-1652KiB/s (341kB/s-1692kB/s), io=20.0MiB (20.0MB), run=4339-6253msec WRITE: bw=4585KiB/s (4695kB/s), 983KiB/s-1664KiB/s (1006kB/s-1704kB/s), io=28.0MiB (29.4MB), run=4339-6253msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183754: Wed Jul 22 02:13:29 2026 read: IOPS=1, BW=5148KiB/s (5271kB/s)(12.0MiB/2387msec) clat (msec): min=738, max=811, avg=775.37, stdev=36.58 lat (msec): min=738, max=811, avg=775.38, stdev=36.58 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7922, max= 8110, per=100.00%, avg=8016.00, stdev=132.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.41%, ctx=327, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183755: Wed Jul 22 02:13:29 2026 read: IOPS=0, BW=1622KiB/s (1660kB/s)(4096KiB/2526msec) clat (nsec): min=816898k, max=816898k, avg=816897621.00, stdev= 0.00 lat (nsec): min=816900k, max=816900k, avg=816900286.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3243KiB/s (3321kB/s)(8192KiB/2526msec); 0 zone resets clat (msec): min=678, max=950, avg=814.58, stdev=192.63 lat (msec): min=680, max=951, avg=815.84, stdev=191.43 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7922, max= 7922, per=61.07%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.39%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183756: Wed Jul 22 02:13:29 2026 write: IOPS=1, BW=5756KiB/s (5894kB/s)(12.0MiB/2135msec); 0 zone resets clat (msec): min=460, max=950, avg=666.16, stdev=254.35 lat (msec): min=462, max=951, avg=666.98, stdev=254.23 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.70%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183758: Wed Jul 22 02:13:29 2026 write: IOPS=1, BW=6135KiB/s (6282kB/s)(12.0MiB/2003msec); 0 zone resets clat (msec): min=257, max=1352, avg=651.82, stdev=608.70 lat (msec): min=257, max=1353, avg=654.03, stdev=607.40 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 6703, max= 8143, per=57.22%, avg=7423.00, stdev=1018.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=5.14%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6486KiB/s (6642kB/s), 1622KiB/s-5148KiB/s (1660kB/s-5271kB/s), io=16.0MiB (16.8MB), run=2387-2526msec WRITE: bw=12.7MiB/s (13.3MB/s), 3243KiB/s-6135KiB/s (3321kB/s-6282kB/s), io=32.0MiB (33.6MB), run=2003-2526msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183757: Wed Jul 22 02:13:29 2026 read: IOPS=1, BW=4370KiB/s (4475kB/s)(12.0MiB/2812msec) clat (msec): min=770, max=1141, avg=911.09, stdev=201.22 lat (msec): min=770, max=1141, avg=911.09, stdev=201.22 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183759: Wed Jul 22 02:13:29 2026 read: IOPS=0, BW=1464KiB/s (1500kB/s)(4096KiB/2797msec) clat (nsec): min=1331.6M, max=1331.6M, avg=1331634185.00, stdev= 0.00 lat (nsec): min=1331.6M, max=1331.6M, avg=1331637423.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2929KiB/s (2999kB/s)(8192KiB/2797msec); 0 zone resets clat (msec): min=261, max=1132, avg=696.82, stdev=615.87 lat (msec): min=262, max=1136, avg=699.52, stdev=618.46 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8000, max= 8000, per=73.78%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.86%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183760: Wed Jul 22 02:13:29 2026 write: IOPS=0, BW=4066KiB/s (4164kB/s)(12.0MiB/3022msec); 0 zone resets clat (msec): min=387, max=2027, avg=988.88, stdev=903.40 lat (msec): min=388, max=2028, avg=990.13, stdev=902.80 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8000, max= 8078, per=74.14%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.77%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183761: Wed Jul 22 02:13:29 2026 write: IOPS=1, BW=4594KiB/s (4704kB/s)(12.0MiB/2675msec); 0 zone resets clat (msec): min=605, max=1100, avg=865.83, stdev=248.58 lat (msec): min=605, max=1100, avg=866.31, stdev=248.66 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7846, max= 8159, per=73.80%, avg=8002.50, stdev=221.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.63%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5826KiB/s (5966kB/s), 1464KiB/s-4370KiB/s (1500kB/s-4475kB/s), io=16.0MiB (16.8MB), run=2797-2812msec WRITE: bw=10.6MiB/s (11.1MB/s), 2929KiB/s-4594KiB/s (2999kB/s-4704kB/s), io=32.0MiB (33.6MB), run=2675-3022msec