== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:22:21 (1786468941) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=0 llite.lustre-ffff89a42f030000.statahead_max=32 llite.lustre-ffff89a42f030000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.63 seconds: 157.96 ops/second llite.lustre-ffff89a42f030000.statahead_max=0 101 real 0m0.605s user 0m0.002s sys 0m0.241s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff89a42f030000.statahead_max=32 llite.lustre-ffff89a42f030000.statahead_max=32 101 real 0m0.405s user 0m0.002s sys 0m0.207s 'ls -l' 100 files with statahead: 0 sec statahead total: 98 statahead wrong: 2 agl total: 94 list_total: 30 fname_total: 68 hit_total: 4113 miss_total: 1471 swrong=2 ewrong=2 total: 900 open/close in 1.96 seconds: 458.09 ops/second llite.lustre-ffff89a42f030000.statahead_max=0 1001 real 0m5.899s user 0m0.022s sys 0m2.309s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff89a42f030000.statahead_max=32 llite.lustre-ffff89a42f030000.statahead_max=32 1001 real 0m3.824s user 0m0.013s sys 0m1.905s 'ls -l' 1000 files with statahead: 4 sec statahead total: 99 statahead wrong: 2 agl total: 95 list_total: 31 fname_total: 68 hit_total: 5112 miss_total: 1472 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff89a42f030000.statahead_stats= statahead total: 99 statahead wrong: 2 agl total: 95 list_total: 31 fname_total: 68 hit_total: 5112 miss_total: 1472 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786468967.084959849 secs.nsecs start_time: 1786468943.220287433 secs.nsecs elapsed_time: 23.864672416 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 3 7 10 8: 2 5 15 16: 19 48 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786468967.085049236 secs.nsecs start_time: 1786468943.220353117 secs.nsecs elapsed_time: 23.864696119 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 4 10 10 8: 2 5 15 16: 22 56 71 32: 11 28 100 - open/close 4265 (time 1786468978.23 total 10.00 last 426.42) - open/close 9099 (time 1786468988.23 total 20.00 last 483.33) total: 10000 open/close in 21.78 seconds: 459.23 ops/second llite.lustre-ffff89a42f030000.statahead_batch_max=0 llite.lustre-ffff89a42f030000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.052s user 0m0.160s sys 0m31.761s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89a42f030000.statahead_batch_max=32 llite.lustre-ffff89a42f030000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.644s user 0m0.176s sys 0m21.624s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469069.434123680 secs.nsecs start_time: 1786469026.050053053 secs.nsecs elapsed_time: 43.384070627 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469069.434188012 secs.nsecs start_time: 1786469026.050100806 secs.nsecs elapsed_time: 43.384087206 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=0 llite.lustre-ffff89a42f030000.statahead_max=2048 llite.lustre-ffff89a42f030000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.28 seconds: 77.83 ops/second llite.lustre-ffff89a42f030000.statahead_max=0 101 real 0m1.252s user 0m0.007s sys 0m0.302s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff89a42f030000.statahead_max=2048 llite.lustre-ffff89a42f030000.statahead_max=2048 101 real 0m0.483s user 0m0.002s sys 0m0.171s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 4.70 seconds: 191.36 ops/second llite.lustre-ffff89a42f030000.statahead_max=0 1001 real 0m9.841s user 0m0.032s sys 0m2.795s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff89a42f030000.statahead_max=2048 llite.lustre-ffff89a42f030000.statahead_max=2048 1001 real 0m3.425s user 0m0.024s sys 0m1.395s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff89a42f030000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469245.050267679 secs.nsecs start_time: 1786469070.237142835 secs.nsecs elapsed_time: 174.813124844 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 20 20 4: 0 0 20 8: 2 40 60 16: 0 0 60 32: 0 0 60 64: 0 0 60 128: 0 0 60 256: 2 40 100 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469245.050317069 secs.nsecs start_time: 1786469070.237268935 secs.nsecs elapsed_time: 174.813048134 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 12 12 8: 2 25 37 16: 1 12 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 1586 (time 1786469256.46 total 10.01 last 158.51) - open/close 3261 (time 1786469266.46 total 20.01 last 167.44) - open/close 5024 (time 1786469276.46 total 30.01 last 176.28) - open/close 7092 (time 1786469286.46 total 40.01 last 206.77) - open/close 9016 (time 1786469296.47 total 50.02 last 192.33) total: 10000 open/close in 55.26 seconds: 180.95 ops/second llite.lustre-ffff89a42f030000.statahead_batch_max=0 llite.lustre-ffff89a42f030000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.295s user 0m0.251s sys 0m26.147s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89a42f030000.statahead_batch_max=256 llite.lustre-ffff89a42f030000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89a42f030000.stats=clear mdc.lustre-MDT0001-mdc-ffff89a42f030000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.432s user 0m0.198s sys 0m20.050s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469375.390441628 secs.nsecs start_time: 1786469338.534585674 secs.nsecs elapsed_time: 36.855855954 secs.nsecs subreqs per batch batches %% cum %% 1: 309 65 65 2: 50 10 75 4: 39 8 84 8: 13 2 86 16: 7 1 88 32: 18 3 92 64: 2 0 92 128: 1 0 92 256: 34 7 100 mdc.lustre-MDT0001-mdc-ffff89a42f030000.batch_stats= snapshot_time: 1786469375.390515413 secs.nsecs start_time: 1786469338.534665453 secs.nsecs elapsed_time: 36.855849960 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff89a42f030000.statahead_batch_max=64 llite.lustre-ffff89a42f030000.statahead_max=128