== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:44:42 (1786571082) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=0 llite.lustre-ffff8cdd92a8a800.statahead_max=32 llite.lustre-ffff8cdd92a8a800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.00 seconds: 100.21 ops/second llite.lustre-ffff8cdd92a8a800.statahead_max=0 101 real 0m0.911s user 0m0.010s sys 0m0.300s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8cdd92a8a800.statahead_max=32 llite.lustre-ffff8cdd92a8a800.statahead_max=32 101 real 0m0.512s user 0m0.003s sys 0m0.335s 'ls -l' 100 files with statahead: 0 sec statahead total: 101 statahead wrong: 2 agl total: 97 list_total: 30 fname_total: 71 hit_total: 3990 miss_total: 1597 swrong=2 ewrong=2 total: 900 open/close in 3.05 seconds: 295.49 ops/second llite.lustre-ffff8cdd92a8a800.statahead_max=0 1001 real 0m8.463s user 0m0.032s sys 0m2.788s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff8cdd92a8a800.statahead_max=32 llite.lustre-ffff8cdd92a8a800.statahead_max=32 1001 real 0m4.194s user 0m0.018s sys 0m1.850s 'ls -l' 1000 files with statahead: 4 sec statahead total: 102 statahead wrong: 2 agl total: 98 list_total: 31 fname_total: 71 hit_total: 4988 miss_total: 1599 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8cdd92a8a800.statahead_stats= statahead total: 102 statahead wrong: 2 agl total: 98 list_total: 31 fname_total: 71 hit_total: 4988 miss_total: 1599 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571115.237808436 secs.nsecs start_time: 1786571083.532358971 secs.nsecs elapsed_time: 31.705449465 secs.nsecs subreqs per batch batches %% cum %% 1: 4 10 10 2: 1 2 13 4: 2 5 18 8: 1 2 21 16: 25 65 86 32: 5 13 100 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571115.238310934 secs.nsecs start_time: 1786571083.532438620 secs.nsecs elapsed_time: 31.705872314 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 0 0 5 4: 0 0 5 8: 4 10 15 16: 8 20 35 32: 26 65 100 - open/close 3219 (time 1786571126.22 total 10.00 last 321.89) - open/close 6195 (time 1786571136.22 total 20.00 last 297.51) - open/close 9124 (time 1786571146.22 total 30.00 last 292.87) total: 10000 open/close in 33.68 seconds: 296.95 ops/second llite.lustre-ffff8cdd92a8a800.statahead_batch_max=0 llite.lustre-ffff8cdd92a8a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.999s user 0m0.232s sys 0m30.834s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cdd92a8a800.statahead_batch_max=32 llite.lustre-ffff8cdd92a8a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.609s user 0m0.179s sys 0m20.887s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571230.641057124 secs.nsecs start_time: 1786571186.488948891 secs.nsecs elapsed_time: 44.152108233 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571230.641118207 secs.nsecs start_time: 1786571186.489037376 secs.nsecs elapsed_time: 44.152080831 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=0 llite.lustre-ffff8cdd92a8a800.statahead_max=2048 llite.lustre-ffff8cdd92a8a800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.83 seconds: 119.98 ops/second llite.lustre-ffff8cdd92a8a800.statahead_max=0 101 real 0m0.732s user 0m0.005s sys 0m0.276s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff8cdd92a8a800.statahead_max=2048 llite.lustre-ffff8cdd92a8a800.statahead_max=2048 101 real 0m0.394s user 0m0.004s sys 0m0.234s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 2.73 seconds: 329.43 ops/second llite.lustre-ffff8cdd92a8a800.statahead_max=0 1001 real 0m7.039s user 0m0.031s sys 0m2.576s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8cdd92a8a800.statahead_max=2048 llite.lustre-ffff8cdd92a8a800.statahead_max=2048 1001 real 0m3.218s user 0m0.016s sys 0m1.910s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8cdd92a8a800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571357.534247112 secs.nsecs start_time: 1786571231.553194103 secs.nsecs elapsed_time: 125.981053009 secs.nsecs subreqs per batch batches %% cum %% 1: 1 16 16 2: 0 0 16 4: 3 50 66 8: 0 0 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571357.534305216 secs.nsecs start_time: 1786571231.553326398 secs.nsecs elapsed_time: 125.980978818 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 4 50 50 16: 0 0 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 3412 (time 1786571368.46 total 10.00 last 341.13) - open/close 7531 (time 1786571378.46 total 20.00 last 411.85) total: 10000 open/close in 25.40 seconds: 393.65 ops/second llite.lustre-ffff8cdd92a8a800.statahead_batch_max=0 llite.lustre-ffff8cdd92a8a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.165s user 0m0.209s sys 0m24.497s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cdd92a8a800.statahead_batch_max=256 llite.lustre-ffff8cdd92a8a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.416s user 0m0.226s sys 0m17.896s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571472.250589717 secs.nsecs start_time: 1786571422.966502389 secs.nsecs elapsed_time: 49.284087328 secs.nsecs subreqs per batch batches %% cum %% 1: 229 58 58 2: 48 12 71 4: 34 8 79 8: 10 2 82 16: 13 3 85 32: 14 3 89 64: 7 1 91 128: 1 0 91 256: 34 8 100 mdc.lustre-MDT0001-mdc-ffff8cdd92a8a800.batch_stats= snapshot_time: 1786571472.250671327 secs.nsecs start_time: 1786571422.966642111 secs.nsecs elapsed_time: 49.284029216 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8cdd92a8a800.statahead_batch_max=64 llite.lustre-ffff8cdd92a8a800.statahead_max=128