== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:52:38 (1784173958) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=0 llite.lustre-ffff988d909ba800.statahead_max=32 llite.lustre-ffff988d909ba800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.73 seconds: 136.28 ops/second llite.lustre-ffff988d909ba800.statahead_max=0 101 real 0m0.656s user 0m0.002s sys 0m0.239s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff988d909ba800.statahead_max=32 llite.lustre-ffff988d909ba800.statahead_max=32 101 real 0m0.548s user 0m0.006s sys 0m0.316s 'ls -l' 100 files with statahead: 1 sec statahead total: 107 statahead wrong: 2 agl total: 102 list_total: 29 fname_total: 78 hit_total: 3880 miss_total: 615 swrong=2 ewrong=2 total: 900 open/close in 1.98 seconds: 455.28 ops/second llite.lustre-ffff988d909ba800.statahead_max=0 1001 real 0m7.108s user 0m0.018s sys 0m2.623s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff988d909ba800.statahead_max=32 llite.lustre-ffff988d909ba800.statahead_max=32 1001 real 0m4.398s user 0m0.013s sys 0m1.909s 'ls -l' 1000 files with statahead: 5 sec statahead total: 108 statahead wrong: 2 agl total: 103 list_total: 30 fname_total: 78 hit_total: 4879 miss_total: 616 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff988d909ba800.statahead_stats= statahead total: 108 statahead wrong: 2 agl total: 103 list_total: 30 fname_total: 78 hit_total: 4879 miss_total: 616 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784173990.481710828 secs.nsecs start_time: 1784173960.244338047 secs.nsecs elapsed_time: 30.237372781 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 0 0 5 4: 3 7 12 8: 1 2 15 16: 23 57 72 32: 11 27 100 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784173990.481912981 secs.nsecs start_time: 1784173960.244398731 secs.nsecs elapsed_time: 30.237514250 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 5 12 20 16: 15 37 57 32: 17 42 100 - open/close 3163 (time 1784174001.53 total 10.00 last 316.23) - open/close 6390 (time 1784174011.54 total 20.01 last 322.58) - open/close 9216 (time 1784174021.54 total 30.01 last 282.57) total: 10000 open/close in 32.20 seconds: 310.57 ops/second llite.lustre-ffff988d909ba800.statahead_batch_max=0 llite.lustre-ffff988d909ba800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.779s user 0m0.129s sys 0m43.314s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff988d909ba800.statahead_batch_max=32 llite.lustre-ffff988d909ba800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.315s user 0m0.133s sys 0m23.563s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174132.781150704 secs.nsecs start_time: 1784174073.151374577 secs.nsecs elapsed_time: 59.629776127 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174132.781207547 secs.nsecs start_time: 1784174073.151469533 secs.nsecs elapsed_time: 59.629738014 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=0 llite.lustre-ffff988d909ba800.statahead_max=2048 llite.lustre-ffff988d909ba800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.42 seconds: 70.18 ops/second llite.lustre-ffff988d909ba800.statahead_max=0 101 real 0m1.151s user 0m0.010s sys 0m0.385s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff988d909ba800.statahead_max=2048 llite.lustre-ffff988d909ba800.statahead_max=2048 101 real 0m0.619s user 0m0.002s sys 0m0.239s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 4.44 seconds: 202.50 ops/second llite.lustre-ffff988d909ba800.statahead_max=0 1001 real 0m10.974s user 0m0.030s sys 0m3.568s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff988d909ba800.statahead_max=2048 llite.lustre-ffff988d909ba800.statahead_max=2048 1001 real 0m4.600s user 0m0.014s sys 0m1.320s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff988d909ba800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174325.147580910 secs.nsecs start_time: 1784174133.917236085 secs.nsecs elapsed_time: 191.230344825 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 28 28 8: 2 28 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174325.147686193 secs.nsecs start_time: 1784174133.917351672 secs.nsecs elapsed_time: 191.230334521 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 14 14 4: 2 28 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 2053 (time 1784174336.64 total 10.00 last 205.23) - open/close 4136 (time 1784174346.64 total 20.01 last 208.22) - open/close 6229 (time 1784174356.64 total 30.01 last 209.29) - open/close 8297 (time 1784174366.64 total 40.01 last 206.74) total: 10000 open/close in 47.95 seconds: 208.57 ops/second llite.lustre-ffff988d909ba800.statahead_batch_max=0 llite.lustre-ffff988d909ba800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.543s user 0m0.153s sys 0m47.930s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff988d909ba800.statahead_batch_max=256 llite.lustre-ffff988d909ba800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff988d909ba800.stats=clear mdc.lustre-MDT0001-mdc-ffff988d909ba800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.979s user 0m0.116s sys 0m30.482s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174486.749161348 secs.nsecs start_time: 1784174433.972890489 secs.nsecs elapsed_time: 52.776270859 secs.nsecs subreqs per batch batches %% cum %% 1: 480 74 74 2: 84 12 87 4: 22 3 90 8: 2 0 90 16: 2 0 91 32: 24 3 94 64: 0 0 94 128: 0 0 94 256: 34 5 100 mdc.lustre-MDT0001-mdc-ffff988d909ba800.batch_stats= snapshot_time: 1784174486.749288935 secs.nsecs start_time: 1784174433.972960320 secs.nsecs elapsed_time: 52.776328615 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff988d909ba800.statahead_batch_max=64 llite.lustre-ffff988d909ba800.statahead_max=128