== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:40:45 (1784126445) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=0 llite.lustre-ffff9951d8209800.statahead_max=32 llite.lustre-ffff9951d8209800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=0 total: 100 open/close in 0.80 seconds: 124.53 ops/second llite.lustre-ffff9951d8209800.statahead_max=0 101 real 0m0.797s user 0m0.007s sys 0m0.279s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9951d8209800.statahead_max=32 llite.lustre-ffff9951d8209800.statahead_max=32 101 real 0m0.422s user 0m0.004s sys 0m0.251s 'ls -l' 100 files with statahead: 0 sec statahead total: 56 statahead wrong: 1 agl total: 53 list_total: 24 fname_total: 32 hit_total: 4206 miss_total: 204 swrong=1 ewrong=1 total: 900 open/close in 4.45 seconds: 202.45 ops/second llite.lustre-ffff9951d8209800.statahead_max=0 1001 real 0m10.018s user 0m0.038s sys 0m2.913s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff9951d8209800.statahead_max=32 llite.lustre-ffff9951d8209800.statahead_max=32 1001 real 0m4.140s user 0m0.018s sys 0m2.119s 'ls -l' 1000 files with statahead: 5 sec statahead total: 57 statahead wrong: 1 agl total: 54 list_total: 25 fname_total: 32 hit_total: 5205 miss_total: 205 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9951d8209800.statahead_stats= statahead total: 57 statahead wrong: 1 agl total: 54 list_total: 25 fname_total: 32 hit_total: 5205 miss_total: 205 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats= snapshot_time: 1784126480.747663769 secs.nsecs start_time: 1784126446.684373972 secs.nsecs elapsed_time: 34.063289797 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 1825 (time 1784126491.75 total 10.01 last 182.26) - open/close 3712 (time 1784126501.75 total 20.02 last 188.64) - open/close 5846 (time 1784126511.75 total 30.02 last 213.36) - open/close 8173 (time 1784126521.75 total 40.02 last 232.63) total: 10000 open/close in 46.22 seconds: 216.38 ops/second llite.lustre-ffff9951d8209800.statahead_batch_max=0 llite.lustre-ffff9951d8209800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.843s user 0m0.257s sys 0m33.145s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9951d8209800.statahead_batch_max=32 llite.lustre-ffff9951d8209800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.879s user 0m0.186s sys 0m21.589s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats= snapshot_time: 1784126612.506025387 secs.nsecs start_time: 1784126567.171206935 secs.nsecs elapsed_time: 45.334818452 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=0 llite.lustre-ffff9951d8209800.statahead_max=2048 llite.lustre-ffff9951d8209800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=0 total: 100 open/close in 1.18 seconds: 84.66 ops/second llite.lustre-ffff9951d8209800.statahead_max=0 101 real 0m0.851s user 0m0.008s sys 0m0.297s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9951d8209800.statahead_max=2048 llite.lustre-ffff9951d8209800.statahead_max=2048 101 real 0m0.484s user 0m0.007s sys 0m0.405s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 3.06 seconds: 294.03 ops/second llite.lustre-ffff9951d8209800.statahead_max=0 1001 real 0m8.129s user 0m0.030s sys 0m2.811s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff9951d8209800.statahead_max=2048 llite.lustre-ffff9951d8209800.statahead_max=2048 1001 real 0m3.330s user 0m0.017s sys 0m1.866s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff9951d8209800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats= snapshot_time: 1784126751.245463455 secs.nsecs start_time: 1784126613.332214919 secs.nsecs elapsed_time: 137.913248536 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 2888 (time 1784126762.11 total 10.00 last 288.78) - open/close 5681 (time 1784126772.11 total 20.00 last 279.28) - open/close 9197 (time 1784126782.11 total 30.00 last 351.54) total: 10000 open/close in 32.55 seconds: 307.23 ops/second llite.lustre-ffff9951d8209800.statahead_batch_max=0 llite.lustre-ffff9951d8209800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.968s user 0m0.198s sys 0m28.941s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9951d8209800.statahead_batch_max=256 llite.lustre-ffff9951d8209800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9951d8209800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.992s user 0m0.169s sys 0m20.664s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9951d8209800.batch_stats= snapshot_time: 1784126857.876775150 secs.nsecs start_time: 1784126822.764660437 secs.nsecs elapsed_time: 35.112114713 secs.nsecs subreqs per batch batches %% cum %% 1: 274 58 58 2: 59 12 71 4: 52 11 82 8: 20 4 86 16: 5 1 87 32: 24 5 92 64: 0 0 92 128: 1 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9951d8209800.statahead_batch_max=64 llite.lustre-ffff9951d8209800.statahead_max=128