== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:59:53 (1782633593) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=0 llite.lustre-ffff97a19016d000.statahead_max=32 llite.lustre-ffff97a19016d000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.57 seconds: 174.93 ops/second llite.lustre-ffff97a19016d000.statahead_max=0 101 real 0m0.586s user 0m0.003s sys 0m0.214s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff97a19016d000.statahead_max=32 llite.lustre-ffff97a19016d000.statahead_max=32 101 real 0m0.408s user 0m0.004s sys 0m0.199s 'ls -l' 100 files with statahead: 1 sec statahead total: 55 statahead wrong: 2 agl total: 51 list_total: 27 fname_total: 28 hit_total: 14377 miss_total: 1237 swrong=2 ewrong=2 total: 900 open/close in 1.94 seconds: 463.04 ops/second llite.lustre-ffff97a19016d000.statahead_max=0 1001 real 0m5.506s user 0m0.018s sys 0m1.966s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff97a19016d000.statahead_max=32 llite.lustre-ffff97a19016d000.statahead_max=32 1001 real 0m3.996s user 0m0.013s sys 0m1.761s 'ls -l' 1000 files with statahead: 4 sec statahead total: 56 statahead wrong: 2 agl total: 52 list_total: 28 fname_total: 28 hit_total: 15376 miss_total: 1238 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff97a19016d000.statahead_stats= statahead total: 56 statahead wrong: 2 agl total: 52 list_total: 28 fname_total: 28 hit_total: 15376 miss_total: 1238 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782633618.174929686 secs.nsecs start_time: 1782633594.759363908 secs.nsecs elapsed_time: 23.415565778 secs.nsecs subreqs per batch batches %% cum %% 1: 6 15 15 2: 2 5 20 4: 0 0 20 8: 0 0 20 16: 26 66 87 32: 5 12 100 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782633618.175045122 secs.nsecs start_time: 1782633594.759419118 secs.nsecs elapsed_time: 23.415626004 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 4 10 12 16: 10 25 38 32: 24 61 100 - open/close 4766 (time 1782633629.20 total 10.00 last 476.59) - open/close 9554 (time 1782633639.21 total 20.00 last 478.77) total: 10000 open/close in 20.92 seconds: 477.99 ops/second llite.lustre-ffff97a19016d000.statahead_batch_max=0 llite.lustre-ffff97a19016d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.521s user 0m0.137s sys 0m35.455s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97a19016d000.statahead_batch_max=32 llite.lustre-ffff97a19016d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.655s user 0m0.147s sys 0m22.359s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782633726.494519519 secs.nsecs start_time: 1782633681.588698345 secs.nsecs elapsed_time: 44.905821174 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782633726.494576012 secs.nsecs start_time: 1782633681.588744642 secs.nsecs elapsed_time: 44.905831370 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=0 llite.lustre-ffff97a19016d000.statahead_max=2048 llite.lustre-ffff97a19016d000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.62 seconds: 160.93 ops/second llite.lustre-ffff97a19016d000.statahead_max=0 101 real 0m0.592s user 0m0.006s sys 0m0.223s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff97a19016d000.statahead_max=2048 llite.lustre-ffff97a19016d000.statahead_max=2048 101 real 0m0.478s user 0m0.002s sys 0m0.194s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.86 seconds: 483.22 ops/second llite.lustre-ffff97a19016d000.statahead_max=0 1001 real 0m5.621s user 0m0.014s sys 0m2.105s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff97a19016d000.statahead_max=2048 llite.lustre-ffff97a19016d000.statahead_max=2048 1001 real 0m3.482s user 0m0.007s sys 0m1.534s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 - open/close 4790 (time 1782633837.62 total 10.00 last 478.92) total: 9000 open/close in 18.75 seconds: 479.90 ops/second llite.lustre-ffff97a19016d000.statahead_max=0 10001 real 0m56.950s user 0m0.157s sys 0m20.881s 'ls -l' 10000 files without statahead: 57 sec llite.lustre-ffff97a19016d000.statahead_max=2048 llite.lustre-ffff97a19016d000.statahead_max=2048 10001 real 0m30.000s user 0m0.143s sys 0m21.065s 'ls -l' 10000 files with statahead: 30 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 65 seconds llite.lustre-ffff97a19016d000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782634012.756351484 secs.nsecs start_time: 1782633727.295623286 secs.nsecs elapsed_time: 285.460728198 secs.nsecs subreqs per batch batches %% cum %% 1: 197 71 71 2: 31 11 82 4: 9 3 85 8: 5 1 87 16: 1 0 87 32: 1 0 88 64: 1 0 88 128: 3 1 89 256: 29 10 100 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782634012.756418851 secs.nsecs start_time: 1782633727.295780777 secs.nsecs elapsed_time: 285.460638074 secs.nsecs subreqs per batch batches %% cum %% 1: 195 73 73 2: 20 7 80 4: 14 5 85 8: 5 1 87 16: 0 0 87 32: 0 0 87 64: 1 0 88 128: 1 0 88 256: 31 11 100 - open/close 4820 (time 1782634023.48 total 10.00 last 481.91) - open/close 9707 (time 1782634033.48 total 20.00 last 488.68) total: 10000 open/close in 20.59 seconds: 485.67 ops/second llite.lustre-ffff97a19016d000.statahead_batch_max=0 llite.lustre-ffff97a19016d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.873s user 0m0.139s sys 0m36.063s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97a19016d000.statahead_batch_max=256 llite.lustre-ffff97a19016d000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97a19016d000.stats=clear mdc.lustre-MDT0001-mdc-ffff97a19016d000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.312s user 0m0.123s sys 0m20.875s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782634115.926319208 secs.nsecs start_time: 1782634080.659387194 secs.nsecs elapsed_time: 35.266932014 secs.nsecs subreqs per batch batches %% cum %% 1: 395 66 66 2: 88 14 81 4: 39 6 88 8: 9 1 89 16: 4 0 90 32: 17 2 93 64: 5 0 94 128: 0 0 94 256: 34 5 100 mdc.lustre-MDT0001-mdc-ffff97a19016d000.batch_stats= snapshot_time: 1782634115.926360831 secs.nsecs start_time: 1782634080.659440003 secs.nsecs elapsed_time: 35.266920828 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff97a19016d000.statahead_batch_max=64 llite.lustre-ffff97a19016d000.statahead_max=128