== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:03:49 (1784282629) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=0 llite.lustre-ffff900dc45e2000.statahead_max=32 llite.lustre-ffff900dc45e2000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=0 total: 100 open/close in 0.74 seconds: 134.82 ops/second llite.lustre-ffff900dc45e2000.statahead_max=0 101 real 0m0.651s user 0m0.004s sys 0m0.253s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff900dc45e2000.statahead_max=32 llite.lustre-ffff900dc45e2000.statahead_max=32 101 real 0m0.391s user 0m0.000s sys 0m0.200s 'ls -l' 100 files with statahead: 0 sec statahead total: 119 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 81 hit_total: 4588 miss_total: 773 swrong=2 ewrong=2 total: 900 open/close in 2.70 seconds: 333.87 ops/second llite.lustre-ffff900dc45e2000.statahead_max=0 1001 real 0m5.895s user 0m0.026s sys 0m2.233s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff900dc45e2000.statahead_max=32 llite.lustre-ffff900dc45e2000.statahead_max=32 1001 real 0m3.598s user 0m0.012s sys 0m1.933s 'ls -l' 1000 files with statahead: 4 sec statahead total: 120 statahead wrong: 2 agl total: 115 list_total: 31 fname_total: 81 hit_total: 5587 miss_total: 774 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff900dc45e2000.statahead_stats= statahead total: 120 statahead wrong: 2 agl total: 115 list_total: 31 fname_total: 81 hit_total: 5587 miss_total: 774 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats= snapshot_time: 1784282655.874731692 secs.nsecs start_time: 1784282631.174383368 secs.nsecs elapsed_time: 24.700348324 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 3129 (time 1784282667.33 total 10.01 last 312.60) - open/close 4469 (time 1784282677.34 total 20.01 last 133.96) - open/close 5823 (time 1784282687.34 total 30.02 last 135.31) - open/close 7026 (time 1784282697.36 total 40.03 last 120.15) - open/close 7943 (time 1784282707.36 total 50.04 last 91.63) - open/close 9541 (time 1784282717.36 total 60.04 last 159.79) total: 10000 open/close in 62.86 seconds: 159.08 ops/second llite.lustre-ffff900dc45e2000.statahead_batch_max=0 llite.lustre-ffff900dc45e2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.687s user 0m0.267s sys 0m22.384s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff900dc45e2000.statahead_batch_max=32 llite.lustre-ffff900dc45e2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.810s user 0m0.212s sys 0m16.916s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats= snapshot_time: 1784282814.136043450 secs.nsecs start_time: 1784282759.929981073 secs.nsecs elapsed_time: 54.206062377 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=0 llite.lustre-ffff900dc45e2000.statahead_max=2048 llite.lustre-ffff900dc45e2000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=0 total: 100 open/close in 1.54 seconds: 65.12 ops/second llite.lustre-ffff900dc45e2000.statahead_max=0 101 real 0m1.516s user 0m0.005s sys 0m0.297s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff900dc45e2000.statahead_max=2048 llite.lustre-ffff900dc45e2000.statahead_max=2048 101 real 0m0.548s user 0m0.003s sys 0m0.198s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 total: 900 open/close in 7.16 seconds: 125.72 ops/second llite.lustre-ffff900dc45e2000.statahead_max=0 1001 real 0m13.169s user 0m0.023s sys 0m2.820s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff900dc45e2000.statahead_max=2048 llite.lustre-ffff900dc45e2000.statahead_max=2048 1001 real 0m3.785s user 0m0.018s sys 0m1.547s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff900dc45e2000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats= snapshot_time: 1784283025.482250080 secs.nsecs start_time: 1784282815.332200455 secs.nsecs elapsed_time: 210.150049625 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 1 10 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 1457 (time 1784283036.96 total 10.01 last 145.59) - open/close 2795 (time 1784283046.96 total 20.01 last 133.73) - open/close 4114 (time 1784283056.96 total 30.01 last 131.89) - open/close 5373 (time 1784283066.96 total 40.02 last 125.86) - open/close 6609 (time 1784283076.97 total 50.02 last 123.59) - open/close 7937 (time 1784283086.99 total 60.04 last 132.51) - open/close 9265 (time 1784283096.99 total 70.04 last 132.78) total: 10000 open/close in 74.93 seconds: 133.46 ops/second llite.lustre-ffff900dc45e2000.statahead_batch_max=0 llite.lustre-ffff900dc45e2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.174s user 0m0.297s sys 0m26.587s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff900dc45e2000.statahead_batch_max=256 llite.lustre-ffff900dc45e2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff900dc45e2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.454s user 0m0.223s sys 0m19.327s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff900dc45e2000.batch_stats= snapshot_time: 1784283181.324631549 secs.nsecs start_time: 1784283144.251859836 secs.nsecs elapsed_time: 37.072771713 secs.nsecs subreqs per batch batches %% cum %% 1: 307 60 60 2: 59 11 72 4: 63 12 84 8: 16 3 87 16: 9 1 89 32: 18 3 92 64: 2 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff900dc45e2000.statahead_batch_max=64 llite.lustre-ffff900dc45e2000.statahead_max=128