== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:23:10 (1782487390) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=0 llite.lustre-ffff8d6b489fc000.statahead_max=32 llite.lustre-ffff8d6b489fc000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=0 total: 100 open/close in 0.95 seconds: 105.48 ops/second llite.lustre-ffff8d6b489fc000.statahead_max=0 101 real 0m0.788s user 0m0.005s sys 0m0.268s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8d6b489fc000.statahead_max=32 llite.lustre-ffff8d6b489fc000.statahead_max=32 101 real 0m0.395s user 0m0.001s sys 0m0.220s 'ls -l' 100 files with statahead: 1 sec statahead total: 99 statahead wrong: 2 agl total: 95 list_total: 29 fname_total: 70 hit_total: 3931 miss_total: 1299 swrong=2 ewrong=2 total: 900 open/close in 2.61 seconds: 344.21 ops/second llite.lustre-ffff8d6b489fc000.statahead_max=0 1001 real 0m7.869s user 0m0.030s sys 0m2.654s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8d6b489fc000.statahead_max=32 llite.lustre-ffff8d6b489fc000.statahead_max=32 1001 real 0m3.797s user 0m0.012s sys 0m2.074s 'ls -l' 1000 files with statahead: 3 sec statahead total: 100 statahead wrong: 2 agl total: 96 list_total: 30 fname_total: 70 hit_total: 4930 miss_total: 1300 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8d6b489fc000.statahead_stats= statahead total: 100 statahead wrong: 2 agl total: 96 list_total: 30 fname_total: 70 hit_total: 4930 miss_total: 1300 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats= snapshot_time: 1782487421.614494359 secs.nsecs start_time: 1782487392.255580719 secs.nsecs elapsed_time: 29.358913640 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 3429 (time 1782487432.45 total 10.00 last 342.86) - open/close 6944 (time 1782487442.46 total 20.01 last 351.20) - open/close 9919 (time 1782487452.46 total 30.01 last 297.50) total: 10000 open/close in 30.35 seconds: 329.45 ops/second llite.lustre-ffff8d6b489fc000.statahead_batch_max=0 llite.lustre-ffff8d6b489fc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.685s user 0m0.215s sys 0m30.432s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d6b489fc000.statahead_batch_max=32 llite.lustre-ffff8d6b489fc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.175s user 0m0.183s sys 0m20.309s batched statahead RPC= hit count=9997 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats= snapshot_time: 1782487533.568802232 secs.nsecs start_time: 1782487489.972829919 secs.nsecs elapsed_time: 43.595972313 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=0 llite.lustre-ffff8d6b489fc000.statahead_max=2048 llite.lustre-ffff8d6b489fc000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=0 total: 100 open/close in 0.68 seconds: 147.17 ops/second llite.lustre-ffff8d6b489fc000.statahead_max=0 101 real 0m0.607s user 0m0.000s sys 0m0.238s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8d6b489fc000.statahead_max=2048 llite.lustre-ffff8d6b489fc000.statahead_max=2048 101 real 0m0.385s user 0m0.002s sys 0m0.213s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10096 miss_total: 4 swrong=0 ewrong=0 total: 900 open/close in 2.15 seconds: 419.35 ops/second llite.lustre-ffff8d6b489fc000.statahead_max=0 1001 real 0m6.426s user 0m0.017s sys 0m2.425s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8d6b489fc000.statahead_max=2048 llite.lustre-ffff8d6b489fc000.statahead_max=2048 1001 real 0m5.061s user 0m0.013s sys 0m2.111s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8d6b489fc000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats= snapshot_time: 1782487652.169846415 secs.nsecs start_time: 1782487534.398749285 secs.nsecs elapsed_time: 117.771097130 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 4045 (time 1782487662.91 total 10.00 last 404.45) - open/close 8490 (time 1782487672.91 total 20.00 last 444.42) total: 10000 open/close in 23.37 seconds: 427.86 ops/second llite.lustre-ffff8d6b489fc000.statahead_batch_max=0 llite.lustre-ffff8d6b489fc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.327s user 0m0.206s sys 0m28.471s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8d6b489fc000.statahead_batch_max=256 llite.lustre-ffff8d6b489fc000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.749s user 0m0.179s sys 0m20.191s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8d6b489fc000.batch_stats= snapshot_time: 1782487749.472601805 secs.nsecs start_time: 1782487715.634620505 secs.nsecs elapsed_time: 33.837981300 secs.nsecs subreqs per batch batches %% cum %% 1: 364 68 68 2: 55 10 78 4: 40 7 85 8: 14 2 88 16: 4 0 89 32: 23 4 93 64: 0 0 93 128: 1 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8d6b489fc000.statahead_batch_max=64 llite.lustre-ffff8d6b489fc000.statahead_max=128