== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:49:58 (1787471398) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=0 llite.lustre-ffff9c78d9314000.statahead_max=32 llite.lustre-ffff9c78d9314000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=0 total: 100 open/close in 3.66 seconds: 27.33 ops/second llite.lustre-ffff9c78d9314000.statahead_max=0 101 real 0m2.466s user 0m0.003s sys 0m0.314s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9c78d9314000.statahead_max=32 llite.lustre-ffff9c78d9314000.statahead_max=32 101 real 0m1.355s user 0m0.006s sys 0m0.176s 'ls -l' 100 files with statahead: 2 sec statahead total: 149 statahead wrong: 2 agl total: 143 list_total: 30 fname_total: 119 hit_total: 3996 miss_total: 1353 swrong=2 ewrong=2 - open/close 707 (time 1787471429.62 total 10.00 last 70.69) total: 900 open/close in 12.80 seconds: 70.29 ops/second llite.lustre-ffff9c78d9314000.statahead_max=0 1001 real 0m24.703s user 0m0.026s sys 0m3.194s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff9c78d9314000.statahead_max=32 llite.lustre-ffff9c78d9314000.statahead_max=32 1001 real 0m11.183s user 0m0.032s sys 0m1.603s 'ls -l' 1000 files with statahead: 11 sec statahead total: 150 statahead wrong: 2 agl total: 144 list_total: 31 fname_total: 119 hit_total: 4994 miss_total: 1355 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9c78d9314000.statahead_stats= statahead total: 150 statahead wrong: 2 agl total: 144 list_total: 31 fname_total: 119 hit_total: 4994 miss_total: 1355 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats= snapshot_time: 1787471502.560268073 secs.nsecs start_time: 1787471404.633852259 secs.nsecs elapsed_time: 97.926415814 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 875 (time 1787471514.44 total 10.01 last 87.43) - open/close 1650 (time 1787471524.44 total 20.02 last 77.44) - open/close 2476 (time 1787471534.45 total 30.02 last 82.55) - open/close 3249 (time 1787471544.46 total 40.03 last 77.24) - open/close 4093 (time 1787471554.47 total 50.04 last 84.31) - open/close 4938 (time 1787471564.48 total 60.06 last 84.37) - open/close 5704 (time 1787471574.49 total 70.06 last 76.58) - open/close 6466 (time 1787471584.49 total 80.07 last 76.14) - open/close 7240 (time 1787471594.51 total 90.08 last 77.31) - open/close 8054 (time 1787471604.51 total 100.08 last 81.36) - open/close 8863 (time 1787471614.52 total 110.09 last 80.85) - open/close 9692 (time 1787471624.52 total 120.09 last 82.87) total: 10000 open/close in 123.31 seconds: 81.09 ops/second llite.lustre-ffff9c78d9314000.statahead_batch_max=0 llite.lustre-ffff9c78d9314000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.619s user 0m0.302s sys 0m17.060s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c78d9314000.statahead_batch_max=32 llite.lustre-ffff9c78d9314000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m26.516s user 0m0.285s sys 0m15.786s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats= snapshot_time: 1787471794.977736988 secs.nsecs start_time: 1787471696.367740199 secs.nsecs elapsed_time: 98.609996789 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=0 llite.lustre-ffff9c78d9314000.statahead_max=2048 llite.lustre-ffff9c78d9314000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=0 total: 100 open/close in 2.34 seconds: 42.70 ops/second llite.lustre-ffff9c78d9314000.statahead_max=0 101 real 0m2.509s user 0m0.006s sys 0m0.336s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9c78d9314000.statahead_max=2048 llite.lustre-ffff9c78d9314000.statahead_max=2048 101 real 0m0.680s user 0m0.007s sys 0m0.186s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 834 (time 1787472090.08 total 10.00 last 83.39) total: 900 open/close in 10.99 seconds: 81.87 ops/second llite.lustre-ffff9c78d9314000.statahead_max=0 1001 real 0m19.192s user 0m0.032s sys 0m2.950s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9c78d9314000.statahead_max=2048 llite.lustre-ffff9c78d9314000.statahead_max=2048 1001 real 0m5.905s user 0m0.029s sys 0m1.657s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9c78d9314000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats= snapshot_time: 1787472150.183712561 secs.nsecs start_time: 1787471798.317611482 secs.nsecs elapsed_time: 351.866101079 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 1 9 63 128: 0 0 63 256: 4 36 100 - open/close 702 (time 1787472163.43 total 10.02 last 70.07) - open/close 1485 (time 1787472173.43 total 20.02 last 78.29) - open/close 2308 (time 1787472183.43 total 30.02 last 82.27) - open/close 3040 (time 1787472193.43 total 40.03 last 73.19) - open/close 3780 (time 1787472203.44 total 50.04 last 73.93) - open/close 4629 (time 1787472213.44 total 60.04 last 84.88) - open/close 5427 (time 1787472223.45 total 70.04 last 79.78) - open/close 6205 (time 1787472233.45 total 80.05 last 77.76) - open/close 7043 (time 1787472243.46 total 90.05 last 83.76) - open/close 7890 (time 1787472253.47 total 100.06 last 84.62) - open/close 8791 (time 1787472263.47 total 110.06 last 90.06) - open/close 9674 (time 1787472273.49 total 120.08 last 88.13) total: 10000 open/close in 123.75 seconds: 80.81 ops/second llite.lustre-ffff9c78d9314000.statahead_batch_max=0 llite.lustre-ffff9c78d9314000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.957s user 0m0.295s sys 0m17.838s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c78d9314000.statahead_batch_max=256 llite.lustre-ffff9c78d9314000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c78d9314000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.956s user 0m0.280s sys 0m16.769s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9c78d9314000.batch_stats= snapshot_time: 1787472408.053206717 secs.nsecs start_time: 1787472342.366900836 secs.nsecs elapsed_time: 65.686305881 secs.nsecs subreqs per batch batches %% cum %% 1: 340 57 57 2: 75 12 69 4: 74 12 82 8: 36 6 88 16: 24 4 92 32: 11 1 94 64: 2 0 94 128: 0 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9c78d9314000.statahead_batch_max=64 llite.lustre-ffff9c78d9314000.statahead_max=128