== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:54:46 (1787835286) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=0 llite.lustre-ffff98a1c4a00800.statahead_max=32 llite.lustre-ffff98a1c4a00800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=0 total: 100 open/close in 2.05 seconds: 48.87 ops/second llite.lustre-ffff98a1c4a00800.statahead_max=0 101 real 0m1.526s user 0m0.004s sys 0m0.291s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff98a1c4a00800.statahead_max=32 llite.lustre-ffff98a1c4a00800.statahead_max=32 101 real 0m0.834s user 0m0.002s sys 0m0.147s 'ls -l' 100 files with statahead: 1 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 96 hit_total: 3978 miss_total: 1488 swrong=2 ewrong=2 - open/close 856 (time 1787835311.65 total 10.01 last 85.56) total: 900 open/close in 10.79 seconds: 83.42 ops/second llite.lustre-ffff98a1c4a00800.statahead_max=0 1001 real 0m16.783s user 0m0.032s sys 0m2.708s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff98a1c4a00800.statahead_max=32 llite.lustre-ffff98a1c4a00800.statahead_max=32 1001 real 0m9.106s user 0m0.030s sys 0m1.312s 'ls -l' 1000 files with statahead: 9 sec statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 96 hit_total: 4976 miss_total: 1490 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff98a1c4a00800.statahead_stats= statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 96 hit_total: 4976 miss_total: 1490 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats= snapshot_time: 1787835369.537696578 secs.nsecs start_time: 1787835290.988207336 secs.nsecs elapsed_time: 78.549489242 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 901 (time 1787835382.18 total 10.01 last 90.00) - open/close 1640 (time 1787835392.18 total 20.01 last 73.88) - open/close 2557 (time 1787835402.19 total 30.02 last 91.64) - open/close 3496 (time 1787835412.19 total 40.03 last 93.84) - open/close 4387 (time 1787835422.20 total 50.03 last 89.08) - open/close 5225 (time 1787835432.20 total 60.03 last 83.76) - open/close 6096 (time 1787835442.20 total 70.03 last 87.10) - open/close 6938 (time 1787835452.20 total 80.04 last 84.17) - open/close 7902 (time 1787835462.21 total 90.05 last 96.32) - open/close 8831 (time 1787835472.22 total 100.06 last 92.80) - open/close 9707 (time 1787835482.23 total 110.06 last 87.58) total: 10000 open/close in 113.47 seconds: 88.13 ops/second llite.lustre-ffff98a1c4a00800.statahead_batch_max=0 llite.lustre-ffff98a1c4a00800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.467s user 0m0.309s sys 0m13.204s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff98a1c4a00800.statahead_batch_max=32 llite.lustre-ffff98a1c4a00800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.990s user 0m0.298s sys 0m12.707s batched statahead RPC= hit count=9969 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats= snapshot_time: 1787835663.521369581 secs.nsecs start_time: 1787835551.261189870 secs.nsecs elapsed_time: 112.260179711 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=0 llite.lustre-ffff98a1c4a00800.statahead_max=2048 llite.lustre-ffff98a1c4a00800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=0 total: 100 open/close in 2.40 seconds: 41.72 ops/second llite.lustre-ffff98a1c4a00800.statahead_max=0 101 real 0m2.719s user 0m0.006s sys 0m0.316s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff98a1c4a00800.statahead_max=2048 llite.lustre-ffff98a1c4a00800.statahead_max=2048 101 real 0m0.764s user 0m0.006s sys 0m0.157s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10068 miss_total: 32 swrong=0 ewrong=0 - open/close 858 (time 1787835941.35 total 10.01 last 85.73) total: 900 open/close in 10.46 seconds: 86.01 ops/second llite.lustre-ffff98a1c4a00800.statahead_max=0 1001 real 0m18.857s user 0m0.037s sys 0m2.743s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff98a1c4a00800.statahead_max=2048 llite.lustre-ffff98a1c4a00800.statahead_max=2048 1001 real 0m5.484s user 0m0.028s sys 0m1.419s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11067 miss_total: 33 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff98a1c4a00800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11067 miss_total: 33 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats= snapshot_time: 1787835996.821222313 secs.nsecs start_time: 1787835665.704308712 secs.nsecs elapsed_time: 331.116913601 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 792 (time 1787836009.49 total 10.00 last 79.18) - open/close 1500 (time 1787836019.50 total 20.01 last 70.74) - open/close 2300 (time 1787836029.50 total 30.02 last 79.97) - open/close 3144 (time 1787836039.50 total 40.02 last 84.40) - open/close 3955 (time 1787836049.51 total 50.03 last 81.00) - open/close 4734 (time 1787836059.52 total 60.04 last 77.80) - open/close 5525 (time 1787836069.53 total 70.05 last 79.04) - open/close 6243 (time 1787836079.54 total 80.06 last 71.72) - open/close 7027 (time 1787836089.55 total 90.06 last 78.37) - open/close 7876 (time 1787836099.56 total 100.07 last 84.80) - open/close 8678 (time 1787836109.57 total 110.09 last 80.09) - open/close 9485 (time 1787836119.58 total 120.09 last 80.65) total: 10000 open/close in 125.92 seconds: 79.42 ops/second llite.lustre-ffff98a1c4a00800.statahead_batch_max=0 llite.lustre-ffff98a1c4a00800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.625s user 0m0.313s sys 0m13.578s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff98a1c4a00800.statahead_batch_max=256 llite.lustre-ffff98a1c4a00800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.800s user 0m0.282s sys 0m13.582s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff98a1c4a00800.batch_stats= snapshot_time: 1787836254.919404451 secs.nsecs start_time: 1787836192.168150630 secs.nsecs elapsed_time: 62.751253821 secs.nsecs subreqs per batch batches %% cum %% 1: 102 46 46 2: 27 12 58 4: 16 7 65 8: 12 5 71 16: 7 3 74 32: 13 5 80 64: 7 3 83 128: 3 1 84 256: 34 15 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff98a1c4a00800.statahead_batch_max=64 llite.lustre-ffff98a1c4a00800.statahead_max=128