== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:14:42 (1786194882) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=0 llite.lustre-ffff9980c47cf800.statahead_max=32 llite.lustre-ffff9980c47cf800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.71 seconds: 141.38 ops/second llite.lustre-ffff9980c47cf800.statahead_max=0 101 real 0m0.666s user 0m0.001s sys 0m0.264s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9980c47cf800.statahead_max=32 llite.lustre-ffff9980c47cf800.statahead_max=32 101 real 0m0.509s user 0m0.002s sys 0m0.244s 'ls -l' 100 files with statahead: 0 sec statahead total: 87 statahead wrong: 2 agl total: 82 list_total: 30 fname_total: 45 hit_total: 13976 miss_total: 1125 swrong=2 ewrong=2 total: 900 open/close in 2.11 seconds: 427.13 ops/second llite.lustre-ffff9980c47cf800.statahead_max=0 1001 real 0m6.216s user 0m0.019s sys 0m2.460s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9980c47cf800.statahead_max=32 llite.lustre-ffff9980c47cf800.statahead_max=32 1001 real 0m4.983s user 0m0.023s sys 0m2.520s 'ls -l' 1000 files with statahead: 5 sec statahead total: 88 statahead wrong: 2 agl total: 83 list_total: 31 fname_total: 45 hit_total: 14975 miss_total: 1126 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff9980c47cf800.statahead_stats= statahead total: 88 statahead wrong: 2 agl total: 83 list_total: 31 fname_total: 45 hit_total: 14975 miss_total: 1126 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786194911.402095110 secs.nsecs start_time: 1786194883.963765301 secs.nsecs elapsed_time: 27.438329809 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 4 10 12 8: 2 5 17 16: 18 45 62 32: 15 37 100 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786194911.402138743 secs.nsecs start_time: 1786194883.963836059 secs.nsecs elapsed_time: 27.438302684 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 3 7 15 16: 17 43 58 32: 16 41 100 - open/close 4754 (time 1786194922.21 total 10.00 last 475.39) - open/close 9122 (time 1786194932.21 total 20.00 last 436.78) total: 10000 open/close in 21.84 seconds: 457.95 ops/second llite.lustre-ffff9980c47cf800.statahead_batch_max=0 llite.lustre-ffff9980c47cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.008s user 0m0.220s sys 0m50.376s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9980c47cf800.statahead_batch_max=32 llite.lustre-ffff9980c47cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.051s user 0m0.169s sys 0m23.270s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195036.859716752 secs.nsecs start_time: 1786194990.280724355 secs.nsecs elapsed_time: 46.578992397 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195036.859760620 secs.nsecs start_time: 1786194990.280778090 secs.nsecs elapsed_time: 46.578982530 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=0 llite.lustre-ffff9980c47cf800.statahead_max=2048 llite.lustre-ffff9980c47cf800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.15 seconds: 86.60 ops/second llite.lustre-ffff9980c47cf800.statahead_max=0 101 real 0m0.662s user 0m0.006s sys 0m0.259s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9980c47cf800.statahead_max=2048 llite.lustre-ffff9980c47cf800.statahead_max=2048 101 real 0m0.565s user 0m0.003s sys 0m0.365s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.95 seconds: 461.73 ops/second llite.lustre-ffff9980c47cf800.statahead_max=0 1001 real 0m6.408s user 0m0.025s sys 0m2.538s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9980c47cf800.statahead_max=2048 llite.lustre-ffff9980c47cf800.statahead_max=2048 1001 real 0m5.956s user 0m0.014s sys 0m2.349s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9980c47cf800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195162.882047015 secs.nsecs start_time: 1786195037.621256686 secs.nsecs elapsed_time: 125.260790329 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195162.882106117 secs.nsecs start_time: 1786195037.621387305 secs.nsecs elapsed_time: 125.260718812 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 25 25 8: 2 25 50 16: 1 12 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 - open/close 4512 (time 1786195173.88 total 10.00 last 451.14) - open/close 9115 (time 1786195183.88 total 20.00 last 460.24) total: 10000 open/close in 21.85 seconds: 457.70 ops/second llite.lustre-ffff9980c47cf800.statahead_batch_max=0 llite.lustre-ffff9980c47cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.838s user 0m0.169s sys 0m35.179s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9980c47cf800.statahead_batch_max=256 llite.lustre-ffff9980c47cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9980c47cf800.stats=clear mdc.lustre-MDT0001-mdc-ffff9980c47cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.940s user 0m0.160s sys 0m21.887s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195267.863492077 secs.nsecs start_time: 1786195230.640797457 secs.nsecs elapsed_time: 37.222694620 secs.nsecs subreqs per batch batches %% cum %% 1: 395 69 69 2: 93 16 86 4: 14 2 88 8: 5 0 89 16: 4 0 90 32: 19 3 93 64: 3 0 94 128: 0 0 94 256: 34 5 100 mdc.lustre-MDT0001-mdc-ffff9980c47cf800.batch_stats= snapshot_time: 1786195267.863554075 secs.nsecs start_time: 1786195230.640877491 secs.nsecs elapsed_time: 37.222676584 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9980c47cf800.statahead_batch_max=64 llite.lustre-ffff9980c47cf800.statahead_max=128