== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:39:48 (1788892788) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=0 llite.lustre-ffff974f275d1800.statahead_max=32 llite.lustre-ffff974f275d1800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.65 seconds: 153.43 ops/second llite.lustre-ffff974f275d1800.statahead_max=0 101 real 0m0.618s user 0m0.004s sys 0m0.232s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff974f275d1800.statahead_max=32 llite.lustre-ffff974f275d1800.statahead_max=32 101 real 0m0.392s user 0m0.002s sys 0m0.217s 'ls -l' 100 files with statahead: 0 sec statahead total: 77 statahead wrong: 2 agl total: 72 list_total: 29 fname_total: 48 hit_total: 13772 miss_total: 515 swrong=2 ewrong=2 total: 900 open/close in 1.83 seconds: 490.50 ops/second llite.lustre-ffff974f275d1800.statahead_max=0 1001 real 0m6.068s user 0m0.027s sys 0m2.213s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff974f275d1800.statahead_max=32 llite.lustre-ffff974f275d1800.statahead_max=32 1001 real 0m4.027s user 0m0.013s sys 0m1.878s 'ls -l' 1000 files with statahead: 4 sec statahead total: 78 statahead wrong: 2 agl total: 73 list_total: 30 fname_total: 48 hit_total: 14771 miss_total: 516 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff974f275d1800.statahead_stats= statahead total: 78 statahead wrong: 2 agl total: 73 list_total: 30 fname_total: 48 hit_total: 14771 miss_total: 516 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788892814.571878075 secs.nsecs start_time: 1788892790.107718970 secs.nsecs elapsed_time: 24.464159105 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 1 2 7 8: 4 10 17 16: 17 42 60 32: 16 40 100 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788892814.571914616 secs.nsecs start_time: 1788892790.107810247 secs.nsecs elapsed_time: 24.464104369 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 0 0 5 4: 4 10 15 8: 1 2 17 16: 22 55 72 32: 11 27 100 - open/close 5352 (time 1788892825.64 total 10.00 last 535.13) total: 10000 open/close in 19.61 seconds: 509.97 ops/second llite.lustre-ffff974f275d1800.statahead_batch_max=0 llite.lustre-ffff974f275d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.828s user 0m0.165s sys 0m30.638s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff974f275d1800.statahead_batch_max=32 llite.lustre-ffff974f275d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.529s user 0m0.151s sys 0m20.365s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788892910.646293559 secs.nsecs start_time: 1788892869.589652299 secs.nsecs elapsed_time: 41.056641260 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788892910.646332372 secs.nsecs start_time: 1788892869.589721174 secs.nsecs elapsed_time: 41.056611198 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=0 llite.lustre-ffff974f275d1800.statahead_max=2048 llite.lustre-ffff974f275d1800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.44 seconds: 69.33 ops/second llite.lustre-ffff974f275d1800.statahead_max=0 101 real 0m1.273s user 0m0.007s sys 0m0.290s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff974f275d1800.statahead_max=2048 llite.lustre-ffff974f275d1800.statahead_max=2048 101 real 0m0.427s user 0m0.003s sys 0m0.232s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 6.69 seconds: 134.63 ops/second llite.lustre-ffff974f275d1800.statahead_max=0 1001 real 0m12.809s user 0m0.034s sys 0m2.726s 'ls -l' 1000 files without statahead: 13 sec llite.lustre-ffff974f275d1800.statahead_max=2048 llite.lustre-ffff974f275d1800.statahead_max=2048 1001 real 0m3.402s user 0m0.017s sys 0m1.347s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff974f275d1800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788893110.952352150 secs.nsecs start_time: 1788892911.528203400 secs.nsecs elapsed_time: 199.424148750 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 40 40 8: 1 20 60 16: 0 0 60 32: 0 0 60 64: 0 0 60 128: 0 0 60 256: 2 40 100 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788893110.952416484 secs.nsecs start_time: 1788892911.528352051 secs.nsecs elapsed_time: 199.424064433 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 12 12 8: 2 25 37 16: 1 12 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 1410 (time 1788893122.84 total 10.00 last 140.94) - open/close 2833 (time 1788893132.85 total 20.01 last 142.21) - open/close 4414 (time 1788893142.85 total 30.01 last 158.07) - open/close 5940 (time 1788893152.85 total 40.01 last 152.59) - open/close 7552 (time 1788893162.85 total 50.02 last 161.13) - open/close 9627 (time 1788893172.86 total 60.02 last 207.43) total: 10000 open/close in 61.53 seconds: 162.53 ops/second llite.lustre-ffff974f275d1800.statahead_batch_max=0 llite.lustre-ffff974f275d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.172s user 0m0.246s sys 0m29.179s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff974f275d1800.statahead_batch_max=256 llite.lustre-ffff974f275d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff974f275d1800.stats=clear mdc.lustre-MDT0001-mdc-ffff974f275d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m25.626s user 0m0.180s sys 0m19.312s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788893242.275666699 secs.nsecs start_time: 1788893211.523923826 secs.nsecs elapsed_time: 30.751742873 secs.nsecs subreqs per batch batches %% cum %% 1: 169 52 52 2: 47 14 66 4: 39 12 78 8: 6 1 80 16: 2 0 81 32: 23 7 88 64: 1 0 88 128: 1 0 89 256: 35 10 100 mdc.lustre-MDT0001-mdc-ffff974f275d1800.batch_stats= snapshot_time: 1788893242.275708759 secs.nsecs start_time: 1788893211.524013547 secs.nsecs elapsed_time: 30.751695212 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff974f275d1800.statahead_batch_max=64 llite.lustre-ffff974f275d1800.statahead_max=128