== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:09:27 (1780387767) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=0 llite.lustre-ffff97f48a0a5800.statahead_max=32 llite.lustre-ffff97f48a0a5800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.61 seconds: 163.83 ops/second llite.lustre-ffff97f48a0a5800.statahead_max=0 101 real 0m0.577s user 0m0.004s sys 0m0.230s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff97f48a0a5800.statahead_max=32 llite.lustre-ffff97f48a0a5800.statahead_max=32 101 real 0m0.388s user 0m0.003s sys 0m0.228s 'ls -l' 100 files with statahead: 0 sec statahead total: 124 statahead wrong: 2 agl total: 119 list_total: 32 fname_total: 81 hit_total: 4035 miss_total: 1615 swrong=2 ewrong=2 total: 900 open/close in 1.94 seconds: 463.54 ops/second llite.lustre-ffff97f48a0a5800.statahead_max=0 1001 real 0m5.874s user 0m0.022s sys 0m2.283s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff97f48a0a5800.statahead_max=32 llite.lustre-ffff97f48a0a5800.statahead_max=32 1001 real 0m3.474s user 0m0.013s sys 0m1.722s 'ls -l' 1000 files with statahead: 4 sec statahead total: 125 statahead wrong: 2 agl total: 120 list_total: 33 fname_total: 81 hit_total: 5034 miss_total: 1616 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 4 seconds llite.lustre-ffff97f48a0a5800.statahead_stats= statahead total: 125 statahead wrong: 2 agl total: 120 list_total: 33 fname_total: 81 hit_total: 5034 miss_total: 1616 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780387791.026469256 secs.nsecs start_time: 1780387768.495194627 secs.nsecs elapsed_time: 22.531274629 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 3 8 10 4: 2 5 16 8: 3 8 24 16: 25 67 91 32: 3 8 100 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780387791.026524605 secs.nsecs start_time: 1780387768.495263187 secs.nsecs elapsed_time: 22.531261418 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 2 5 12 16: 12 30 42 32: 23 57 100 - open/close 5359 (time 1780387802.05 total 10.00 last 535.89) total: 10000 open/close in 18.96 seconds: 527.52 ops/second llite.lustre-ffff97f48a0a5800.statahead_batch_max=0 llite.lustre-ffff97f48a0a5800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.558s user 0m0.207s sys 0m38.305s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97f48a0a5800.statahead_batch_max=32 llite.lustre-ffff97f48a0a5800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.735s user 0m0.155s sys 0m20.487s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780387897.245245313 secs.nsecs start_time: 1780387855.478277112 secs.nsecs elapsed_time: 41.766968201 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780387897.245282763 secs.nsecs start_time: 1780387855.478329675 secs.nsecs elapsed_time: 41.766953088 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=0 llite.lustre-ffff97f48a0a5800.statahead_max=2048 llite.lustre-ffff97f48a0a5800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.82 seconds: 121.86 ops/second llite.lustre-ffff97f48a0a5800.statahead_max=0 101 real 0m0.680s user 0m0.001s sys 0m0.263s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff97f48a0a5800.statahead_max=2048 llite.lustre-ffff97f48a0a5800.statahead_max=2048 101 real 0m0.379s user 0m0.002s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.90 seconds: 474.16 ops/second llite.lustre-ffff97f48a0a5800.statahead_max=0 1001 real 0m5.790s user 0m0.016s sys 0m2.290s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff97f48a0a5800.statahead_max=2048 llite.lustre-ffff97f48a0a5800.statahead_max=2048 1001 real 0m3.472s user 0m0.010s sys 0m1.309s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff97f48a0a5800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780388004.552442753 secs.nsecs start_time: 1780387898.001710818 secs.nsecs elapsed_time: 106.550731935 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 1 14 14 4: 0 0 14 8: 3 42 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780388004.552528156 secs.nsecs start_time: 1780387898.001855096 secs.nsecs elapsed_time: 106.550673060 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 3 42 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 4802 (time 1780388015.35 total 10.00 last 480.15) total: 10000 open/close in 19.80 seconds: 504.97 ops/second llite.lustre-ffff97f48a0a5800.statahead_batch_max=0 llite.lustre-ffff97f48a0a5800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.297s user 0m0.209s sys 0m34.089s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97f48a0a5800.statahead_batch_max=256 llite.lustre-ffff97f48a0a5800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.stats=clear mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.405s user 0m0.147s sys 0m21.023s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780388105.403714439 secs.nsecs start_time: 1780388068.489185669 secs.nsecs elapsed_time: 36.914528770 secs.nsecs subreqs per batch batches % cum % 1: 400 70 70 2: 73 12 83 4: 23 4 87 8: 7 1 89 16: 1 0 89 32: 25 4 93 64: 1 0 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff97f48a0a5800.batch_stats= snapshot_time: 1780388105.403779094 secs.nsecs start_time: 1780388068.489254116 secs.nsecs elapsed_time: 36.914524978 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff97f48a0a5800.statahead_batch_max=64 llite.lustre-ffff97f48a0a5800.statahead_max=128