== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:04:31 (1780340671) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=0 llite.lustre-ffff952c84b45800.statahead_max=32 llite.lustre-ffff952c84b45800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=0 total: 100 open/close in 2.80 seconds: 35.74 ops/second llite.lustre-ffff952c84b45800.statahead_max=0 101 real 0m2.946s user 0m0.007s sys 0m0.340s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff952c84b45800.statahead_max=32 llite.lustre-ffff952c84b45800.statahead_max=32 101 real 0m1.490s user 0m0.001s sys 0m0.183s 'ls -l' 100 files with statahead: 2 sec statahead total: 137 statahead wrong: 2 agl total: 130 list_total: 31 fname_total: 106 hit_total: 4371 miss_total: 1291 swrong=2 ewrong=2 - open/close 703 (time 1780340703.16 total 10.01 last 70.24) total: 900 open/close in 13.40 seconds: 67.18 ops/second llite.lustre-ffff952c84b45800.statahead_max=0 1001 real 0m21.135s user 0m0.039s sys 0m3.045s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff952c84b45800.statahead_max=32 llite.lustre-ffff952c84b45800.statahead_max=32 1001 real 0m10.244s user 0m0.028s sys 0m1.509s 'ls -l' 1000 files with statahead: 11 sec statahead total: 138 statahead wrong: 2 agl total: 131 list_total: 32 fname_total: 106 hit_total: 5368 miss_total: 1294 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff952c84b45800.statahead_stats= statahead total: 138 statahead wrong: 2 agl total: 131 list_total: 32 fname_total: 106 hit_total: 5368 miss_total: 1294 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats= snapshot_time: 1780340777.231874041 secs.nsecs start_time: 1780340676.916602107 secs.nsecs elapsed_time: 100.315271934 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 666 (time 1780340790.88 total 10.01 last 66.53) - open/close 1320 (time 1780340800.92 total 20.05 last 65.12) - open/close 1889 (time 1780340810.95 total 30.08 last 56.75) - open/close 2599 (time 1780340820.96 total 40.09 last 70.93) - open/close 3467 (time 1780340830.96 total 50.09 last 86.76) - open/close 4270 (time 1780340840.97 total 60.10 last 80.24) - open/close 4795 (time 1780340850.98 total 70.11 last 52.44) - open/close 5555 (time 1780340860.98 total 80.12 last 75.98) - open/close 6081 (time 1780340870.98 total 90.12 last 52.59) - open/close 6879 (time 1780340881.00 total 100.13 last 79.71) - open/close 7474 (time 1780340891.02 total 110.16 last 59.34) - open/close 8072 (time 1780340901.03 total 120.16 last 59.77) - open/close 8844 (time 1780340911.03 total 130.16 last 77.18) - open/close 9537 (time 1780340921.05 total 140.18 last 69.17) total: 10000 open/close in 147.05 seconds: 68.00 ops/second llite.lustre-ffff952c84b45800.statahead_batch_max=0 llite.lustre-ffff952c84b45800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.851s user 0m0.349s sys 0m14.815s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff952c84b45800.statahead_batch_max=32 llite.lustre-ffff952c84b45800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m3.444s user 0m0.325s sys 0m14.600s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats= snapshot_time: 1780341149.124231869 secs.nsecs start_time: 1780341006.681796490 secs.nsecs elapsed_time: 142.442435379 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=0 llite.lustre-ffff952c84b45800.statahead_max=2048 llite.lustre-ffff952c84b45800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=0 total: 100 open/close in 1.86 seconds: 53.69 ops/second llite.lustre-ffff952c84b45800.statahead_max=0 101 real 0m2.174s user 0m0.004s sys 0m0.328s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff952c84b45800.statahead_max=2048 llite.lustre-ffff952c84b45800.statahead_max=2048 101 real 0m0.783s user 0m0.003s sys 0m0.144s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 895 (time 1780341432.23 total 10.01 last 89.38) total: 900 open/close in 10.06 seconds: 89.45 ops/second llite.lustre-ffff952c84b45800.statahead_max=0 1001 real 0m17.228s user 0m0.024s sys 0m2.990s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff952c84b45800.statahead_max=2048 llite.lustre-ffff952c84b45800.statahead_max=2048 1001 real 0m6.767s user 0m0.030s sys 0m1.417s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff952c84b45800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats= snapshot_time: 1780341482.996642436 secs.nsecs start_time: 1780341151.939486295 secs.nsecs elapsed_time: 331.057156141 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 886 (time 1780341495.06 total 10.00 last 88.59) - open/close 1776 (time 1780341505.06 total 20.01 last 88.96) - open/close 2694 (time 1780341515.07 total 30.01 last 91.75) - open/close 3775 (time 1780341525.07 total 40.01 last 108.07) - open/close 4728 (time 1780341535.08 total 50.02 last 95.19) - open/close 5699 (time 1780341545.10 total 60.05 last 96.88) - open/close 6509 (time 1780341555.11 total 70.05 last 80.98) - open/close 7347 (time 1780341565.13 total 80.07 last 83.64) - open/close 8115 (time 1780341575.13 total 90.07 last 76.77) - open/close 9049 (time 1780341585.13 total 100.08 last 93.35) - open/close 9964 (time 1780341595.13 total 110.08 last 91.50) total: 10000 open/close in 110.38 seconds: 90.60 ops/second llite.lustre-ffff952c84b45800.statahead_batch_max=0 llite.lustre-ffff952c84b45800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.611s user 0m0.316s sys 0m15.001s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff952c84b45800.statahead_batch_max=256 llite.lustre-ffff952c84b45800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff952c84b45800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.332s user 0m0.284s sys 0m15.217s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff952c84b45800.batch_stats= snapshot_time: 1780341713.178606707 secs.nsecs start_time: 1780341653.193274244 secs.nsecs elapsed_time: 59.985332463 secs.nsecs subreqs per batch batches % cum % 1: 265 54 54 2: 79 16 71 4: 45 9 80 8: 23 4 85 16: 18 3 89 32: 16 3 92 64: 2 0 92 128: 2 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff952c84b45800.statahead_batch_max=64 llite.lustre-ffff952c84b45800.statahead_max=128