== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:37:47 (1782225467) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=0 llite.lustre-ffff9fb706942800.statahead_max=32 llite.lustre-ffff9fb706942800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=0 total: 100 open/close in 2.97 seconds: 33.71 ops/second llite.lustre-ffff9fb706942800.statahead_max=0 101 real 0m3.733s user 0m0.005s sys 0m0.412s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9fb706942800.statahead_max=32 llite.lustre-ffff9fb706942800.statahead_max=32 101 real 0m1.502s user 0m0.006s sys 0m0.226s 'ls -l' 100 files with statahead: 2 sec statahead total: 128 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 92 hit_total: 3590 miss_total: 1478 swrong=2 ewrong=2 - open/close 439 (time 1782225499.28 total 10.03 last 43.77) total: 900 open/close in 19.09 seconds: 47.14 ops/second llite.lustre-ffff9fb706942800.statahead_max=0 1001 real 0m31.365s user 0m0.039s sys 0m3.955s 'ls -l' 1000 files without statahead: 32 sec llite.lustre-ffff9fb706942800.statahead_max=32 llite.lustre-ffff9fb706942800.statahead_max=32 1001 real 0m13.123s user 0m0.038s sys 0m1.846s 'ls -l' 1000 files with statahead: 13 sec statahead total: 129 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 92 hit_total: 4586 miss_total: 1482 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 28 seconds llite.lustre-ffff9fb706942800.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 92 hit_total: 4586 miss_total: 1482 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats= snapshot_time: 1782225598.056596684 secs.nsecs start_time: 1782225472.655788756 secs.nsecs elapsed_time: 125.400807928 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 505 (time 1782225612.44 total 10.03 last 50.36) - open/close 1073 (time 1782225622.48 total 20.06 last 56.59) - open/close 1698 (time 1782225632.48 total 30.07 last 62.50) - open/close 2433 (time 1782225642.49 total 40.08 last 73.41) - open/close 3064 (time 1782225652.50 total 50.08 last 63.07) - open/close 3692 (time 1782225662.50 total 60.08 last 62.79) - open/close 4231 (time 1782225672.50 total 70.09 last 53.87) - open/close 4874 (time 1782225682.50 total 80.09 last 64.30) - open/close 5385 (time 1782225692.51 total 90.10 last 51.05) - open/close 5969 (time 1782225702.52 total 100.11 last 58.35) - open/close 6583 (time 1782225712.53 total 110.11 last 61.38) - open/close 7204 (time 1782225722.53 total 120.12 last 62.08) - open/close 7838 (time 1782225732.54 total 130.13 last 63.31) - open/close 8480 (time 1782225742.55 total 140.14 last 64.13) - open/close 9074 (time 1782225752.56 total 150.15 last 59.36) - open/close 9680 (time 1782225762.57 total 160.15 last 60.56) total: 10000 open/close in 165.28 seconds: 60.50 ops/second llite.lustre-ffff9fb706942800.statahead_batch_max=0 llite.lustre-ffff9fb706942800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m21.571s user 0m0.440s sys 0m19.438s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fb706942800.statahead_batch_max=32 llite.lustre-ffff9fb706942800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m20.527s user 0m0.425s sys 0m19.355s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats= snapshot_time: 1782226025.140924797 secs.nsecs start_time: 1782225863.712691317 secs.nsecs elapsed_time: 161.428233480 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=0 llite.lustre-ffff9fb706942800.statahead_max=2048 llite.lustre-ffff9fb706942800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=0 total: 100 open/close in 4.14 seconds: 24.13 ops/second llite.lustre-ffff9fb706942800.statahead_max=0 101 real 0m3.479s user 0m0.007s sys 0m0.394s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff9fb706942800.statahead_max=2048 llite.lustre-ffff9fb706942800.statahead_max=2048 101 real 0m1.220s user 0m0.006s sys 0m0.183s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 533 (time 1782226442.92 total 10.01 last 53.24) total: 900 open/close in 16.70 seconds: 53.88 ops/second llite.lustre-ffff9fb706942800.statahead_max=0 1001 real 0m28.088s user 0m0.039s sys 0m3.819s 'ls -l' 1000 files without statahead: 28 sec llite.lustre-ffff9fb706942800.statahead_max=2048 llite.lustre-ffff9fb706942800.statahead_max=2048 1001 real 0m10.943s user 0m0.037s sys 0m1.757s 'ls -l' 1000 files with statahead: 11 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 29 seconds llite.lustre-ffff9fb706942800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats= snapshot_time: 1782226535.732373475 secs.nsecs start_time: 1782226028.733014844 secs.nsecs elapsed_time: 506.999358631 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 2 20 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 613 (time 1782226548.93 total 10.01 last 61.22) - open/close 1168 (time 1782226558.94 total 20.02 last 55.47) - open/close 1797 (time 1782226568.94 total 30.02 last 62.89) - open/close 2348 (time 1782226578.94 total 40.02 last 55.08) - open/close 2850 (time 1782226588.95 total 50.03 last 50.16) - open/close 3337 (time 1782226598.96 total 60.04 last 48.66) - open/close 4022 (time 1782226608.96 total 70.04 last 68.48) - open/close 4537 (time 1782226618.98 total 80.06 last 51.43) - open/close 5127 (time 1782226629.00 total 90.08 last 58.87) - open/close 5661 (time 1782226639.01 total 100.09 last 53.32) - open/close 6163 (time 1782226649.02 total 110.10 last 50.16) - open/close 6687 (time 1782226659.03 total 120.11 last 52.38) - open/close 7303 (time 1782226669.05 total 130.12 last 61.48) - open/close 7894 (time 1782226679.06 total 140.14 last 59.02) - open/close 8507 (time 1782226689.07 total 150.14 last 61.26) - open/close 9044 (time 1782226699.07 total 160.15 last 53.69) - open/close 9580 (time 1782226709.08 total 170.16 last 53.55) total: 10000 open/close in 177.72 seconds: 56.27 ops/second llite.lustre-ffff9fb706942800.statahead_batch_max=0 llite.lustre-ffff9fb706942800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.722s user 0m0.398s sys 0m20.014s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fb706942800.statahead_batch_max=256 llite.lustre-ffff9fb706942800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fb706942800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m23.011s user 0m0.379s sys 0m18.867s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9fb706942800.batch_stats= snapshot_time: 1782226906.466216038 secs.nsecs start_time: 1782226806.344945029 secs.nsecs elapsed_time: 100.121271009 secs.nsecs subreqs per batch batches %% cum %% 1: 210 49 49 2: 67 15 65 4: 47 11 76 8: 25 5 82 16: 16 3 86 32: 22 5 91 64: 1 0 91 128: 2 0 92 256: 33 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9fb706942800.statahead_batch_max=64 llite.lustre-ffff9fb706942800.statahead_max=128