== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:07:30 (1788592050) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=0 llite.lustre-ffff93320cba4000.statahead_max=32 llite.lustre-ffff93320cba4000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=0 total: 100 open/close in 2.14 seconds: 46.76 ops/second llite.lustre-ffff93320cba4000.statahead_max=0 101 real 0m1.864s user 0m0.005s sys 0m0.289s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff93320cba4000.statahead_max=32 llite.lustre-ffff93320cba4000.statahead_max=32 101 real 0m0.789s user 0m0.004s sys 0m0.183s 'ls -l' 100 files with statahead: 1 sec statahead total: 113 statahead wrong: 2 agl total: 107 list_total: 30 fname_total: 65 hit_total: 3793 miss_total: 1470 swrong=2 ewrong=2 - open/close 769 (time 1788592073.35 total 10.01 last 76.85) total: 900 open/close in 11.83 seconds: 76.09 ops/second llite.lustre-ffff93320cba4000.statahead_max=0 1001 real 0m19.321s user 0m0.029s sys 0m2.725s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff93320cba4000.statahead_max=32 llite.lustre-ffff93320cba4000.statahead_max=32 1001 real 0m8.491s user 0m0.025s sys 0m1.359s 'ls -l' 1000 files with statahead: 9 sec statahead total: 114 statahead wrong: 2 agl total: 108 list_total: 31 fname_total: 65 hit_total: 4789 miss_total: 1474 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff93320cba4000.statahead_stats= statahead total: 114 statahead wrong: 2 agl total: 108 list_total: 31 fname_total: 65 hit_total: 4789 miss_total: 1474 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats= snapshot_time: 1788592132.358327282 secs.nsecs start_time: 1788592053.641101943 secs.nsecs elapsed_time: 78.717225339 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 4 4: 0 0 4 8: 3 7 12 16: 2 4 17 32: 34 82 100 - open/close 750 (time 1788592144.47 total 10.01 last 74.94) - open/close 1500 (time 1788592154.48 total 20.02 last 74.92) - open/close 2202 (time 1788592164.48 total 30.02 last 70.17) - open/close 2916 (time 1788592174.49 total 40.03 last 71.36) - open/close 3606 (time 1788592184.49 total 50.04 last 68.95) - open/close 4362 (time 1788592194.50 total 60.04 last 75.57) - open/close 5103 (time 1788592204.51 total 70.05 last 74.04) - open/close 5906 (time 1788592214.53 total 80.07 last 80.12) - open/close 6620 (time 1788592224.53 total 90.07 last 71.37) - open/close 7294 (time 1788592234.54 total 100.08 last 67.34) - open/close 8043 (time 1788592244.54 total 110.09 last 74.88) - open/close 8819 (time 1788592254.55 total 120.09 last 77.55) - open/close 9534 (time 1788592264.57 total 130.11 last 71.37) total: 10000 open/close in 136.11 seconds: 73.47 ops/second llite.lustre-ffff93320cba4000.statahead_batch_max=0 llite.lustre-ffff93320cba4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.628s user 0m0.293s sys 0m15.685s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93320cba4000.statahead_batch_max=32 llite.lustre-ffff93320cba4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m25.277s user 0m0.261s sys 0m13.329s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats= snapshot_time: 1788592422.346954163 secs.nsecs start_time: 1788592328.489960288 secs.nsecs elapsed_time: 93.856993875 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=0 llite.lustre-ffff93320cba4000.statahead_max=2048 llite.lustre-ffff93320cba4000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=0 total: 100 open/close in 2.76 seconds: 36.26 ops/second llite.lustre-ffff93320cba4000.statahead_max=0 101 real 0m1.937s user 0m0.007s sys 0m0.295s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff93320cba4000.statahead_max=2048 llite.lustre-ffff93320cba4000.statahead_max=2048 101 real 0m0.619s user 0m0.004s sys 0m0.182s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 783 (time 1788592707.62 total 10.00 last 78.29) total: 900 open/close in 11.62 seconds: 77.44 ops/second llite.lustre-ffff93320cba4000.statahead_max=0 1001 real 0m19.926s user 0m0.031s sys 0m2.717s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff93320cba4000.statahead_max=2048 llite.lustre-ffff93320cba4000.statahead_max=2048 1001 real 0m5.192s user 0m0.024s sys 0m1.475s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff93320cba4000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats= snapshot_time: 1788592759.964147694 secs.nsecs start_time: 1788592424.495294799 secs.nsecs elapsed_time: 335.468852895 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 1 8 58 128: 1 8 66 256: 4 33 100 - open/close 868 (time 1788592772.68 total 10.01 last 86.72) - open/close 1748 (time 1788592782.68 total 20.02 last 87.94) - open/close 2603 (time 1788592792.68 total 30.02 last 85.49) - open/close 3572 (time 1788592802.69 total 40.02 last 96.82) - open/close 4468 (time 1788592812.70 total 50.03 last 89.53) - open/close 5320 (time 1788592822.70 total 60.04 last 85.17) - open/close 6233 (time 1788592832.71 total 70.04 last 91.25) - open/close 7030 (time 1788592842.71 total 80.04 last 79.69) - open/close 7857 (time 1788592852.71 total 90.04 last 82.69) - open/close 8684 (time 1788592862.71 total 100.05 last 82.68) - open/close 9557 (time 1788592872.72 total 110.05 last 87.28) total: 10000 open/close in 115.94 seconds: 86.25 ops/second llite.lustre-ffff93320cba4000.statahead_batch_max=0 llite.lustre-ffff93320cba4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.146s user 0m0.325s sys 0m15.894s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93320cba4000.statahead_batch_max=256 llite.lustre-ffff93320cba4000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93320cba4000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.385s user 0m0.288s sys 0m14.803s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff93320cba4000.batch_stats= snapshot_time: 1788592989.732159948 secs.nsecs start_time: 1788592936.242413480 secs.nsecs elapsed_time: 53.489746468 secs.nsecs subreqs per batch batches %% cum %% 1: 89 42 42 2: 14 6 49 4: 25 11 61 8: 11 5 66 16: 14 6 73 32: 15 7 80 64: 5 2 82 128: 1 0 83 256: 35 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff93320cba4000.statahead_batch_max=64 llite.lustre-ffff93320cba4000.statahead_max=128