== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:43:23 (1780811003) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=0 llite.lustre-ffff987588afa000.statahead_max=32 llite.lustre-ffff987588afa000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.77 seconds: 129.63 ops/second llite.lustre-ffff987588afa000.statahead_max=0 101 real 0m0.555s user 0m0.003s sys 0m0.198s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff987588afa000.statahead_max=32 llite.lustre-ffff987588afa000.statahead_max=32 101 real 0m0.385s user 0m0.002s sys 0m0.224s 'ls -l' 100 files with statahead: 1 sec statahead total: 58 statahead wrong: 1 agl total: 54 list_total: 25 fname_total: 33 hit_total: 13710 miss_total: 200 swrong=1 ewrong=1 total: 900 open/close in 2.14 seconds: 420.78 ops/second llite.lustre-ffff987588afa000.statahead_max=0 1001 real 0m5.921s user 0m0.019s sys 0m2.059s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff987588afa000.statahead_max=32 llite.lustre-ffff987588afa000.statahead_max=32 1001 real 0m3.851s user 0m0.014s sys 0m1.865s 'ls -l' 1000 files with statahead: 4 sec statahead total: 59 statahead wrong: 1 agl total: 55 list_total: 26 fname_total: 33 hit_total: 14709 miss_total: 201 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff987588afa000.statahead_stats= statahead total: 59 statahead wrong: 1 agl total: 55 list_total: 26 fname_total: 33 hit_total: 14709 miss_total: 201 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811029.776386340 secs.nsecs start_time: 1780811004.819084638 secs.nsecs elapsed_time: 24.957301702 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 2 5 8 4: 3 8 16 8: 1 2 18 16: 26 70 89 32: 4 10 100 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811029.776448529 secs.nsecs start_time: 1780811004.819154996 secs.nsecs elapsed_time: 24.957293533 secs.nsecs subreqs per batch batches % cum % 1: 2 5 5 2: 0 0 5 4: 0 0 5 8: 3 7 12 16: 11 27 40 32: 24 60 100 - open/close 4401 (time 1780811040.88 total 10.00 last 440.08) - open/close 8543 (time 1780811050.88 total 20.00 last 414.13) total: 10000 open/close in 23.35 seconds: 428.32 ops/second llite.lustre-ffff987588afa000.statahead_batch_max=0 llite.lustre-ffff987588afa000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.339s user 0m0.131s sys 0m37.038s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff987588afa000.statahead_batch_max=32 llite.lustre-ffff987588afa000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.660s user 0m0.149s sys 0m21.511s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811138.105616528 secs.nsecs start_time: 1780811095.356624552 secs.nsecs elapsed_time: 42.748991976 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811138.105656491 secs.nsecs start_time: 1780811095.356674074 secs.nsecs elapsed_time: 42.748982417 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=0 llite.lustre-ffff987588afa000.statahead_max=2048 llite.lustre-ffff987588afa000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.70 seconds: 141.91 ops/second llite.lustre-ffff987588afa000.statahead_max=0 101 real 0m0.571s user 0m0.000s sys 0m0.210s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff987588afa000.statahead_max=2048 llite.lustre-ffff987588afa000.statahead_max=2048 101 real 0m0.370s user 0m0.002s sys 0m0.245s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.92 seconds: 469.29 ops/second llite.lustre-ffff987588afa000.statahead_max=0 1001 real 0m5.543s user 0m0.014s sys 0m2.040s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff987588afa000.statahead_max=2048 llite.lustre-ffff987588afa000.statahead_max=2048 1001 real 0m3.247s user 0m0.015s sys 0m1.321s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff987588afa000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811246.263313186 secs.nsecs start_time: 1780811138.881988010 secs.nsecs elapsed_time: 107.381325176 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 16 16 8: 3 50 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811246.263399571 secs.nsecs start_time: 1780811138.882097307 secs.nsecs elapsed_time: 107.381302264 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 11 11 8: 2 22 33 16: 2 22 55 32: 1 11 66 64: 0 0 66 128: 1 11 77 256: 2 22 100 - open/close 4071 (time 1780811257.43 total 10.00 last 407.02) - open/close 8489 (time 1780811267.44 total 20.01 last 441.24) total: 10000 open/close in 23.16 seconds: 431.72 ops/second llite.lustre-ffff987588afa000.statahead_batch_max=0 llite.lustre-ffff987588afa000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.543s user 0m0.135s sys 0m36.836s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff987588afa000.statahead_batch_max=256 llite.lustre-ffff987588afa000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff987588afa000.stats=clear mdc.lustre-MDT0001-mdc-ffff987588afa000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.558s user 0m0.127s sys 0m20.062s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811352.013621638 secs.nsecs start_time: 1780811317.209642821 secs.nsecs elapsed_time: 34.803978817 secs.nsecs subreqs per batch batches % cum % 1: 260 66 66 2: 52 13 79 4: 14 3 83 8: 2 0 83 16: 3 0 84 32: 25 6 91 64: 0 0 91 128: 0 0 91 256: 35 8 100 mdc.lustre-MDT0001-mdc-ffff987588afa000.batch_stats= snapshot_time: 1780811352.013664006 secs.nsecs start_time: 1780811317.209720211 secs.nsecs elapsed_time: 34.803943795 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff987588afa000.statahead_batch_max=64 llite.lustre-ffff987588afa000.statahead_max=128