== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 11:17:07 (1786202227)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.51 seconds: 19.73 ops/second
 - mkdir 51 (time 1786202259.81 total 10.13 last 5.04)
 - mkdir 142 (time 1786202270.12 total 20.43 last 8.83)
 - mkdir 239 (time 1786202280.18 total 30.50 last 9.63)
 - mkdir 363 (time 1786202290.23 total 40.54 last 12.35)
 - mkdir 510 (time 1786202300.26 total 50.57 last 14.66)
 - mkdir 659 (time 1786202310.26 total 60.57 last 14.90)
 - mkdir 882 (time 1786202320.26 total 70.57 last 22.30)
total: 1000 mkdir in 73.55 seconds: 13.60 ops/second
 - mkdir 40 (time 1786202256.88 total 10.11 last 3.96)
 - mkdir 125 (time 1786202267.04 total 20.26 last 8.37)
 - mkdir 205 (time 1786202277.10 total 30.33 last 7.95)
 - mkdir 323 (time 1786202287.11 total 40.33 last 11.79)
 - mkdir 464 (time 1786202297.15 total 50.37 last 14.04)
 - mkdir 600 (time 1786202307.17 total 60.39 last 13.57)
 - mkdir 797 (time 1786202317.19 total 70.42 last 19.66)
total: 1000 mkdir in 76.69 seconds: 13.04 ops/second
 - mkdir 71 (time 1786202262.39 total 10.04 last 7.07)
 - mkdir 154 (time 1786202272.44 total 20.09 last 8.26)
 - mkdir 259 (time 1786202282.47 total 30.12 last 10.47)
 - mkdir 385 (time 1786202292.51 total 40.16 last 12.55)
 - mkdir 531 (time 1786202302.51 total 50.17 last 14.59)
 - mkdir 686 (time 1786202312.55 total 60.21 last 15.44)
 - mkdir 947 (time 1786202322.56 total 70.21 last 26.09)
total: 1000 mkdir in 71.69 seconds: 13.95 ops/second
 - mkdir 41 (time 1786202258.03 total 10.16 last 4.04)
 - mkdir 126 (time 1786202268.15 total 20.28 last 8.39)
 - mkdir 208 (time 1786202278.23 total 30.36 last 8.14)
 - mkdir 323 (time 1786202288.43 total 40.56 last 11.27)
 - mkdir 470 (time 1786202298.52 total 50.65 last 14.58)
 - mkdir 616 (time 1786202308.55 total 60.68 last 14.55)
 - mkdir 818 (time 1786202318.55 total 70.68 last 20.20)
total: 1000 mkdir in 76.24 seconds: 13.12 ops/second
 - mkdir 68 (time 1786202262.21 total 10.01 last 6.79)
 - mkdir 149 (time 1786202272.35 total 20.14 last 7.99)
 - mkdir 251 (time 1786202282.41 total 30.21 last 10.14)
 - mkdir 379 (time 1786202292.45 total 40.24 last 12.76)
 - mkdir 528 (time 1786202302.52 total 50.32 last 14.79)
 - mkdir 688 (time 1786202312.52 total 60.32 last 16.00)
 - mkdir 945 (time 1786202322.54 total 70.33 last 25.66)
total: 1000 mkdir in 71.91 seconds: 13.91 ops/second
 - mkdir 47 (time 1786202258.75 total 10.03 last 4.69)
 - mkdir 132 (time 1786202268.78 total 20.06 last 8.47)
 - mkdir 214 (time 1786202278.82 total 30.10 last 8.17)
 - mkdir 333 (time 1786202288.84 total 40.12 last 11.87)
 - mkdir 475 (time 1786202298.86 total 50.14 last 14.18)
 - mkdir 621 (time 1786202308.86 total 60.15 last 14.59)
 - mkdir 828 (time 1786202318.90 total 70.19 last 20.61)
total: 1000 mkdir in 75.46 seconds: 13.25 ops/second
 - mkdir 29 (time 1786202253.33 total 10.02 last 2.90)
 - mkdir 96 (time 1786202263.34 total 20.02 last 6.70)
 - mkdir 169 (time 1786202273.41 total 30.09 last 7.25)
 - mkdir 273 (time 1786202283.41 total 40.09 last 10.40)
 - mkdir 404 (time 1786202293.42 total 50.11 last 13.08)
 - mkdir 549 (time 1786202303.48 total 60.17 last 14.41)
 - mkdir 713 (time 1786202313.48 total 70.17 last 16.40)
 - mkdir 986 (time 1786202323.53 total 80.22 last 27.17)
total: 1000 mkdir in 81.01 seconds: 12.34 ops/second
 - mkdir 68 (time 1786202262.24 total 10.01 last 6.80)
 - mkdir 145 (time 1786202272.32 total 20.09 last 7.63)
 - mkdir 242 (time 1786202282.33 total 30.10 last 9.69)
 - mkdir 373 (time 1786202292.34 total 40.11 last 13.09)
 - mkdir 523 (time 1786202302.39 total 50.16 last 14.91)
 - mkdir 679 (time 1786202312.43 total 60.20 last 15.54)
 - mkdir 935 (time 1786202322.44 total 70.21 last 25.57)
total: 1000 mkdir in 72.54 seconds: 13.79 ops/second
 - mkdir 56 (time 1786202261.28 total 10.04 last 5.58)
 - mkdir 142 (time 1786202271.45 total 20.20 last 8.46)
 - mkdir 234 (time 1786202281.51 total 30.26 last 9.14)
 - mkdir 353 (time 1786202291.52 total 40.27 last 11.89)
 - mkdir 502 (time 1786202301.58 total 50.34 last 14.81)
 - mkdir 656 (time 1786202311.60 total 60.35 last 15.38)
 - mkdir 894 (time 1786202321.61 total 70.37 last 23.76)
total: 1000 mkdir in 73.62 seconds: 13.58 ops/second
 - mkdir 41 (time 1786202257.83 total 10.08 last 4.07)
 - mkdir 124 (time 1786202267.86 total 20.10 last 8.28)
 - mkdir 199 (time 1786202277.93 total 30.17 last 7.45)
 - mkdir 317 (time 1786202287.98 total 40.22 last 11.74)
 - mkdir 458 (time 1786202298.00 total 50.25 last 14.07)
 - mkdir 599 (time 1786202308.02 total 60.26 last 14.08)
 - mkdir 797 (time 1786202318.02 total 70.27 last 19.79)
total: 1000 mkdir in 77.25 seconds: 12.94 ops/second
Time for file creation 94 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 8 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.24 seconds: 41.52 ops/second
total: 1000 mkdir in 5.63 seconds: 177.70 ops/second
total: 1000 mkdir in 7.61 seconds: 131.41 ops/second
 - mkdir 997 (time 1786202504.89 total 10.01 last 99.56)
total: 1000 mkdir in 10.24 seconds: 97.69 ops/second
 - mkdir 991 (time 1786202504.88 total 10.04 last 98.71)
total: 1000 mkdir in 10.55 seconds: 94.78 ops/second
 - mkdir 977 (time 1786202504.96 total 10.04 last 97.30)
total: 1000 mkdir in 11.24 seconds: 88.93 ops/second
 - mkdir 977 (time 1786202505.09 total 10.12 last 96.52)
total: 1000 mkdir in 11.27 seconds: 88.76 ops/second
 - mkdir 975 (time 1786202505.01 total 10.01 last 97.38)
total: 1000 mkdir in 11.30 seconds: 88.50 ops/second
 - mkdir 970 (time 1786202505.10 total 10.08 last 96.27)
total: 1000 mkdir in 11.43 seconds: 87.52 ops/second
 - mkdir 964 (time 1786202505.10 total 10.04 last 96.06)
total: 1000 mkdir in 11.49 seconds: 87.04 ops/second
 - mkdir 952 (time 1786202505.10 total 10.05 last 94.71)
total: 1000 mkdir in 11.72 seconds: 85.33 ops/second
Time for file creation 16 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786202511 ; total 0 ; last 0)
total: 1000 unlinks in 4 seconds: 250.000000 unlinks/second
 - unlinked 0 (time 1786202511 ; total 0 ; last 0)
total: 1000 unlinks in 4 seconds: 250.000000 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 10 seconds: 100.000000 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 11 seconds: 90.909088 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 11 seconds: 90.909088 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 11 seconds: 90.909088 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 11 seconds: 90.909088 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 12 seconds: 83.333336 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 12 seconds: 83.333336 unlinks/second
 - unlinked 0 (time 1786202512 ; total 0 ; last 0)
total: 1000 unlinks in 12 seconds: 83.333336 unlinks/second
Time for file removal 18 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8