== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:14:10 (1789690450)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.57 seconds: 17.60 ops/second
 - mkdir 135 (time 1789690474.03 total 10.02 last 13.47)
 - mkdir 281 (time 1789690484.10 total 20.09 last 14.50)
 - mkdir 424 (time 1789690494.11 total 30.11 last 14.28)
 - mkdir 568 (time 1789690504.15 total 40.14 last 14.35)
 - mkdir 727 (time 1789690514.27 total 50.26 last 15.72)
 - mkdir 908 (time 1789690524.29 total 60.28 last 18.05)
total: 1000 mkdir in 66.10 seconds: 15.13 ops/second
 - mkdir 131 (time 1789690474.00 total 10.02 last 13.08)
 - mkdir 272 (time 1789690484.01 total 20.04 last 14.08)
 - mkdir 409 (time 1789690494.05 total 30.07 last 13.65)
 - mkdir 555 (time 1789690504.06 total 40.09 last 14.58)
 - mkdir 715 (time 1789690514.07 total 50.10 last 15.98)
 - mkdir 901 (time 1789690524.10 total 60.12 last 18.56)
total: 1000 mkdir in 67.06 seconds: 14.91 ops/second
 - mkdir 130 (time 1789690473.69 total 10.01 last 12.99)
 - mkdir 271 (time 1789690483.69 total 20.01 last 14.09)
 - mkdir 407 (time 1789690493.69 total 30.01 last 13.60)
 - mkdir 552 (time 1789690503.73 total 40.05 last 14.45)
 - mkdir 705 (time 1789690513.77 total 50.10 last 15.23)
 - mkdir 885 (time 1789690523.82 total 60.14 last 17.92)
total: 1000 mkdir in 67.82 seconds: 14.74 ops/second
 - mkdir 129 (time 1789690474.85 total 10.15 last 12.71)
 - mkdir 269 (time 1789690484.93 total 20.23 last 13.89)
 - mkdir 404 (time 1789690494.96 total 30.26 last 13.46)
 - mkdir 549 (time 1789690505.02 total 40.32 last 14.42)
 - mkdir 708 (time 1789690515.05 total 50.34 last 15.86)
 - mkdir 896 (time 1789690525.15 total 60.45 last 18.61)
total: 1000 mkdir in 67.97 seconds: 14.71 ops/second
 - mkdir 128 (time 1789690474.68 total 10.01 last 12.79)
 - mkdir 265 (time 1789690484.69 total 20.01 last 13.69)
 - mkdir 401 (time 1789690494.75 total 30.07 last 13.51)
 - mkdir 546 (time 1789690504.77 total 40.09 last 14.48)
 - mkdir 704 (time 1789690514.77 total 50.09 last 15.79)
 - mkdir 889 (time 1789690524.84 total 60.16 last 18.38)
total: 1000 mkdir in 68.35 seconds: 14.63 ops/second
 - mkdir 132 (time 1789690474.65 total 10.01 last 13.19)
 - mkdir 268 (time 1789690484.71 total 20.07 last 13.52)
 - mkdir 411 (time 1789690494.77 total 30.12 last 14.22)
 - mkdir 554 (time 1789690504.82 total 40.17 last 14.23)
 - mkdir 708 (time 1789690514.84 total 50.19 last 15.37)
 - mkdir 887 (time 1789690524.85 total 60.20 last 17.89)
total: 1000 mkdir in 68.42 seconds: 14.62 ops/second
 - mkdir 125 (time 1789690473.99 total 10.03 last 12.46)
 - mkdir 262 (time 1789690484.05 total 20.09 last 13.62)
 - mkdir 392 (time 1789690494.13 total 30.18 last 12.89)
 - mkdir 538 (time 1789690504.16 total 40.20 last 14.56)
 - mkdir 698 (time 1789690514.20 total 50.24 last 15.94)
 - mkdir 878 (time 1789690524.23 total 60.28 last 17.93)
total: 1000 mkdir in 69.45 seconds: 14.40 ops/second
 - mkdir 125 (time 1789690474.39 total 10.02 last 12.48)
 - mkdir 260 (time 1789690484.39 total 20.02 last 13.50)
 - mkdir 398 (time 1789690494.43 total 30.06 last 13.75)
 - mkdir 546 (time 1789690504.49 total 40.12 last 14.70)
 - mkdir 699 (time 1789690514.53 total 50.16 last 15.25)
 - mkdir 881 (time 1789690524.54 total 60.17 last 18.19)
total: 1000 mkdir in 69.58 seconds: 14.37 ops/second
 - mkdir 133 (time 1789690474.90 total 10.03 last 13.26)
 - mkdir 269 (time 1789690484.94 total 20.08 last 13.54)
 - mkdir 402 (time 1789690494.99 total 30.12 last 13.24)
 - mkdir 549 (time 1789690505.00 total 40.13 last 14.69)
 - mkdir 709 (time 1789690515.07 total 50.20 last 15.90)
 - mkdir 887 (time 1789690525.17 total 60.31 last 17.61)
total: 1000 mkdir in 69.26 seconds: 14.44 ops/second
 - mkdir 119 (time 1789690473.10 total 10.03 last 11.86)
 - mkdir 248 (time 1789690483.11 total 20.05 last 12.88)
 - mkdir 378 (time 1789690493.21 total 30.15 last 12.87)
 - mkdir 520 (time 1789690503.23 total 40.16 last 14.18)
 - mkdir 676 (time 1789690513.23 total 50.17 last 15.59)
 - mkdir 857 (time 1789690523.29 total 60.22 last 18.01)
 - mkdir 992 (time 1789690533.34 total 70.27 last 13.42)
total: 1000 mkdir in 71.16 seconds: 14.05 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.41 seconds: 24.43 ops/second
 - mkdir 146 (time 1789691113.20 total 10.06 last 14.52)
 - mkdir 304 (time 1789691123.24 total 20.10 last 15.74)
 - mkdir 462 (time 1789691133.26 total 30.12 last 15.77)
 - mkdir 611 (time 1789691143.35 total 40.21 last 14.76)
 - mkdir 757 (time 1789691153.37 total 50.23 last 14.57)
 - mkdir 900 (time 1789691163.39 total 60.25 last 14.27)
total: 1000 mkdir in 66.43 seconds: 15.05 ops/second
 - mkdir 137 (time 1789691112.55 total 10.02 last 13.68)
 - mkdir 292 (time 1789691122.57 total 20.03 last 15.48)
 - mkdir 438 (time 1789691132.61 total 30.07 last 14.54)
 - mkdir 595 (time 1789691142.70 total 40.16 last 15.56)
 - mkdir 742 (time 1789691152.76 total 50.22 last 14.61)
 - mkdir 886 (time 1789691162.80 total 60.27 last 14.33)
total: 1000 mkdir in 67.90 seconds: 14.73 ops/second
 - mkdir 146 (time 1789691113.41 total 10.07 last 14.50)
 - mkdir 310 (time 1789691123.42 total 20.09 last 16.37)
 - mkdir 464 (time 1789691133.44 total 30.10 last 15.38)
 - mkdir 613 (time 1789691143.53 total 40.19 last 14.77)
 - mkdir 755 (time 1789691153.65 total 50.31 last 14.03)
 - mkdir 901 (time 1789691163.68 total 60.34 last 14.56)
total: 1000 mkdir in 67.62 seconds: 14.79 ops/second
 - mkdir 157 (time 1789691115.02 total 10.01 last 15.68)
 - mkdir 317 (time 1789691125.12 total 20.11 last 15.85)
 - mkdir 480 (time 1789691135.15 total 30.14 last 16.25)
 - mkdir 628 (time 1789691145.19 total 40.18 last 14.74)
 - mkdir 768 (time 1789691155.22 total 50.21 last 13.97)
 - mkdir 923 (time 1789691165.26 total 60.25 last 15.44)
total: 1000 mkdir in 66.33 seconds: 15.08 ops/second
 - mkdir 153 (time 1789691114.52 total 10.02 last 15.27)
 - mkdir 312 (time 1789691124.56 total 20.06 last 15.84)
 - mkdir 463 (time 1789691134.61 total 30.11 last 15.03)
 - mkdir 610 (time 1789691144.64 total 40.14 last 14.65)
 - mkdir 752 (time 1789691154.68 total 50.18 last 14.14)
 - mkdir 906 (time 1789691164.71 total 60.21 last 15.35)
total: 1000 mkdir in 67.72 seconds: 14.77 ops/second
 - mkdir 150 (time 1789691114.84 total 10.06 last 14.91)
 - mkdir 306 (time 1789691124.92 total 20.14 last 15.47)
 - mkdir 464 (time 1789691134.92 total 30.15 last 15.79)
 - mkdir 612 (time 1789691144.97 total 40.20 last 14.73)
 - mkdir 755 (time 1789691155.01 total 50.24 last 14.24)
 - mkdir 908 (time 1789691165.03 total 60.26 last 15.28)
total: 1000 mkdir in 68.13 seconds: 14.68 ops/second
 - mkdir 130 (time 1789691112.21 total 10.03 last 12.97)
 - mkdir 279 (time 1789691122.25 total 20.06 last 14.84)
 - mkdir 424 (time 1789691132.26 total 30.07 last 14.49)
 - mkdir 581 (time 1789691142.30 total 40.12 last 15.63)
 - mkdir 723 (time 1789691152.32 total 50.14 last 14.17)
 - mkdir 867 (time 1789691162.39 total 60.20 last 14.31)
 - mkdir 994 (time 1789691172.45 total 70.26 last 12.62)
total: 1000 mkdir in 70.87 seconds: 14.11 ops/second
 - mkdir 139 (time 1789691113.74 total 10.07 last 13.80)
 - mkdir 289 (time 1789691123.79 total 20.12 last 14.93)
 - mkdir 438 (time 1789691133.84 total 30.17 last 14.82)
 - mkdir 586 (time 1789691143.87 total 40.20 last 14.76)
 - mkdir 731 (time 1789691153.94 total 50.27 last 14.40)
 - mkdir 884 (time 1789691164.00 total 60.32 last 15.22)
total: 1000 mkdir in 69.54 seconds: 14.38 ops/second
 - mkdir 158 (time 1789691115.04 total 10.04 last 15.74)
 - mkdir 311 (time 1789691125.04 total 20.04 last 15.30)
 - mkdir 467 (time 1789691135.07 total 30.07 last 15.55)
 - mkdir 615 (time 1789691145.07 total 40.07 last 14.80)
 - mkdir 756 (time 1789691155.12 total 50.11 last 14.04)
 - mkdir 908 (time 1789691165.17 total 60.16 last 15.13)
total: 1000 mkdir in 68.42 seconds: 14.62 ops/second
 - mkdir 158 (time 1789691115.27 total 10.06 last 15.71)
 - mkdir 310 (time 1789691125.28 total 20.06 last 15.19)
 - mkdir 465 (time 1789691135.33 total 30.11 last 15.42)
 - mkdir 614 (time 1789691145.34 total 40.13 last 14.87)
 - mkdir 754 (time 1789691155.39 total 50.18 last 13.94)
 - mkdir 906 (time 1789691165.43 total 60.21 last 15.14)
total: 1000 mkdir in 68.83 seconds: 14.53 ops/second
Time for file creation 81 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789691184 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1789691184 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1789691185 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1789691186 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
Time for file removal 51 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8