== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:13:10 (1787335990)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.69 seconds: 14.45 ops/second
 - mkdir 218 (time 1787336014.69 total 10.04 last 21.71)
 - mkdir 395 (time 1787336024.70 total 20.05 last 17.69)
 - mkdir 559 (time 1787336034.72 total 30.07 last 16.36)
 - mkdir 740 (time 1787336044.79 total 40.15 last 17.97)
 - mkdir 939 (time 1787336054.81 total 50.17 last 19.87)
total: 1000 mkdir in 53.63 seconds: 18.65 ops/second
 - mkdir 207 (time 1787336013.92 total 10.02 last 20.66)
 - mkdir 384 (time 1787336023.97 total 20.07 last 17.61)
 - mkdir 546 (time 1787336033.99 total 30.09 last 16.17)
 - mkdir 722 (time 1787336044.01 total 40.11 last 17.57)
 - mkdir 911 (time 1787336054.06 total 50.16 last 18.79)
total: 1000 mkdir in 56.51 seconds: 17.70 ops/second
 - mkdir 210 (time 1787336014.40 total 10.01 last 20.98)
 - mkdir 385 (time 1787336024.46 total 20.07 last 17.40)
 - mkdir 547 (time 1787336034.48 total 30.09 last 16.17)
 - mkdir 725 (time 1787336044.52 total 40.13 last 17.73)
 - mkdir 919 (time 1787336054.53 total 50.13 last 19.39)
total: 1000 mkdir in 56.04 seconds: 17.84 ops/second
 - mkdir 203 (time 1787336014.44 total 10.01 last 20.27)
 - mkdir 376 (time 1787336024.46 total 20.03 last 17.27)
 - mkdir 541 (time 1787336034.52 total 30.09 last 16.40)
 - mkdir 717 (time 1787336044.56 total 40.13 last 17.54)
 - mkdir 910 (time 1787336054.58 total 50.15 last 19.25)
total: 1000 mkdir in 57.86 seconds: 17.28 ops/second
 - mkdir 218 (time 1787336015.00 total 10.03 last 21.74)
 - mkdir 386 (time 1787336025.10 total 20.13 last 16.64)
 - mkdir 546 (time 1787336035.13 total 30.16 last 15.95)
 - mkdir 727 (time 1787336045.16 total 40.18 last 18.05)
 - mkdir 920 (time 1787336055.16 total 50.18 last 19.30)
total: 1000 mkdir in 57.42 seconds: 17.42 ops/second
 - mkdir 204 (time 1787336014.59 total 10.04 last 20.32)
 - mkdir 376 (time 1787336024.62 total 20.06 last 17.16)
 - mkdir 541 (time 1787336034.63 total 30.08 last 16.47)
 - mkdir 716 (time 1787336044.65 total 40.09 last 17.48)
 - mkdir 907 (time 1787336054.68 total 50.13 last 19.04)
total: 1000 mkdir in 58.30 seconds: 17.15 ops/second
 - mkdir 210 (time 1787336014.95 total 10.02 last 20.96)
 - mkdir 378 (time 1787336025.00 total 20.08 last 16.70)
 - mkdir 537 (time 1787336035.05 total 30.13 last 15.82)
 - mkdir 713 (time 1787336045.07 total 40.14 last 17.58)
 - mkdir 909 (time 1787336055.09 total 50.17 last 19.55)
total: 1000 mkdir in 58.78 seconds: 17.01 ops/second
 - mkdir 209 (time 1787336014.98 total 10.01 last 20.89)
 - mkdir 376 (time 1787336025.01 total 20.03 last 16.65)
 - mkdir 538 (time 1787336035.04 total 30.06 last 16.15)
 - mkdir 713 (time 1787336045.04 total 40.07 last 17.48)
 - mkdir 909 (time 1787336055.05 total 50.08 last 19.59)
total: 1000 mkdir in 58.78 seconds: 17.01 ops/second
 - mkdir 187 (time 1787336012.78 total 10.04 last 18.62)
 - mkdir 372 (time 1787336022.82 total 20.08 last 18.43)
 - mkdir 521 (time 1787336032.85 total 30.11 last 14.86)
 - mkdir 693 (time 1787336042.90 total 40.16 last 17.12)
 - mkdir 866 (time 1787336052.92 total 50.18 last 17.25)
 - mkdir 994 (time 1787336063.07 total 60.33 last 12.61)
total: 1000 mkdir in 61.03 seconds: 16.39 ops/second
 - mkdir 183 (time 1787336013.21 total 10.04 last 18.22)
 - mkdir 358 (time 1787336023.28 total 20.11 last 17.39)
 - mkdir 510 (time 1787336033.33 total 30.16 last 15.12)
 - mkdir 684 (time 1787336043.38 total 40.21 last 17.32)
 - mkdir 865 (time 1787336053.39 total 50.22 last 18.08)
 - mkdir 981 (time 1787336063.40 total 60.23 last 11.58)
total: 1000 mkdir in 62.19 seconds: 16.08 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.48 seconds: 20.62 ops/second
 - mkdir 196 (time 1787336636.42 total 10.01 last 19.59)
 - mkdir 412 (time 1787336646.45 total 20.03 last 21.54)
 - mkdir 668 (time 1787336656.49 total 30.08 last 25.48)
 - mkdir 877 (time 1787336666.50 total 40.09 last 20.88)
total: 1000 mkdir in 46.54 seconds: 21.49 ops/second
 - mkdir 212 (time 1787336637.65 total 10.02 last 21.16)
 - mkdir 425 (time 1787336647.70 total 20.07 last 21.20)
 - mkdir 698 (time 1787336657.72 total 30.08 last 27.25)
 - mkdir 896 (time 1787336667.79 total 40.15 last 19.66)
total: 1000 mkdir in 45.88 seconds: 21.80 ops/second
 - mkdir 241 (time 1787336638.94 total 10.04 last 24.01)
 - mkdir 438 (time 1787336648.96 total 20.05 last 19.67)
 - mkdir 722 (time 1787336658.99 total 30.09 last 28.31)
 - mkdir 913 (time 1787336669.07 total 40.17 last 18.95)
total: 1000 mkdir in 45.21 seconds: 22.12 ops/second
 - mkdir 232 (time 1787336638.74 total 10.01 last 23.19)
 - mkdir 427 (time 1787336648.75 total 20.02 last 19.48)
 - mkdir 703 (time 1787336658.76 total 30.03 last 27.57)
 - mkdir 901 (time 1787336668.79 total 40.06 last 19.73)
total: 1000 mkdir in 46.05 seconds: 21.71 ops/second
 - mkdir 230 (time 1787336639.14 total 10.08 last 22.83)
 - mkdir 422 (time 1787336649.14 total 20.08 last 19.19)
 - mkdir 700 (time 1787336659.20 total 30.14 last 27.63)
 - mkdir 901 (time 1787336669.25 total 40.19 last 20.00)
total: 1000 mkdir in 47.22 seconds: 21.18 ops/second
 - mkdir 225 (time 1787336638.60 total 10.08 last 22.33)
 - mkdir 424 (time 1787336648.71 total 20.18 last 19.69)
 - mkdir 704 (time 1787336658.71 total 30.19 last 27.98)
 - mkdir 897 (time 1787336668.72 total 40.20 last 19.29)
total: 1000 mkdir in 47.86 seconds: 20.89 ops/second
 - mkdir 233 (time 1787336638.81 total 10.04 last 23.22)
 - mkdir 432 (time 1787336648.88 total 20.10 last 19.76)
 - mkdir 702 (time 1787336658.93 total 30.15 last 26.87)
 - mkdir 894 (time 1787336668.97 total 40.20 last 19.12)
total: 1000 mkdir in 48.97 seconds: 20.42 ops/second
 - mkdir 224 (time 1787336638.37 total 10.04 last 22.30)
 - mkdir 418 (time 1787336648.43 total 20.10 last 19.30)
 - mkdir 691 (time 1787336658.44 total 30.11 last 27.26)
 - mkdir 878 (time 1787336668.45 total 40.12 last 18.69)
total: 1000 mkdir in 49.76 seconds: 20.10 ops/second
 - mkdir 222 (time 1787336638.17 total 10.00 last 22.19)
 - mkdir 411 (time 1787336648.20 total 20.03 last 18.85)
 - mkdir 680 (time 1787336658.23 total 30.06 last 26.82)
 - mkdir 864 (time 1787336668.25 total 40.08 last 18.37)
 - mkdir 994 (time 1787336678.30 total 50.13 last 12.93)
total: 1000 mkdir in 50.78 seconds: 19.69 ops/second
 - mkdir 194 (time 1787336637.12 total 10.04 last 19.32)
 - mkdir 392 (time 1787336647.12 total 20.05 last 19.79)
 - mkdir 643 (time 1787336657.14 total 30.06 last 25.07)
 - mkdir 837 (time 1787336667.15 total 40.07 last 19.38)
 - mkdir 972 (time 1787336677.29 total 50.22 last 13.31)
total: 1000 mkdir in 52.88 seconds: 18.91 ops/second
Time for file creation 63 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787336690 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787336692 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787336692 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787336692 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787336693 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787336692 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787336692 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787336693 ; total 1 ; last 1)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787336693 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787336693 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
Time for file removal 52 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8