== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 10:10:23 (1787839823)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.54 seconds: 18.58 ops/second
 - mkdir 144 (time 1787839842.95 total 10.01 last 14.39)
 - mkdir 284 (time 1787839852.97 total 20.03 last 13.97)
 - mkdir 463 (time 1787839863.02 total 30.08 last 17.81)
 - mkdir 647 (time 1787839873.04 total 40.09 last 18.37)
 - mkdir 816 (time 1787839883.12 total 50.18 last 16.76)
 - mkdir 994 (time 1787839893.14 total 60.20 last 17.76)
total: 1000 mkdir in 60.50 seconds: 16.53 ops/second
 - mkdir 151 (time 1787839844.90 total 10.03 last 15.05)
 - mkdir 300 (time 1787839854.92 total 20.06 last 14.87)
 - mkdir 479 (time 1787839864.93 total 30.06 last 17.89)
 - mkdir 666 (time 1787839874.94 total 40.08 last 18.68)
 - mkdir 838 (time 1787839884.94 total 50.08 last 17.19)
total: 1000 mkdir in 59.20 seconds: 16.89 ops/second
 - mkdir 134 (time 1787839844.31 total 10.04 last 13.35)
 - mkdir 282 (time 1787839854.31 total 20.04 last 14.79)
 - mkdir 461 (time 1787839864.32 total 30.05 last 17.88)
 - mkdir 645 (time 1787839874.34 total 40.07 last 18.37)
 - mkdir 811 (time 1787839884.39 total 50.11 last 16.52)
 - mkdir 981 (time 1787839894.42 total 60.14 last 16.95)
total: 1000 mkdir in 61.83 seconds: 16.17 ops/second
 - mkdir 140 (time 1787839843.94 total 10.13 last 13.82)
 - mkdir 280 (time 1787839854.04 total 20.24 last 13.85)
 - mkdir 456 (time 1787839864.05 total 30.24 last 17.60)
 - mkdir 642 (time 1787839874.08 total 40.27 last 18.54)
 - mkdir 808 (time 1787839884.16 total 50.36 last 16.46)
 - mkdir 977 (time 1787839894.20 total 60.39 last 16.84)
total: 1000 mkdir in 62.91 seconds: 15.90 ops/second
 - mkdir 141 (time 1787839844.03 total 10.08 last 13.98)
 - mkdir 279 (time 1787839854.04 total 20.09 last 13.79)
 - mkdir 451 (time 1787839864.08 total 30.13 last 17.13)
 - mkdir 633 (time 1787839874.08 total 40.14 last 18.19)
 - mkdir 802 (time 1787839884.13 total 50.18 last 16.82)
 - mkdir 975 (time 1787839894.17 total 60.22 last 17.23)
total: 1000 mkdir in 63.15 seconds: 15.83 ops/second
 - mkdir 138 (time 1787839844.95 total 10.06 last 13.71)
 - mkdir 286 (time 1787839855.06 total 20.17 last 14.65)
 - mkdir 466 (time 1787839865.12 total 30.23 last 17.89)
 - mkdir 652 (time 1787839875.13 total 40.24 last 18.57)
 - mkdir 815 (time 1787839885.15 total 50.26 last 16.28)
 - mkdir 984 (time 1787839895.15 total 60.26 last 16.90)
total: 1000 mkdir in 62.41 seconds: 16.02 ops/second
 - mkdir 132 (time 1787839844.57 total 10.03 last 13.16)
 - mkdir 278 (time 1787839854.59 total 20.04 last 14.58)
 - mkdir 453 (time 1787839864.60 total 30.06 last 17.47)
 - mkdir 640 (time 1787839874.62 total 40.08 last 18.66)
 - mkdir 805 (time 1787839884.66 total 50.12 last 16.44)
 - mkdir 972 (time 1787839894.74 total 60.20 last 16.56)
total: 1000 mkdir in 64.06 seconds: 15.61 ops/second
 - mkdir 135 (time 1787839845.03 total 10.04 last 13.45)
 - mkdir 281 (time 1787839855.05 total 20.06 last 14.57)
 - mkdir 454 (time 1787839865.06 total 30.07 last 17.28)
 - mkdir 637 (time 1787839875.07 total 40.08 last 18.29)
 - mkdir 800 (time 1787839885.11 total 50.11 last 16.24)
 - mkdir 966 (time 1787839895.11 total 60.12 last 16.59)
total: 1000 mkdir in 64.68 seconds: 15.46 ops/second
 - mkdir 129 (time 1787839845.04 total 10.01 last 12.88)
 - mkdir 270 (time 1787839855.06 total 20.04 last 14.07)
 - mkdir 442 (time 1787839865.12 total 30.09 last 17.10)
 - mkdir 625 (time 1787839875.21 total 40.18 last 18.14)
 - mkdir 785 (time 1787839885.28 total 50.26 last 15.88)
 - mkdir 951 (time 1787839895.31 total 60.28 last 16.56)
total: 1000 mkdir in 66.31 seconds: 15.08 ops/second
 - mkdir 126 (time 1787839844.04 total 10.03 last 12.57)
 - mkdir 259 (time 1787839854.06 total 20.04 last 13.28)
 - mkdir 428 (time 1787839864.09 total 30.07 last 16.85)
 - mkdir 608 (time 1787839874.11 total 40.09 last 17.97)
 - mkdir 764 (time 1787839884.17 total 50.16 last 15.50)
 - mkdir 928 (time 1787839894.20 total 60.18 last 16.36)
total: 1000 mkdir in 67.88 seconds: 14.73 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.29 ops/second
 - mkdir 208 (time 1787840472.83 total 10.07 last 20.66)
 - mkdir 402 (time 1787840482.87 total 20.10 last 19.33)
 - mkdir 572 (time 1787840492.89 total 30.13 last 16.96)
 - mkdir 710 (time 1787840502.94 total 40.17 last 13.74)
 - mkdir 840 (time 1787840512.95 total 50.19 last 12.98)
 - mkdir 999 (time 1787840522.96 total 60.20 last 15.88)
total: 1000 mkdir in 60.20 seconds: 16.61 ops/second
 - mkdir 202 (time 1787840472.41 total 10.02 last 20.16)
 - mkdir 391 (time 1787840482.42 total 20.03 last 18.88)
 - mkdir 561 (time 1787840492.44 total 30.06 last 16.96)
 - mkdir 705 (time 1787840502.51 total 40.12 last 14.30)
 - mkdir 832 (time 1787840512.53 total 50.15 last 12.67)
 - mkdir 979 (time 1787840522.55 total 60.16 last 14.67)
total: 1000 mkdir in 61.01 seconds: 16.39 ops/second
 - mkdir 203 (time 1787840472.07 total 10.00 last 20.29)
 - mkdir 379 (time 1787840482.08 total 20.02 last 17.57)
 - mkdir 547 (time 1787840492.10 total 30.03 last 16.78)
 - mkdir 681 (time 1787840502.15 total 40.09 last 13.33)
 - mkdir 818 (time 1787840512.30 total 50.23 last 13.50)
 - mkdir 968 (time 1787840522.34 total 60.28 last 14.93)
total: 1000 mkdir in 61.91 seconds: 16.15 ops/second
 - mkdir 197 (time 1787840472.32 total 10.06 last 19.58)
 - mkdir 384 (time 1787840482.34 total 20.09 last 18.65)
 - mkdir 551 (time 1787840492.39 total 30.14 last 16.62)
 - mkdir 685 (time 1787840502.42 total 40.17 last 13.35)
 - mkdir 820 (time 1787840512.48 total 50.23 last 13.42)
 - mkdir 968 (time 1787840522.48 total 60.23 last 14.80)
total: 1000 mkdir in 61.89 seconds: 16.16 ops/second
 - mkdir 197 (time 1787840472.75 total 10.03 last 19.64)
 - mkdir 386 (time 1787840482.76 total 20.05 last 18.87)
 - mkdir 555 (time 1787840492.81 total 30.09 last 16.82)
 - mkdir 693 (time 1787840502.86 total 40.14 last 13.73)
 - mkdir 822 (time 1787840512.90 total 50.18 last 12.85)
 - mkdir 982 (time 1787840522.90 total 60.18 last 16.00)
total: 1000 mkdir in 61.48 seconds: 16.27 ops/second
 - mkdir 199 (time 1787840472.63 total 10.03 last 19.83)
 - mkdir 385 (time 1787840482.64 total 20.04 last 18.58)
 - mkdir 557 (time 1787840492.71 total 30.12 last 17.07)
 - mkdir 688 (time 1787840502.75 total 40.16 last 13.05)
 - mkdir 820 (time 1787840512.78 total 50.18 last 13.17)
 - mkdir 976 (time 1787840522.79 total 60.19 last 15.58)
total: 1000 mkdir in 61.75 seconds: 16.20 ops/second
 - mkdir 198 (time 1787840472.44 total 10.02 last 19.77)
 - mkdir 379 (time 1787840482.44 total 20.02 last 18.10)
 - mkdir 549 (time 1787840492.47 total 30.05 last 16.95)
 - mkdir 689 (time 1787840502.51 total 40.09 last 13.94)
 - mkdir 817 (time 1787840512.56 total 50.14 last 12.73)
 - mkdir 967 (time 1787840522.58 total 60.16 last 14.97)
total: 1000 mkdir in 62.08 seconds: 16.11 ops/second
 - mkdir 200 (time 1787840472.62 total 10.07 last 19.86)
 - mkdir 386 (time 1787840482.64 total 20.08 last 18.57)
 - mkdir 554 (time 1787840492.72 total 30.17 last 16.67)
 - mkdir 688 (time 1787840502.74 total 40.18 last 13.38)
 - mkdir 816 (time 1787840512.76 total 50.20 last 12.77)
 - mkdir 971 (time 1787840522.77 total 60.22 last 15.48)
total: 1000 mkdir in 62.05 seconds: 16.12 ops/second
 - mkdir 196 (time 1787840472.92 total 10.04 last 19.53)
 - mkdir 387 (time 1787840482.94 total 20.06 last 19.06)
 - mkdir 551 (time 1787840492.98 total 30.10 last 16.34)
 - mkdir 688 (time 1787840503.02 total 40.13 last 13.65)
 - mkdir 818 (time 1787840513.10 total 50.22 last 12.89)
 - mkdir 975 (time 1787840523.16 total 60.28 last 15.60)
total: 1000 mkdir in 62.01 seconds: 16.13 ops/second
 - mkdir 191 (time 1787840472.54 total 10.01 last 19.07)
 - mkdir 376 (time 1787840482.60 total 20.07 last 18.39)
 - mkdir 543 (time 1787840492.71 total 30.18 last 16.52)
 - mkdir 674 (time 1787840502.71 total 40.19 last 13.10)
 - mkdir 805 (time 1787840512.74 total 50.21 last 13.06)
 - mkdir 958 (time 1787840522.76 total 60.23 last 15.27)
total: 1000 mkdir in 62.85 seconds: 15.91 ops/second
Time for file creation 72 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787840532 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787840534 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840533 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787840534 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787840534 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8