== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 04:28:02 (1781252882)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.53 seconds: 18.91 ops/second
 - mkdir 154 (time 1781252901.25 total 10.03 last 15.35)
 - mkdir 318 (time 1781252911.28 total 20.06 last 16.35)
 - mkdir 487 (time 1781252921.34 total 30.12 last 16.80)
 - mkdir 692 (time 1781252931.36 total 40.14 last 20.47)
 - mkdir 867 (time 1781252941.40 total 50.18 last 17.43)
total: 1000 mkdir in 56.21 seconds: 17.79 ops/second
 - mkdir 154 (time 1781252903.86 total 10.03 last 15.35)
 - mkdir 333 (time 1781252913.87 total 20.04 last 17.89)
 - mkdir 520 (time 1781252923.89 total 30.06 last 18.65)
 - mkdir 721 (time 1781252933.92 total 40.09 last 20.05)
 - mkdir 905 (time 1781252943.98 total 50.15 last 18.29)
total: 1000 mkdir in 54.73 seconds: 18.27 ops/second
 - mkdir 152 (time 1781252903.65 total 10.09 last 15.07)
 - mkdir 331 (time 1781252913.75 total 20.18 last 17.73)
 - mkdir 516 (time 1781252923.81 total 30.24 last 18.39)
 - mkdir 717 (time 1781252933.82 total 40.26 last 20.07)
 - mkdir 897 (time 1781252943.88 total 50.31 last 17.90)
total: 1000 mkdir in 55.84 seconds: 17.91 ops/second
 - mkdir 158 (time 1781252904.09 total 10.01 last 15.78)
 - mkdir 329 (time 1781252914.14 total 20.06 last 17.02)
 - mkdir 515 (time 1781252924.15 total 30.07 last 18.58)
 - mkdir 720 (time 1781252934.16 total 40.07 last 20.50)
 - mkdir 899 (time 1781252944.16 total 50.08 last 17.89)
total: 1000 mkdir in 55.47 seconds: 18.03 ops/second
 - mkdir 159 (time 1781252904.48 total 10.04 last 15.84)
 - mkdir 336 (time 1781252914.56 total 20.11 last 17.57)
 - mkdir 529 (time 1781252924.62 total 30.18 last 19.17)
 - mkdir 727 (time 1781252934.65 total 40.21 last 19.74)
 - mkdir 905 (time 1781252944.69 total 50.25 last 17.74)
total: 1000 mkdir in 55.12 seconds: 18.14 ops/second
 - mkdir 153 (time 1781252904.37 total 10.07 last 15.20)
 - mkdir 323 (time 1781252914.42 total 20.12 last 16.91)
 - mkdir 511 (time 1781252924.45 total 30.15 last 18.74)
 - mkdir 711 (time 1781252934.48 total 40.18 last 19.94)
 - mkdir 898 (time 1781252944.52 total 50.21 last 18.63)
total: 1000 mkdir in 55.60 seconds: 17.99 ops/second
 - mkdir 154 (time 1781252904.50 total 10.05 last 15.32)
 - mkdir 327 (time 1781252914.52 total 20.07 last 17.26)
 - mkdir 512 (time 1781252924.53 total 30.09 last 18.47)
 - mkdir 712 (time 1781252934.55 total 40.11 last 19.96)
 - mkdir 897 (time 1781252944.58 total 50.14 last 18.44)
total: 1000 mkdir in 55.86 seconds: 17.90 ops/second
 - mkdir 161 (time 1781252904.91 total 10.03 last 16.06)
 - mkdir 331 (time 1781252914.93 total 20.05 last 16.96)
 - mkdir 525 (time 1781252924.94 total 30.05 last 19.40)
 - mkdir 722 (time 1781252935.07 total 40.18 last 19.45)
 - mkdir 904 (time 1781252945.07 total 50.19 last 18.19)
total: 1000 mkdir in 55.63 seconds: 17.98 ops/second
 - mkdir 153 (time 1781252904.19 total 10.09 last 15.16)
 - mkdir 324 (time 1781252914.25 total 20.15 last 16.99)
 - mkdir 510 (time 1781252924.25 total 30.16 last 18.60)
 - mkdir 708 (time 1781252934.26 total 40.16 last 19.79)
 - mkdir 889 (time 1781252944.31 total 50.22 last 18.00)
total: 1000 mkdir in 56.57 seconds: 17.68 ops/second
 - mkdir 152 (time 1781252904.50 total 10.03 last 15.16)
 - mkdir 320 (time 1781252914.50 total 20.03 last 16.80)
 - mkdir 504 (time 1781252924.52 total 30.05 last 18.36)
 - mkdir 705 (time 1781252934.55 total 40.08 last 20.04)
 - mkdir 890 (time 1781252944.56 total 50.09 last 18.48)
total: 1000 mkdir in 56.35 seconds: 17.74 ops/second
Time for file creation 66 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 9 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.56 ops/second
 - mkdir 154 (time 1781253480.93 total 10.01 last 15.38)
 - mkdir 304 (time 1781253491.03 total 20.12 last 14.84)
 - mkdir 456 (time 1781253501.08 total 30.17 last 15.12)
 - mkdir 626 (time 1781253511.12 total 40.21 last 16.93)
 - mkdir 795 (time 1781253521.14 total 50.22 last 16.88)
 - mkdir 965 (time 1781253531.17 total 60.25 last 16.95)
total: 1000 mkdir in 62.55 seconds: 15.99 ops/second
 - mkdir 162 (time 1781253482.42 total 10.08 last 16.08)
 - mkdir 305 (time 1781253492.46 total 20.12 last 14.24)
 - mkdir 470 (time 1781253502.52 total 30.18 last 16.40)
 - mkdir 645 (time 1781253512.54 total 40.19 last 17.47)
 - mkdir 811 (time 1781253522.58 total 50.24 last 16.52)
 - mkdir 969 (time 1781253532.68 total 60.34 last 15.64)
total: 1000 mkdir in 63.29 seconds: 15.80 ops/second
 - mkdir 152 (time 1781253481.90 total 10.01 last 15.19)
 - mkdir 290 (time 1781253491.98 total 20.09 last 13.69)
 - mkdir 445 (time 1781253502.00 total 30.10 last 15.48)
 - mkdir 611 (time 1781253512.00 total 40.10 last 16.60)
 - mkdir 783 (time 1781253522.02 total 50.13 last 17.16)
 - mkdir 947 (time 1781253532.06 total 60.16 last 16.34)
total: 1000 mkdir in 66.21 seconds: 15.10 ops/second
 - mkdir 153 (time 1781253481.96 total 10.01 last 15.28)
 - mkdir 295 (time 1781253492.07 total 20.12 last 14.05)
 - mkdir 451 (time 1781253502.12 total 30.17 last 15.52)
 - mkdir 627 (time 1781253512.14 total 40.19 last 17.56)
 - mkdir 791 (time 1781253522.14 total 50.20 last 16.39)
 - mkdir 948 (time 1781253532.20 total 60.25 last 15.61)
total: 1000 mkdir in 66.20 seconds: 15.10 ops/second
 - mkdir 153 (time 1781253482.63 total 10.06 last 15.21)
 - mkdir 293 (time 1781253492.67 total 20.10 last 13.94)
 - mkdir 456 (time 1781253502.67 total 30.11 last 16.30)
 - mkdir 630 (time 1781253512.70 total 40.13 last 17.35)
 - mkdir 796 (time 1781253522.74 total 50.17 last 16.54)
 - mkdir 954 (time 1781253532.80 total 60.23 last 15.71)
total: 1000 mkdir in 66.00 seconds: 15.15 ops/second
 - mkdir 147 (time 1781253482.18 total 10.04 last 14.64)
 - mkdir 286 (time 1781253492.21 total 20.06 last 13.87)
 - mkdir 442 (time 1781253502.22 total 30.07 last 15.59)
 - mkdir 614 (time 1781253512.26 total 40.11 last 17.13)
 - mkdir 784 (time 1781253522.26 total 50.11 last 16.99)
 - mkdir 944 (time 1781253532.37 total 60.22 last 15.83)
total: 1000 mkdir in 66.87 seconds: 14.95 ops/second
 - mkdir 148 (time 1781253482.20 total 10.04 last 14.75)
 - mkdir 282 (time 1781253492.22 total 20.06 last 13.37)
 - mkdir 438 (time 1781253502.22 total 30.06 last 15.60)
 - mkdir 611 (time 1781253512.25 total 40.09 last 17.25)
 - mkdir 777 (time 1781253522.28 total 50.12 last 16.55)
 - mkdir 935 (time 1781253532.32 total 60.16 last 15.74)
total: 1000 mkdir in 68.25 seconds: 14.65 ops/second
 - mkdir 148 (time 1781253482.18 total 10.03 last 14.76)
 - mkdir 284 (time 1781253492.22 total 20.07 last 13.54)
 - mkdir 438 (time 1781253502.24 total 30.10 last 15.36)
 - mkdir 603 (time 1781253512.30 total 40.16 last 16.40)
 - mkdir 766 (time 1781253522.36 total 50.21 last 16.21)
 - mkdir 923 (time 1781253532.42 total 60.27 last 15.61)
total: 1000 mkdir in 69.70 seconds: 14.35 ops/second
 - mkdir 151 (time 1781253480.58 total 10.06 last 15.01)
 - mkdir 289 (time 1781253490.64 total 20.12 last 13.72)
 - mkdir 432 (time 1781253500.68 total 30.16 last 14.24)
 - mkdir 588 (time 1781253510.72 total 40.20 last 15.55)
 - mkdir 747 (time 1781253520.73 total 50.21 last 15.87)
 - mkdir 904 (time 1781253530.77 total 60.25 last 15.64)
 - mkdir 990 (time 1781253540.80 total 70.28 last 8.57)
total: 1000 mkdir in 71.47 seconds: 13.99 ops/second
 - mkdir 154 (time 1781253482.76 total 10.04 last 15.34)
 - mkdir 291 (time 1781253492.77 total 20.05 last 13.68)
 - mkdir 446 (time 1781253502.81 total 30.09 last 15.44)
 - mkdir 611 (time 1781253512.89 total 40.17 last 16.37)
 - mkdir 773 (time 1781253522.90 total 50.18 last 16.18)
 - mkdir 927 (time 1781253532.94 total 60.21 last 15.35)
total: 1000 mkdir in 69.76 seconds: 14.34 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781253552 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253552 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253552 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253553 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253553 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253553 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253553 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781253554 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781253553 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781253554 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 47 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8