== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:00:39 (1781294439)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.52 seconds: 19.32 ops/second
 - mkdir 142 (time 1781294464.58 total 10.00 last 14.19)
 - mkdir 284 (time 1781294474.60 total 20.02 last 14.18)
 - mkdir 442 (time 1781294484.65 total 30.08 last 15.71)
 - mkdir 575 (time 1781294494.70 total 40.12 last 13.24)
 - mkdir 696 (time 1781294504.77 total 50.19 last 12.02)
 - mkdir 866 (time 1781294514.80 total 60.22 last 16.95)
total: 1000 mkdir in 64.97 seconds: 15.39 ops/second
 - mkdir 146 (time 1781294463.65 total 10.05 last 14.53)
 - mkdir 282 (time 1781294473.74 total 20.14 last 13.48)
 - mkdir 438 (time 1781294483.76 total 30.16 last 15.57)
 - mkdir 575 (time 1781294493.83 total 40.23 last 13.60)
 - mkdir 695 (time 1781294503.91 total 50.32 last 11.90)
 - mkdir 848 (time 1781294513.96 total 60.37 last 15.22)
total: 1000 mkdir in 66.02 seconds: 15.15 ops/second
 - mkdir 143 (time 1781294464.07 total 10.08 last 14.18)
 - mkdir 283 (time 1781294474.10 total 20.11 last 13.96)
 - mkdir 443 (time 1781294484.10 total 30.11 last 16.00)
 - mkdir 578 (time 1781294494.20 total 40.22 last 13.36)
 - mkdir 695 (time 1781294504.28 total 50.29 last 11.61)
 - mkdir 856 (time 1781294514.28 total 60.29 last 16.10)
total: 1000 mkdir in 65.84 seconds: 15.19 ops/second
 - mkdir 142 (time 1781294464.91 total 10.04 last 14.14)
 - mkdir 289 (time 1781294474.91 total 20.04 last 14.70)
 - mkdir 443 (time 1781294484.96 total 30.09 last 15.32)
 - mkdir 572 (time 1781294495.01 total 40.14 last 12.84)
 - mkdir 690 (time 1781294505.02 total 50.15 last 11.79)
 - mkdir 859 (time 1781294515.03 total 60.16 last 16.90)
total: 1000 mkdir in 65.72 seconds: 15.22 ops/second
 - mkdir 144 (time 1781294465.28 total 10.04 last 14.35)
 - mkdir 297 (time 1781294475.31 total 20.07 last 15.25)
 - mkdir 447 (time 1781294485.37 total 30.13 last 14.91)
 - mkdir 583 (time 1781294495.45 total 40.21 last 13.50)
 - mkdir 697 (time 1781294505.50 total 50.26 last 11.34)
 - mkdir 869 (time 1781294515.53 total 60.29 last 17.15)
total: 1000 mkdir in 65.73 seconds: 15.21 ops/second
 - mkdir 140 (time 1781294465.06 total 10.03 last 13.96)
 - mkdir 286 (time 1781294475.09 total 20.07 last 14.55)
 - mkdir 435 (time 1781294485.18 total 30.15 last 14.77)
 - mkdir 565 (time 1781294495.22 total 40.19 last 12.95)
 - mkdir 685 (time 1781294505.26 total 50.23 last 11.95)
 - mkdir 859 (time 1781294515.27 total 60.24 last 17.38)
total: 1000 mkdir in 66.81 seconds: 14.97 ops/second
 - mkdir 143 (time 1781294465.00 total 10.04 last 14.24)
 - mkdir 291 (time 1781294475.03 total 20.07 last 14.76)
 - mkdir 437 (time 1781294485.08 total 30.11 last 14.54)
 - mkdir 568 (time 1781294495.13 total 40.17 last 13.03)
 - mkdir 684 (time 1781294505.23 total 50.27 last 11.49)
 - mkdir 853 (time 1781294515.26 total 60.30 last 16.85)
total: 1000 mkdir in 67.36 seconds: 14.85 ops/second
 - mkdir 132 (time 1781294463.43 total 10.02 last 13.17)
 - mkdir 263 (time 1781294473.43 total 20.02 last 13.10)
 - mkdir 413 (time 1781294483.44 total 30.03 last 14.99)
 - mkdir 548 (time 1781294493.44 total 40.04 last 13.49)
 - mkdir 668 (time 1781294503.50 total 50.10 last 11.93)
 - mkdir 819 (time 1781294513.51 total 60.10 last 15.09)
total: 1000 mkdir in 68.98 seconds: 14.50 ops/second
 - mkdir 143 (time 1781294465.31 total 10.02 last 14.27)
 - mkdir 290 (time 1781294475.33 total 20.04 last 14.68)
 - mkdir 432 (time 1781294485.40 total 30.11 last 14.09)
 - mkdir 564 (time 1781294495.41 total 40.12 last 13.20)
 - mkdir 682 (time 1781294505.44 total 50.15 last 11.76)
 - mkdir 853 (time 1781294515.45 total 60.16 last 17.08)
total: 1000 mkdir in 67.18 seconds: 14.88 ops/second
 - mkdir 137 (time 1781294465.90 total 10.04 last 13.65)
 - mkdir 283 (time 1781294475.98 total 20.12 last 14.48)
 - mkdir 422 (time 1781294486.04 total 30.17 last 13.82)
 - mkdir 551 (time 1781294496.09 total 40.22 last 12.84)
 - mkdir 670 (time 1781294506.19 total 50.32 last 11.78)
 - mkdir 858 (time 1781294516.22 total 60.36 last 18.74)
total: 1000 mkdir in 68.27 seconds: 14.65 ops/second
Time for file creation 81 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 20.09 ops/second
 - mkdir 116 (time 1781295054.64 total 10.06 last 11.53)
 - mkdir 269 (time 1781295064.68 total 20.10 last 15.25)
 - mkdir 418 (time 1781295074.73 total 30.15 last 14.81)
 - mkdir 557 (time 1781295084.79 total 40.21 last 13.83)
 - mkdir 705 (time 1781295094.79 total 50.21 last 14.79)
 - mkdir 875 (time 1781295104.85 total 60.27 last 16.91)
total: 1000 mkdir in 68.03 seconds: 14.70 ops/second
 - mkdir 122 (time 1781295056.19 total 10.03 last 12.16)
 - mkdir 280 (time 1781295066.21 total 20.06 last 15.76)
 - mkdir 425 (time 1781295076.28 total 30.12 last 14.41)
 - mkdir 564 (time 1781295086.32 total 40.16 last 13.85)
 - mkdir 725 (time 1781295096.33 total 50.18 last 16.07)
 - mkdir 895 (time 1781295106.37 total 60.21 last 16.95)
total: 1000 mkdir in 67.12 seconds: 14.90 ops/second
 - mkdir 121 (time 1781295056.32 total 10.04 last 12.05)
 - mkdir 283 (time 1781295066.36 total 20.09 last 16.13)
 - mkdir 429 (time 1781295076.40 total 30.13 last 14.54)
 - mkdir 565 (time 1781295086.42 total 40.15 last 13.57)
 - mkdir 722 (time 1781295096.53 total 50.25 last 15.54)
 - mkdir 885 (time 1781295106.53 total 60.25 last 16.30)
total: 1000 mkdir in 68.32 seconds: 14.64 ops/second
 - mkdir 109 (time 1781295054.16 total 10.02 last 10.87)
 - mkdir 262 (time 1781295064.19 total 20.06 last 15.25)
 - mkdir 404 (time 1781295074.21 total 30.08 last 14.17)
 - mkdir 543 (time 1781295084.32 total 40.19 last 13.74)
 - mkdir 684 (time 1781295094.33 total 50.19 last 14.09)
 - mkdir 853 (time 1781295104.36 total 60.23 last 16.85)
 - mkdir 997 (time 1781295114.47 total 70.34 last 14.25)
total: 1000 mkdir in 70.68 seconds: 14.15 ops/second
 - mkdir 119 (time 1781295055.23 total 10.01 last 11.89)
 - mkdir 269 (time 1781295065.38 total 20.16 last 14.78)
 - mkdir 416 (time 1781295075.39 total 30.17 last 14.68)
 - mkdir 554 (time 1781295085.43 total 40.21 last 13.75)
 - mkdir 706 (time 1781295095.43 total 50.22 last 15.19)
 - mkdir 870 (time 1781295105.48 total 60.27 last 16.32)
total: 1000 mkdir in 69.68 seconds: 14.35 ops/second
 - mkdir 122 (time 1781295056.39 total 10.03 last 12.16)
 - mkdir 274 (time 1781295066.41 total 20.05 last 15.17)
 - mkdir 420 (time 1781295076.44 total 30.08 last 14.56)
 - mkdir 552 (time 1781295086.47 total 40.12 last 13.16)
 - mkdir 710 (time 1781295096.51 total 50.15 last 15.74)
 - mkdir 880 (time 1781295106.53 total 60.17 last 16.97)
total: 1000 mkdir in 68.98 seconds: 14.50 ops/second
 - mkdir 127 (time 1781295056.44 total 10.01 last 12.69)
 - mkdir 278 (time 1781295066.46 total 20.02 last 15.08)
 - mkdir 426 (time 1781295076.54 total 30.10 last 14.68)
 - mkdir 556 (time 1781295086.56 total 40.13 last 12.97)
 - mkdir 706 (time 1781295096.57 total 50.14 last 14.99)
 - mkdir 866 (time 1781295106.64 total 60.20 last 15.89)
 - mkdir 992 (time 1781295116.77 total 70.33 last 12.44)
total: 1000 mkdir in 71.39 seconds: 14.01 ops/second
 - mkdir 122 (time 1781295056.72 total 10.06 last 12.13)
 - mkdir 270 (time 1781295066.74 total 20.08 last 14.77)
 - mkdir 419 (time 1781295076.75 total 30.08 last 14.89)
 - mkdir 556 (time 1781295086.75 total 40.09 last 13.69)
 - mkdir 707 (time 1781295096.81 total 50.15 last 15.02)
 - mkdir 863 (time 1781295106.83 total 60.16 last 15.58)
 - mkdir 985 (time 1781295116.88 total 70.22 last 12.14)
total: 1000 mkdir in 72.14 seconds: 13.86 ops/second
 - mkdir 118 (time 1781295056.53 total 10.05 last 11.75)
 - mkdir 268 (time 1781295066.67 total 20.18 last 14.80)
 - mkdir 412 (time 1781295076.69 total 30.21 last 14.36)
 - mkdir 539 (time 1781295086.72 total 40.24 last 12.67)
 - mkdir 686 (time 1781295096.77 total 50.29 last 14.62)
 - mkdir 838 (time 1781295106.81 total 60.33 last 15.14)
 - mkdir 965 (time 1781295116.91 total 70.42 last 12.58)
total: 1000 mkdir in 74.07 seconds: 13.50 ops/second
 - mkdir 117 (time 1781295056.07 total 10.04 last 11.66)
 - mkdir 262 (time 1781295066.09 total 20.05 last 14.48)
 - mkdir 399 (time 1781295076.12 total 30.08 last 13.66)
 - mkdir 529 (time 1781295086.18 total 40.14 last 12.92)
 - mkdir 678 (time 1781295096.21 total 50.17 last 14.86)
 - mkdir 826 (time 1781295106.25 total 60.22 last 14.73)
 - mkdir 959 (time 1781295116.39 total 70.35 last 13.12)
total: 1000 mkdir in 74.73 seconds: 13.38 ops/second
Time for file creation 88 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781295130 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1781295130 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781295131 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1781295132 ; total 1 ; last 1)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781295131 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781295131 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781295132 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1781295131 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781295131 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781295132 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 48 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8