== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:35:20 (1784064920)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.38 seconds: 26.62 ops/second
 - mkdir 165 (time 1784064942.02 total 10.02 last 16.47)
 - mkdir 333 (time 1784064952.03 total 20.03 last 16.79)
 - mkdir 489 (time 1784064962.06 total 30.06 last 15.54)
 - mkdir 646 (time 1784064972.07 total 40.07 last 15.69)
 - mkdir 816 (time 1784064982.08 total 50.08 last 16.98)
total: 1000 mkdir in 59.86 seconds: 16.71 ops/second
 - mkdir 161 (time 1784064941.41 total 10.06 last 16.00)
 - mkdir 330 (time 1784064951.49 total 20.14 last 16.77)
 - mkdir 480 (time 1784064961.49 total 30.14 last 15.00)
 - mkdir 626 (time 1784064971.54 total 40.19 last 14.53)
 - mkdir 791 (time 1784064981.58 total 50.23 last 16.43)
 - mkdir 974 (time 1784064991.61 total 60.26 last 18.25)
total: 1000 mkdir in 62.49 seconds: 16.00 ops/second
 - mkdir 160 (time 1784064942.04 total 10.00 last 15.99)
 - mkdir 327 (time 1784064952.04 total 20.01 last 16.70)
 - mkdir 482 (time 1784064962.04 total 30.01 last 15.50)
 - mkdir 633 (time 1784064972.07 total 40.03 last 15.06)
 - mkdir 800 (time 1784064982.08 total 50.04 last 16.68)
 - mkdir 983 (time 1784064992.08 total 60.04 last 18.29)
total: 1000 mkdir in 62.15 seconds: 16.09 ops/second
 - mkdir 156 (time 1784064941.09 total 10.04 last 15.55)
 - mkdir 327 (time 1784064951.10 total 20.04 last 17.09)
 - mkdir 475 (time 1784064961.12 total 30.06 last 14.77)
 - mkdir 623 (time 1784064971.17 total 40.12 last 14.71)
 - mkdir 786 (time 1784064981.22 total 50.16 last 16.23)
 - mkdir 959 (time 1784064991.24 total 60.19 last 17.26)
total: 1000 mkdir in 63.34 seconds: 15.79 ops/second
 - mkdir 166 (time 1784064942.29 total 10.00 last 16.59)
 - mkdir 331 (time 1784064952.31 total 20.02 last 16.47)
 - mkdir 482 (time 1784064962.33 total 30.04 last 15.08)
 - mkdir 630 (time 1784064972.41 total 40.13 last 14.67)
 - mkdir 804 (time 1784064982.42 total 50.13 last 17.39)
 - mkdir 979 (time 1784064992.48 total 60.19 last 17.40)
total: 1000 mkdir in 62.47 seconds: 16.01 ops/second
 - mkdir 170 (time 1784064942.56 total 10.03 last 16.95)
 - mkdir 338 (time 1784064952.58 total 20.05 last 16.77)
 - mkdir 484 (time 1784064962.59 total 30.06 last 14.58)
 - mkdir 635 (time 1784064972.65 total 40.11 last 15.02)
 - mkdir 806 (time 1784064982.72 total 50.19 last 16.98)
 - mkdir 979 (time 1784064992.84 total 60.31 last 17.09)
total: 1000 mkdir in 62.79 seconds: 15.93 ops/second
 - mkdir 155 (time 1784064941.91 total 10.05 last 15.42)
 - mkdir 326 (time 1784064951.92 total 20.05 last 17.10)
 - mkdir 477 (time 1784064962.00 total 30.13 last 14.98)
 - mkdir 620 (time 1784064972.01 total 40.15 last 14.28)
 - mkdir 786 (time 1784064982.06 total 50.20 last 16.51)
 - mkdir 966 (time 1784064992.27 total 60.40 last 17.64)
total: 1000 mkdir in 64.21 seconds: 15.57 ops/second
 - mkdir 164 (time 1784064942.56 total 10.02 last 16.37)
 - mkdir 320 (time 1784064952.62 total 20.08 last 15.50)
 - mkdir 470 (time 1784064962.63 total 30.09 last 14.99)
 - mkdir 623 (time 1784064972.64 total 40.10 last 15.29)
 - mkdir 791 (time 1784064982.68 total 50.14 last 16.74)
 - mkdir 969 (time 1784064992.80 total 60.26 last 17.58)
total: 1000 mkdir in 63.83 seconds: 15.67 ops/second
 - mkdir 155 (time 1784064941.39 total 10.02 last 15.47)
 - mkdir 319 (time 1784064951.40 total 20.03 last 16.39)
 - mkdir 465 (time 1784064961.43 total 30.06 last 14.56)
 - mkdir 610 (time 1784064971.43 total 40.06 last 14.49)
 - mkdir 770 (time 1784064981.48 total 50.11 last 15.92)
 - mkdir 944 (time 1784064991.51 total 60.14 last 17.36)
total: 1000 mkdir in 66.04 seconds: 15.14 ops/second
 - mkdir 145 (time 1784064941.63 total 10.06 last 14.42)
 - mkdir 304 (time 1784064951.66 total 20.08 last 15.86)
 - mkdir 448 (time 1784064961.75 total 30.18 last 14.27)
 - mkdir 585 (time 1784064971.84 total 40.26 last 13.58)
 - mkdir 740 (time 1784064981.86 total 50.28 last 15.47)
 - mkdir 916 (time 1784064991.91 total 60.33 last 17.51)
total: 1000 mkdir in 68.05 seconds: 14.69 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.75 seconds: 13.35 ops/second
 - mkdir 143 (time 1784065509.85 total 10.07 last 14.20)
 - mkdir 320 (time 1784065519.85 total 20.07 last 17.70)
 - mkdir 481 (time 1784065529.92 total 30.14 last 15.99)
 - mkdir 618 (time 1784065539.93 total 40.15 last 13.69)
 - mkdir 750 (time 1784065550.00 total 50.22 last 13.11)
 - mkdir 947 (time 1784065560.00 total 60.22 last 19.70)
total: 1000 mkdir in 63.49 seconds: 15.75 ops/second
 - mkdir 151 (time 1784065511.35 total 10.04 last 15.04)
 - mkdir 328 (time 1784065521.36 total 20.05 last 17.68)
 - mkdir 481 (time 1784065531.36 total 30.05 last 15.30)
 - mkdir 612 (time 1784065541.42 total 40.10 last 13.03)
 - mkdir 766 (time 1784065551.44 total 50.12 last 15.37)
 - mkdir 962 (time 1784065561.44 total 60.13 last 19.59)
total: 1000 mkdir in 62.62 seconds: 15.97 ops/second
 - mkdir 153 (time 1784065511.28 total 10.00 last 15.30)
 - mkdir 329 (time 1784065521.31 total 20.03 last 17.55)
 - mkdir 484 (time 1784065531.35 total 30.07 last 15.44)
 - mkdir 613 (time 1784065541.39 total 40.11 last 12.85)
 - mkdir 767 (time 1784065551.47 total 50.19 last 15.28)
 - mkdir 963 (time 1784065561.49 total 60.20 last 19.57)
total: 1000 mkdir in 62.69 seconds: 15.95 ops/second
 - mkdir 148 (time 1784065510.65 total 10.05 last 14.72)
 - mkdir 330 (time 1784065520.72 total 20.12 last 18.08)
 - mkdir 482 (time 1784065530.76 total 30.16 last 15.13)
 - mkdir 609 (time 1784065540.79 total 40.19 last 12.67)
 - mkdir 746 (time 1784065550.80 total 50.20 last 13.69)
 - mkdir 945 (time 1784065560.81 total 60.21 last 19.88)
total: 1000 mkdir in 63.96 seconds: 15.64 ops/second
 - mkdir 145 (time 1784065511.57 total 10.03 last 14.46)
 - mkdir 330 (time 1784065521.58 total 20.03 last 18.49)
 - mkdir 476 (time 1784065531.62 total 30.07 last 14.54)
 - mkdir 604 (time 1784065541.64 total 40.10 last 12.77)
 - mkdir 758 (time 1784065551.69 total 50.15 last 15.32)
 - mkdir 953 (time 1784065561.74 total 60.20 last 19.41)
total: 1000 mkdir in 63.90 seconds: 15.65 ops/second
 - mkdir 142 (time 1784065510.25 total 10.02 last 14.17)
 - mkdir 315 (time 1784065520.27 total 20.04 last 17.27)
 - mkdir 467 (time 1784065530.27 total 30.04 last 15.20)
 - mkdir 598 (time 1784065540.30 total 40.07 last 13.06)
 - mkdir 731 (time 1784065550.31 total 50.08 last 13.28)
 - mkdir 928 (time 1784065560.34 total 60.11 last 19.65)
total: 1000 mkdir in 65.28 seconds: 15.32 ops/second
 - mkdir 151 (time 1784065510.58 total 10.03 last 15.05)
 - mkdir 320 (time 1784065520.64 total 20.10 last 16.80)
 - mkdir 475 (time 1784065530.67 total 30.12 last 15.46)
 - mkdir 603 (time 1784065540.77 total 40.22 last 12.67)
 - mkdir 748 (time 1784065550.79 total 50.24 last 14.47)
 - mkdir 935 (time 1784065560.80 total 60.25 last 18.68)
total: 1000 mkdir in 65.21 seconds: 15.33 ops/second
 - mkdir 146 (time 1784065510.99 total 10.06 last 14.52)
 - mkdir 317 (time 1784065520.99 total 20.06 last 17.10)
 - mkdir 474 (time 1784065531.00 total 30.07 last 15.68)
 - mkdir 600 (time 1784065541.03 total 40.09 last 12.57)
 - mkdir 744 (time 1784065551.06 total 50.13 last 14.35)
 - mkdir 932 (time 1784065561.09 total 60.16 last 18.74)
total: 1000 mkdir in 65.65 seconds: 15.23 ops/second
 - mkdir 143 (time 1784065511.26 total 10.04 last 14.24)
 - mkdir 326 (time 1784065521.28 total 20.06 last 18.26)
 - mkdir 480 (time 1784065531.35 total 30.14 last 15.29)
 - mkdir 606 (time 1784065541.44 total 40.22 last 12.49)
 - mkdir 751 (time 1784065551.49 total 50.28 last 14.42)
 - mkdir 935 (time 1784065561.52 total 60.30 last 18.36)
total: 1000 mkdir in 65.87 seconds: 15.18 ops/second
 - mkdir 140 (time 1784065511.85 total 10.07 last 13.91)
 - mkdir 315 (time 1784065521.90 total 20.11 last 17.43)
 - mkdir 456 (time 1784065531.95 total 30.16 last 14.03)
 - mkdir 574 (time 1784065541.98 total 40.20 last 11.76)
 - mkdir 713 (time 1784065552.04 total 50.25 last 13.82)
 - mkdir 900 (time 1784065562.05 total 60.26 last 18.68)
total: 1000 mkdir in 67.38 seconds: 14.84 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1784065575 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1784065579 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1784065578 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8