== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:50:22 (1786215022)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.12 seconds: 84.88 ops/second
 - mkdir 655 (time 1786215036.40 total 10.01 last 65.41)
 - mkdir 869 (time 1786215046.40 total 20.02 last 21.39)
total: 1000 mkdir in 24.36 seconds: 41.05 ops/second
 - mkdir 589 (time 1786215036.85 total 10.03 last 58.72)
 - mkdir 817 (time 1786215046.87 total 20.05 last 22.76)
 - mkdir 979 (time 1786215056.96 total 30.14 last 16.06)
total: 1000 mkdir in 32.43 seconds: 30.83 ops/second
 - mkdir 565 (time 1786215037.08 total 10.03 last 56.36)
 - mkdir 796 (time 1786215047.12 total 20.06 last 23.02)
 - mkdir 958 (time 1786215057.18 total 30.12 last 16.10)
total: 1000 mkdir in 34.60 seconds: 28.90 ops/second
 - mkdir 552 (time 1786215037.60 total 10.01 last 55.16)
 - mkdir 793 (time 1786215047.61 total 20.02 last 24.08)
 - mkdir 953 (time 1786215057.67 total 30.07 last 15.91)
total: 1000 mkdir in 34.75 seconds: 28.78 ops/second
 - mkdir 558 (time 1786215037.40 total 10.02 last 55.68)
 - mkdir 792 (time 1786215047.41 total 20.03 last 23.37)
 - mkdir 948 (time 1786215057.43 total 30.05 last 15.57)
total: 1000 mkdir in 35.52 seconds: 28.16 ops/second
 - mkdir 557 (time 1786215037.42 total 10.02 last 55.59)
 - mkdir 793 (time 1786215047.42 total 20.02 last 23.59)
 - mkdir 947 (time 1786215057.53 total 30.13 last 15.23)
total: 1000 mkdir in 35.71 seconds: 28.00 ops/second
 - mkdir 550 (time 1786215037.53 total 10.04 last 54.78)
 - mkdir 787 (time 1786215047.56 total 20.07 last 23.63)
 - mkdir 938 (time 1786215057.69 total 30.20 last 14.90)
total: 1000 mkdir in 36.51 seconds: 27.39 ops/second
 - mkdir 547 (time 1786215037.56 total 10.01 last 54.66)
 - mkdir 786 (time 1786215047.58 total 20.03 last 23.85)
 - mkdir 933 (time 1786215057.74 total 30.19 last 14.46)
total: 1000 mkdir in 36.75 seconds: 27.21 ops/second
 - mkdir 537 (time 1786215037.61 total 10.03 last 53.53)
 - mkdir 764 (time 1786215047.61 total 20.04 last 22.69)
 - mkdir 909 (time 1786215057.62 total 30.04 last 14.50)
total: 1000 mkdir in 37.48 seconds: 26.68 ops/second
 - mkdir 539 (time 1786215037.73 total 10.05 last 53.64)
 - mkdir 776 (time 1786215047.73 total 20.05 last 23.69)
 - mkdir 917 (time 1786215057.76 total 30.09 last 14.05)
total: 1000 mkdir in 37.49 seconds: 26.67 ops/second
Time for file creation 42 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 5 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.57 ops/second
 - mkdir 183 (time 1786215459.46 total 10.00 last 18.29)
 - mkdir 423 (time 1786215469.51 total 20.05 last 23.89)
 - mkdir 559 (time 1786215479.52 total 30.07 last 13.58)
 - mkdir 764 (time 1786215489.54 total 40.08 last 20.46)
 - mkdir 980 (time 1786215499.55 total 50.10 last 21.58)
total: 1000 mkdir in 51.41 seconds: 19.45 ops/second
 - mkdir 214 (time 1786215462.81 total 10.01 last 21.37)
 - mkdir 410 (time 1786215472.84 total 20.04 last 19.55)
 - mkdir 557 (time 1786215482.87 total 30.07 last 14.65)
 - mkdir 768 (time 1786215492.90 total 40.10 last 21.04)
 - mkdir 953 (time 1786215502.94 total 50.14 last 18.42)
total: 1000 mkdir in 56.47 seconds: 17.71 ops/second
 - mkdir 208 (time 1786215462.50 total 10.00 last 20.80)
 - mkdir 407 (time 1786215472.53 total 20.04 last 19.83)
 - mkdir 548 (time 1786215482.53 total 30.04 last 14.10)
 - mkdir 755 (time 1786215492.56 total 40.06 last 20.65)
 - mkdir 945 (time 1786215502.59 total 50.10 last 18.93)
total: 1000 mkdir in 57.98 seconds: 17.25 ops/second
 - mkdir 210 (time 1786215462.78 total 10.03 last 20.93)
 - mkdir 407 (time 1786215472.84 total 20.10 last 19.58)
 - mkdir 552 (time 1786215482.87 total 30.12 last 14.46)
 - mkdir 762 (time 1786215492.89 total 40.15 last 20.95)
 - mkdir 943 (time 1786215502.92 total 50.18 last 18.04)
total: 1000 mkdir in 58.27 seconds: 17.16 ops/second
 - mkdir 192 (time 1786215462.12 total 10.01 last 19.17)
 - mkdir 395 (time 1786215472.16 total 20.06 last 20.21)
 - mkdir 536 (time 1786215482.20 total 30.10 last 14.04)
 - mkdir 744 (time 1786215492.27 total 40.17 last 20.66)
 - mkdir 937 (time 1786215502.39 total 50.29 last 19.07)
total: 1000 mkdir in 59.12 seconds: 16.91 ops/second
 - mkdir 220 (time 1786215463.24 total 10.03 last 21.93)
 - mkdir 404 (time 1786215473.33 total 20.12 last 18.24)
 - mkdir 552 (time 1786215483.34 total 30.14 last 14.78)
 - mkdir 761 (time 1786215493.38 total 40.18 last 20.81)
 - mkdir 941 (time 1786215503.40 total 50.19 last 17.98)
total: 1000 mkdir in 58.49 seconds: 17.10 ops/second
 - mkdir 216 (time 1786215463.27 total 10.02 last 21.56)
 - mkdir 394 (time 1786215473.29 total 20.04 last 17.76)
 - mkdir 540 (time 1786215483.38 total 30.13 last 14.47)
 - mkdir 752 (time 1786215493.38 total 40.14 last 21.20)
 - mkdir 935 (time 1786215503.38 total 50.14 last 18.30)
total: 1000 mkdir in 58.99 seconds: 16.95 ops/second
 - mkdir 203 (time 1786215462.54 total 10.01 last 20.27)
 - mkdir 396 (time 1786215472.58 total 20.06 last 19.21)
 - mkdir 532 (time 1786215482.59 total 30.07 last 13.59)
 - mkdir 739 (time 1786215492.59 total 40.07 last 20.70)
 - mkdir 923 (time 1786215502.60 total 50.08 last 18.38)
 - mkdir 994 (time 1786215512.67 total 60.14 last 7.05)
total: 1000 mkdir in 60.68 seconds: 16.48 ops/second
 - mkdir 214 (time 1786215463.30 total 10.04 last 21.32)
 - mkdir 392 (time 1786215473.39 total 20.13 last 17.64)
 - mkdir 536 (time 1786215483.48 total 30.22 last 14.27)
 - mkdir 747 (time 1786215493.49 total 40.23 last 21.08)
 - mkdir 928 (time 1786215503.50 total 50.24 last 18.08)
 - mkdir 997 (time 1786215513.53 total 60.27 last 6.88)
total: 1000 mkdir in 60.45 seconds: 16.54 ops/second
 - mkdir 198 (time 1786215462.58 total 10.03 last 19.75)
 - mkdir 387 (time 1786215472.65 total 20.09 last 18.78)
 - mkdir 525 (time 1786215482.71 total 30.15 last 13.72)
 - mkdir 723 (time 1786215492.75 total 40.20 last 19.71)
 - mkdir 901 (time 1786215502.80 total 50.24 last 17.72)
 - mkdir 976 (time 1786215512.86 total 60.30 last 7.46)
total: 1000 mkdir in 62.22 seconds: 16.07 ops/second
Time for file creation 72 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786215523 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215523 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215523 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215523 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215523 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215524 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215524 ; total 1 ; last 1)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786215524 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215524 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786215524 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
Time for file removal 38 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8