== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 10:59:34 (1789657174)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.41 ops/second
 - mkdir 147 (time 1789657195.46 total 10.03 last 14.66)
 - mkdir 325 (time 1789657205.50 total 20.07 last 17.72)
 - mkdir 507 (time 1789657215.52 total 30.09 last 18.16)
 - mkdir 696 (time 1789657225.53 total 40.10 last 18.88)
 - mkdir 892 (time 1789657235.57 total 50.15 last 19.51)
total: 1000 mkdir in 56.42 seconds: 17.72 ops/second
 - mkdir 143 (time 1789657194.55 total 10.05 last 14.22)
 - mkdir 299 (time 1789657204.57 total 20.08 last 15.57)
 - mkdir 470 (time 1789657214.60 total 30.10 last 17.06)
 - mkdir 665 (time 1789657224.62 total 40.13 last 19.45)
 - mkdir 868 (time 1789657234.67 total 50.18 last 20.20)
total: 1000 mkdir in 57.90 seconds: 17.27 ops/second
 - mkdir 148 (time 1789657196.20 total 10.02 last 14.77)
 - mkdir 318 (time 1789657206.22 total 20.03 last 16.98)
 - mkdir 503 (time 1789657216.26 total 30.08 last 18.42)
 - mkdir 706 (time 1789657226.29 total 40.10 last 20.24)
 - mkdir 896 (time 1789657236.37 total 50.19 last 18.84)
total: 1000 mkdir in 56.33 seconds: 17.75 ops/second
 - mkdir 144 (time 1789657194.79 total 10.09 last 14.28)
 - mkdir 313 (time 1789657204.81 total 20.11 last 16.87)
 - mkdir 489 (time 1789657214.82 total 30.11 last 17.59)
 - mkdir 677 (time 1789657224.86 total 40.16 last 18.72)
 - mkdir 871 (time 1789657234.87 total 50.16 last 19.39)
total: 1000 mkdir in 57.91 seconds: 17.27 ops/second
 - mkdir 145 (time 1789657195.28 total 10.06 last 14.41)
 - mkdir 317 (time 1789657205.32 total 20.11 last 17.12)
 - mkdir 491 (time 1789657215.32 total 30.11 last 17.39)
 - mkdir 683 (time 1789657225.33 total 40.12 last 19.19)
 - mkdir 876 (time 1789657235.33 total 50.12 last 19.30)
total: 1000 mkdir in 57.51 seconds: 17.39 ops/second
 - mkdir 145 (time 1789657195.52 total 10.09 last 14.38)
 - mkdir 315 (time 1789657205.53 total 20.10 last 16.98)
 - mkdir 493 (time 1789657215.54 total 30.11 last 17.78)
 - mkdir 684 (time 1789657225.55 total 40.12 last 19.08)
 - mkdir 880 (time 1789657235.57 total 50.14 last 19.57)
total: 1000 mkdir in 57.64 seconds: 17.35 ops/second
 - mkdir 144 (time 1789657196.10 total 10.02 last 14.38)
 - mkdir 310 (time 1789657206.15 total 20.06 last 16.52)
 - mkdir 484 (time 1789657216.21 total 30.12 last 17.30)
 - mkdir 685 (time 1789657226.22 total 40.14 last 20.06)
 - mkdir 879 (time 1789657236.26 total 50.17 last 19.33)
total: 1000 mkdir in 57.91 seconds: 17.27 ops/second
 - mkdir 142 (time 1789657196.24 total 10.00 last 14.20)
 - mkdir 307 (time 1789657206.25 total 20.00 last 16.49)
 - mkdir 490 (time 1789657216.26 total 30.02 last 18.27)
 - mkdir 687 (time 1789657226.26 total 40.02 last 19.69)
 - mkdir 874 (time 1789657236.30 total 50.06 last 18.63)
total: 1000 mkdir in 58.42 seconds: 17.12 ops/second
 - mkdir 146 (time 1789657196.13 total 10.03 last 14.55)
 - mkdir 312 (time 1789657206.14 total 20.04 last 16.58)
 - mkdir 492 (time 1789657216.21 total 30.11 last 17.89)
 - mkdir 691 (time 1789657226.26 total 40.16 last 19.80)
 - mkdir 878 (time 1789657236.30 total 50.20 last 18.62)
total: 1000 mkdir in 58.58 seconds: 17.07 ops/second
 - mkdir 145 (time 1789657196.37 total 10.06 last 14.42)
 - mkdir 313 (time 1789657206.38 total 20.06 last 16.79)
 - mkdir 487 (time 1789657216.41 total 30.09 last 17.35)
 - mkdir 684 (time 1789657226.44 total 40.12 last 19.64)
 - mkdir 872 (time 1789657236.45 total 50.14 last 18.77)
total: 1000 mkdir in 58.63 seconds: 17.06 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.58 seconds: 17.15 ops/second
 - mkdir 159 (time 1789657767.33 total 10.04 last 15.84)
 - mkdir 327 (time 1789657777.38 total 20.08 last 16.72)
 - mkdir 505 (time 1789657787.43 total 30.13 last 17.72)
 - mkdir 687 (time 1789657797.47 total 40.18 last 18.12)
 - mkdir 835 (time 1789657807.50 total 50.20 last 14.76)
 - mkdir 993 (time 1789657817.52 total 60.22 last 15.77)
total: 1000 mkdir in 60.63 seconds: 16.49 ops/second
 - mkdir 154 (time 1789657768.49 total 10.00 last 15.40)
 - mkdir 330 (time 1789657778.51 total 20.03 last 17.56)
 - mkdir 506 (time 1789657788.55 total 30.06 last 17.55)
 - mkdir 694 (time 1789657798.58 total 40.09 last 18.74)
 - mkdir 839 (time 1789657808.61 total 50.12 last 14.45)
 - mkdir 995 (time 1789657818.64 total 60.15 last 15.56)
total: 1000 mkdir in 60.53 seconds: 16.52 ops/second
 - mkdir 156 (time 1789657768.35 total 10.03 last 15.55)
 - mkdir 326 (time 1789657778.42 total 20.10 last 16.90)
 - mkdir 505 (time 1789657788.44 total 30.12 last 17.86)
 - mkdir 689 (time 1789657798.48 total 40.17 last 18.31)
 - mkdir 834 (time 1789657808.49 total 50.17 last 14.49)
 - mkdir 987 (time 1789657818.53 total 60.21 last 15.24)
total: 1000 mkdir in 61.35 seconds: 16.30 ops/second
 - mkdir 150 (time 1789657767.97 total 10.06 last 14.91)
 - mkdir 320 (time 1789657777.98 total 20.07 last 16.98)
 - mkdir 494 (time 1789657788.06 total 30.15 last 17.26)
 - mkdir 678 (time 1789657798.12 total 40.21 last 18.29)
 - mkdir 825 (time 1789657808.17 total 50.26 last 14.62)
 - mkdir 984 (time 1789657818.27 total 60.35 last 15.76)
total: 1000 mkdir in 61.84 seconds: 16.17 ops/second
 - mkdir 158 (time 1789657768.45 total 10.05 last 15.71)
 - mkdir 332 (time 1789657778.48 total 20.08 last 17.35)
 - mkdir 507 (time 1789657788.53 total 30.13 last 17.41)
 - mkdir 690 (time 1789657798.58 total 40.18 last 18.22)
 - mkdir 834 (time 1789657808.64 total 50.24 last 14.31)
 - mkdir 988 (time 1789657818.65 total 60.25 last 15.39)
total: 1000 mkdir in 61.41 seconds: 16.28 ops/second
 - mkdir 151 (time 1789657768.88 total 10.05 last 15.02)
 - mkdir 329 (time 1789657778.92 total 20.10 last 17.72)
 - mkdir 501 (time 1789657788.94 total 30.12 last 17.16)
 - mkdir 682 (time 1789657798.98 total 40.16 last 18.03)
 - mkdir 831 (time 1789657808.98 total 50.16 last 14.90)
 - mkdir 984 (time 1789657819.08 total 60.26 last 15.15)
total: 1000 mkdir in 61.78 seconds: 16.19 ops/second
 - mkdir 153 (time 1789657768.65 total 10.04 last 15.24)
 - mkdir 320 (time 1789657778.69 total 20.08 last 16.64)
 - mkdir 493 (time 1789657788.74 total 30.14 last 17.20)
 - mkdir 677 (time 1789657798.79 total 40.19 last 18.31)
 - mkdir 824 (time 1789657808.80 total 50.19 last 14.69)
 - mkdir 979 (time 1789657818.84 total 60.23 last 15.45)
total: 1000 mkdir in 62.44 seconds: 16.02 ops/second
 - mkdir 148 (time 1789657768.55 total 10.02 last 14.76)
 - mkdir 318 (time 1789657778.59 total 20.06 last 16.94)
 - mkdir 499 (time 1789657788.64 total 30.11 last 18.00)
 - mkdir 683 (time 1789657798.67 total 40.15 last 18.34)
 - mkdir 826 (time 1789657808.71 total 50.18 last 14.24)
 - mkdir 974 (time 1789657818.77 total 60.24 last 14.72)
total: 1000 mkdir in 63.11 seconds: 15.84 ops/second
 - mkdir 152 (time 1789657768.56 total 10.02 last 15.16)
 - mkdir 320 (time 1789657778.59 total 20.06 last 16.75)
 - mkdir 488 (time 1789657788.60 total 30.07 last 16.78)
 - mkdir 670 (time 1789657798.66 total 40.12 last 18.10)
 - mkdir 817 (time 1789657808.69 total 50.15 last 14.65)
 - mkdir 971 (time 1789657818.72 total 60.18 last 15.36)
total: 1000 mkdir in 63.21 seconds: 15.82 ops/second
 - mkdir 145 (time 1789657768.89 total 10.05 last 14.43)
 - mkdir 313 (time 1789657778.93 total 20.09 last 16.73)
 - mkdir 478 (time 1789657788.96 total 30.12 last 16.46)
 - mkdir 659 (time 1789657798.98 total 40.14 last 18.05)
 - mkdir 805 (time 1789657808.98 total 50.15 last 14.60)
 - mkdir 956 (time 1789657819.03 total 60.19 last 15.03)
total: 1000 mkdir in 64.37 seconds: 15.54 ops/second
Time for file creation 74 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789657830 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657830 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657831 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789657831 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1789657832 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8