== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:21:00 (1787620860)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.42 seconds: 23.65 ops/second
 - mkdir 200 (time 1787620879.10 total 10.00 last 20.00)
 - mkdir 348 (time 1787620889.12 total 20.02 last 14.78)
 - mkdir 505 (time 1787620899.13 total 30.03 last 15.68)
 - mkdir 661 (time 1787620909.14 total 40.04 last 15.59)
 - mkdir 801 (time 1787620919.23 total 50.12 last 13.88)
 - mkdir 955 (time 1787620929.32 total 60.22 last 15.25)
total: 1000 mkdir in 63.48 seconds: 15.75 ops/second
 - mkdir 184 (time 1787620881.85 total 10.03 last 18.35)
 - mkdir 353 (time 1787620891.86 total 20.04 last 16.88)
 - mkdir 519 (time 1787620901.90 total 30.07 last 16.54)
 - mkdir 673 (time 1787620911.97 total 40.14 last 15.30)
 - mkdir 833 (time 1787620922.02 total 50.19 last 15.92)
 - mkdir 989 (time 1787620932.04 total 60.21 last 15.57)
total: 1000 mkdir in 61.41 seconds: 16.28 ops/second
 - mkdir 186 (time 1787620882.95 total 10.01 last 18.58)
 - mkdir 363 (time 1787620892.96 total 20.02 last 17.68)
 - mkdir 527 (time 1787620903.06 total 30.12 last 16.23)
 - mkdir 673 (time 1787620913.14 total 40.20 last 14.48)
 - mkdir 836 (time 1787620923.21 total 50.27 last 16.19)
 - mkdir 992 (time 1787620933.24 total 60.30 last 15.56)
total: 1000 mkdir in 61.12 seconds: 16.36 ops/second
 - mkdir 181 (time 1787620882.86 total 10.02 last 18.07)
 - mkdir 357 (time 1787620892.88 total 20.04 last 17.56)
 - mkdir 526 (time 1787620902.88 total 30.05 last 16.90)
 - mkdir 673 (time 1787620913.05 total 40.22 last 14.45)
 - mkdir 833 (time 1787620923.10 total 50.26 last 15.93)
 - mkdir 990 (time 1787620933.19 total 60.35 last 15.56)
total: 1000 mkdir in 61.57 seconds: 16.24 ops/second
 - mkdir 179 (time 1787620882.93 total 10.04 last 17.84)
 - mkdir 355 (time 1787620892.94 total 20.05 last 17.58)
 - mkdir 524 (time 1787620902.95 total 30.05 last 16.89)
 - mkdir 672 (time 1787620913.01 total 40.11 last 14.71)
 - mkdir 830 (time 1787620923.01 total 50.11 last 15.79)
 - mkdir 978 (time 1787620933.06 total 60.16 last 14.73)
total: 1000 mkdir in 62.87 seconds: 15.91 ops/second
 - mkdir 180 (time 1787620883.06 total 10.06 last 17.90)
 - mkdir 352 (time 1787620893.08 total 20.08 last 17.17)
 - mkdir 520 (time 1787620903.12 total 30.11 last 16.74)
 - mkdir 668 (time 1787620913.18 total 40.18 last 14.70)
 - mkdir 828 (time 1787620923.24 total 50.23 last 15.91)
 - mkdir 977 (time 1787620933.27 total 60.26 last 14.85)
total: 1000 mkdir in 63.20 seconds: 15.82 ops/second
 - mkdir 179 (time 1787620883.27 total 10.03 last 17.84)
 - mkdir 355 (time 1787620893.27 total 20.04 last 17.59)
 - mkdir 518 (time 1787620903.34 total 30.10 last 16.19)
 - mkdir 671 (time 1787620913.45 total 40.22 last 15.13)
 - mkdir 832 (time 1787620923.47 total 50.24 last 16.06)
 - mkdir 975 (time 1787620933.49 total 60.25 last 14.28)
total: 1000 mkdir in 63.30 seconds: 15.80 ops/second
 - mkdir 180 (time 1787620883.06 total 10.02 last 17.96)
 - mkdir 354 (time 1787620893.10 total 20.06 last 17.33)
 - mkdir 517 (time 1787620903.11 total 30.07 last 16.28)
 - mkdir 667 (time 1787620913.17 total 40.13 last 14.91)
 - mkdir 823 (time 1787620923.22 total 50.18 last 15.53)
 - mkdir 976 (time 1787620933.27 total 60.23 last 15.22)
total: 1000 mkdir in 63.86 seconds: 15.66 ops/second
 - mkdir 180 (time 1787620881.98 total 10.11 last 17.80)
 - mkdir 341 (time 1787620892.00 total 20.13 last 16.06)
 - mkdir 504 (time 1787620902.02 total 30.15 last 16.27)
 - mkdir 655 (time 1787620912.03 total 40.16 last 15.08)
 - mkdir 811 (time 1787620922.07 total 50.20 last 15.55)
 - mkdir 961 (time 1787620932.14 total 60.27 last 14.89)
total: 1000 mkdir in 65.19 seconds: 15.34 ops/second
 - mkdir 182 (time 1787620882.39 total 10.03 last 18.15)
 - mkdir 344 (time 1787620892.39 total 20.03 last 16.20)
 - mkdir 508 (time 1787620902.43 total 30.06 last 16.34)
 - mkdir 657 (time 1787620912.51 total 40.14 last 14.78)
 - mkdir 809 (time 1787620922.54 total 50.17 last 15.16)
 - mkdir 959 (time 1787620932.56 total 60.20 last 14.96)
total: 1000 mkdir in 65.42 seconds: 15.29 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.90 ops/second
 - mkdir 169 (time 1787621452.74 total 10.03 last 16.84)
 - mkdir 342 (time 1787621462.79 total 20.09 last 17.21)
 - mkdir 528 (time 1787621472.83 total 30.13 last 18.52)
 - mkdir 687 (time 1787621482.88 total 40.18 last 15.83)
 - mkdir 845 (time 1787621492.91 total 50.21 last 15.75)
total: 1000 mkdir in 58.94 seconds: 16.97 ops/second
 - mkdir 176 (time 1787621455.11 total 10.09 last 17.44)
 - mkdir 353 (time 1787621465.19 total 20.17 last 17.57)
 - mkdir 531 (time 1787621475.22 total 30.20 last 17.73)
 - mkdir 683 (time 1787621485.26 total 40.24 last 15.15)
 - mkdir 866 (time 1787621495.28 total 50.26 last 18.25)
 - mkdir 999 (time 1787621505.31 total 60.29 last 13.27)
total: 1000 mkdir in 60.29 seconds: 16.59 ops/second
 - mkdir 185 (time 1787621456.04 total 10.02 last 18.46)
 - mkdir 374 (time 1787621466.05 total 20.03 last 18.88)
 - mkdir 548 (time 1787621476.08 total 30.06 last 17.35)
 - mkdir 698 (time 1787621486.10 total 40.08 last 14.97)
 - mkdir 883 (time 1787621496.17 total 50.15 last 18.36)
total: 1000 mkdir in 59.40 seconds: 16.84 ops/second
 - mkdir 179 (time 1787621455.40 total 10.03 last 17.85)
 - mkdir 366 (time 1787621465.42 total 20.04 last 18.67)
 - mkdir 544 (time 1787621475.46 total 30.08 last 17.73)
 - mkdir 688 (time 1787621485.47 total 40.09 last 14.38)
 - mkdir 867 (time 1787621495.49 total 50.11 last 17.87)
 - mkdir 995 (time 1787621505.55 total 60.17 last 12.72)
total: 1000 mkdir in 60.62 seconds: 16.50 ops/second
 - mkdir 188 (time 1787621456.41 total 10.04 last 18.72)
 - mkdir 376 (time 1787621466.47 total 20.10 last 18.69)
 - mkdir 556 (time 1787621476.51 total 30.15 last 17.92)
 - mkdir 704 (time 1787621486.52 total 40.16 last 14.78)
 - mkdir 882 (time 1787621496.53 total 50.17 last 17.78)
total: 1000 mkdir in 59.98 seconds: 16.67 ops/second
 - mkdir 183 (time 1787621456.00 total 10.04 last 18.24)
 - mkdir 370 (time 1787621466.04 total 20.08 last 18.61)
 - mkdir 546 (time 1787621476.07 total 30.11 last 17.55)
 - mkdir 691 (time 1787621486.08 total 40.12 last 14.49)
 - mkdir 873 (time 1787621496.13 total 50.17 last 18.12)
 - mkdir 995 (time 1787621506.20 total 60.24 last 12.11)
total: 1000 mkdir in 60.64 seconds: 16.49 ops/second
 - mkdir 182 (time 1787621456.35 total 10.06 last 18.09)
 - mkdir 368 (time 1787621466.42 total 20.12 last 18.48)
 - mkdir 543 (time 1787621476.47 total 30.18 last 17.40)
 - mkdir 696 (time 1787621486.54 total 40.25 last 15.20)
 - mkdir 876 (time 1787621496.55 total 50.25 last 17.99)
 - mkdir 998 (time 1787621506.58 total 60.28 last 12.16)
total: 1000 mkdir in 60.36 seconds: 16.57 ops/second
 - mkdir 187 (time 1787621456.49 total 10.03 last 18.64)
 - mkdir 368 (time 1787621466.50 total 20.04 last 18.08)
 - mkdir 542 (time 1787621476.51 total 30.05 last 17.38)
 - mkdir 693 (time 1787621486.54 total 40.08 last 15.05)
 - mkdir 871 (time 1787621496.58 total 50.12 last 17.74)
 - mkdir 991 (time 1787621506.64 total 60.18 last 11.92)
total: 1000 mkdir in 61.18 seconds: 16.35 ops/second
 - mkdir 189 (time 1787621456.76 total 10.02 last 18.87)
 - mkdir 373 (time 1787621466.79 total 20.05 last 18.35)
 - mkdir 548 (time 1787621476.84 total 30.10 last 17.41)
 - mkdir 696 (time 1787621486.87 total 40.13 last 14.76)
 - mkdir 873 (time 1787621496.89 total 50.15 last 17.66)
 - mkdir 990 (time 1787621506.92 total 60.17 last 11.67)
total: 1000 mkdir in 61.16 seconds: 16.35 ops/second
 - mkdir 187 (time 1787621456.73 total 10.04 last 18.62)
 - mkdir 370 (time 1787621466.73 total 20.05 last 18.29)
 - mkdir 542 (time 1787621476.78 total 30.09 last 17.12)
 - mkdir 690 (time 1787621486.81 total 40.12 last 14.76)
 - mkdir 867 (time 1787621496.89 total 50.20 last 17.55)
 - mkdir 989 (time 1787621506.99 total 60.30 last 12.08)
total: 1000 mkdir in 61.65 seconds: 16.22 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787621519 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787621519 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787621520 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787621520 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787621521 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787621520 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787621521 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787621521 ; total 1 ; last 1)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787621521 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787621521 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
Time for file removal 50 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8