== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 12:14:11 (1786983251)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.55 seconds: 18.29 ops/second
 - mkdir 131 (time 1786983273.19 total 10.11 last 12.95)
 - mkdir 267 (time 1786983283.21 total 20.13 last 13.57)
 - mkdir 412 (time 1786983293.25 total 30.18 last 14.44)
 - mkdir 582 (time 1786983303.26 total 40.19 last 16.99)
 - mkdir 746 (time 1786983313.29 total 50.21 last 16.35)
 - mkdir 926 (time 1786983323.37 total 60.30 last 17.85)
total: 1000 mkdir in 63.99 seconds: 15.63 ops/second
 - mkdir 148 (time 1786983278.55 total 10.17 last 14.56)
 - mkdir 287 (time 1786983288.58 total 20.19 last 13.86)
 - mkdir 456 (time 1786983298.62 total 30.24 last 16.82)
 - mkdir 624 (time 1786983308.66 total 40.28 last 16.74)
 - mkdir 800 (time 1786983318.69 total 50.30 last 17.55)
 - mkdir 979 (time 1786983328.77 total 60.38 last 17.76)
total: 1000 mkdir in 62.56 seconds: 15.99 ops/second
 - mkdir 148 (time 1786983278.27 total 10.05 last 14.73)
 - mkdir 286 (time 1786983288.38 total 20.16 last 13.64)
 - mkdir 443 (time 1786983298.44 total 30.23 last 15.60)
 - mkdir 607 (time 1786983308.48 total 40.27 last 16.33)
 - mkdir 782 (time 1786983318.52 total 50.30 last 17.44)
 - mkdir 966 (time 1786983328.67 total 60.45 last 18.12)
total: 1000 mkdir in 65.31 seconds: 15.31 ops/second
 - mkdir 136 (time 1786983278.06 total 10.04 last 13.54)
 - mkdir 273 (time 1786983288.10 total 20.09 last 13.64)
 - mkdir 436 (time 1786983298.12 total 30.11 last 16.27)
 - mkdir 605 (time 1786983308.14 total 40.13 last 16.87)
 - mkdir 775 (time 1786983318.18 total 50.17 last 16.93)
 - mkdir 957 (time 1786983328.20 total 60.19 last 18.16)
total: 1000 mkdir in 65.88 seconds: 15.18 ops/second
 - mkdir 141 (time 1786983278.19 total 10.03 last 14.06)
 - mkdir 281 (time 1786983288.22 total 20.05 last 13.96)
 - mkdir 437 (time 1786983298.25 total 30.08 last 15.55)
 - mkdir 598 (time 1786983308.30 total 40.14 last 16.02)
 - mkdir 770 (time 1786983318.32 total 50.16 last 17.17)
 - mkdir 954 (time 1786983328.36 total 60.20 last 18.32)
total: 1000 mkdir in 66.50 seconds: 15.04 ops/second
 - mkdir 142 (time 1786983278.38 total 10.03 last 14.16)
 - mkdir 274 (time 1786983288.48 total 20.12 last 13.08)
 - mkdir 433 (time 1786983298.55 total 30.19 last 15.79)
 - mkdir 595 (time 1786983308.57 total 40.21 last 16.16)
 - mkdir 773 (time 1786983318.62 total 50.26 last 17.71)
 - mkdir 953 (time 1786983328.64 total 60.28 last 17.97)
total: 1000 mkdir in 66.54 seconds: 15.03 ops/second
 - mkdir 136 (time 1786983277.86 total 10.06 last 13.51)
 - mkdir 275 (time 1786983287.91 total 20.12 last 13.83)
 - mkdir 434 (time 1786983297.91 total 30.12 last 15.90)
 - mkdir 595 (time 1786983307.98 total 40.19 last 15.99)
 - mkdir 768 (time 1786983318.02 total 50.23 last 17.23)
 - mkdir 949 (time 1786983328.09 total 60.30 last 17.97)
total: 1000 mkdir in 67.20 seconds: 14.88 ops/second
 - mkdir 145 (time 1786983278.55 total 10.04 last 14.44)
 - mkdir 279 (time 1786983288.65 total 20.13 last 13.28)
 - mkdir 441 (time 1786983298.73 total 30.22 last 16.06)
 - mkdir 604 (time 1786983308.78 total 40.27 last 16.22)
 - mkdir 772 (time 1786983318.81 total 50.30 last 16.75)
 - mkdir 953 (time 1786983328.89 total 60.37 last 17.97)
total: 1000 mkdir in 66.58 seconds: 15.02 ops/second
 - mkdir 139 (time 1786983278.59 total 10.02 last 13.88)
 - mkdir 279 (time 1786983288.67 total 20.10 last 13.89)
 - mkdir 442 (time 1786983298.67 total 30.10 last 16.29)
 - mkdir 607 (time 1786983308.69 total 40.12 last 16.48)
 - mkdir 780 (time 1786983318.73 total 50.16 last 17.23)
 - mkdir 956 (time 1786983328.75 total 60.18 last 17.56)
total: 1000 mkdir in 66.56 seconds: 15.02 ops/second
 - mkdir 130 (time 1786983277.14 total 10.02 last 12.97)
 - mkdir 258 (time 1786983287.20 total 20.08 last 12.72)
 - mkdir 410 (time 1786983297.23 total 30.11 last 15.16)
 - mkdir 571 (time 1786983307.27 total 40.15 last 16.04)
 - mkdir 743 (time 1786983317.31 total 50.19 last 17.14)
 - mkdir 930 (time 1786983327.32 total 60.20 last 18.67)
total: 1000 mkdir in 68.09 seconds: 14.69 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.75 seconds: 13.33 ops/second
 - mkdir 124 (time 1786983833.39 total 10.04 last 12.35)
 - mkdir 331 (time 1786983843.41 total 20.06 last 20.66)
 - mkdir 550 (time 1786983853.44 total 30.08 last 21.85)
 - mkdir 756 (time 1786983863.46 total 40.11 last 20.54)
 - mkdir 872 (time 1786983873.53 total 50.18 last 11.52)
 - mkdir 997 (time 1786983883.60 total 60.24 last 12.42)
total: 1000 mkdir in 60.66 seconds: 16.48 ops/second
 - mkdir 128 (time 1786983833.81 total 10.10 last 12.67)
 - mkdir 342 (time 1786983843.81 total 20.10 last 21.40)
 - mkdir 555 (time 1786983853.83 total 30.13 last 21.25)
 - mkdir 750 (time 1786983863.86 total 40.16 last 19.44)
 - mkdir 863 (time 1786983873.88 total 50.18 last 11.28)
 - mkdir 984 (time 1786983884.13 total 60.43 last 11.80)
total: 1000 mkdir in 62.50 seconds: 16.00 ops/second
 - mkdir 146 (time 1786983835.74 total 10.01 last 14.58)
 - mkdir 361 (time 1786983845.75 total 20.02 last 21.48)
 - mkdir 570 (time 1786983855.77 total 30.04 last 20.86)
 - mkdir 745 (time 1786983865.80 total 40.08 last 17.44)
 - mkdir 864 (time 1786983875.82 total 50.09 last 11.88)
 - mkdir 977 (time 1786983885.92 total 60.20 last 11.19)
total: 1000 mkdir in 64.10 seconds: 15.60 ops/second
 - mkdir 147 (time 1786983836.11 total 10.01 last 14.69)
 - mkdir 368 (time 1786983846.15 total 20.05 last 22.01)
 - mkdir 580 (time 1786983856.15 total 30.05 last 21.19)
 - mkdir 752 (time 1786983866.17 total 40.07 last 17.16)
 - mkdir 866 (time 1786983876.21 total 50.11 last 11.35)
 - mkdir 970 (time 1786983886.30 total 60.20 last 10.32)
total: 1000 mkdir in 65.78 seconds: 15.20 ops/second
 - mkdir 135 (time 1786983835.26 total 10.01 last 13.49)
 - mkdir 346 (time 1786983845.27 total 20.02 last 21.08)
 - mkdir 553 (time 1786983855.29 total 30.04 last 20.66)
 - mkdir 738 (time 1786983865.47 total 40.22 last 18.17)
 - mkdir 853 (time 1786983875.54 total 50.29 last 11.42)
 - mkdir 963 (time 1786983885.59 total 60.34 last 10.94)
total: 1000 mkdir in 67.24 seconds: 14.87 ops/second
 - mkdir 111 (time 1786983831.67 total 10.03 last 11.07)
 - mkdir 285 (time 1786983841.72 total 20.09 last 17.30)
 - mkdir 500 (time 1786983851.73 total 30.09 last 21.50)
 - mkdir 694 (time 1786983861.73 total 40.09 last 19.39)
 - mkdir 811 (time 1786983871.81 total 50.17 last 11.61)
 - mkdir 920 (time 1786983881.82 total 60.18 last 10.89)
 - mkdir 993 (time 1786983891.86 total 70.23 last 7.26)
total: 1000 mkdir in 71.57 seconds: 13.97 ops/second
 - mkdir 145 (time 1786983836.33 total 10.04 last 14.45)
 - mkdir 364 (time 1786983846.36 total 20.07 last 21.83)
 - mkdir 576 (time 1786983856.38 total 30.09 last 21.15)
 - mkdir 747 (time 1786983866.52 total 40.23 last 16.86)
 - mkdir 866 (time 1786983876.57 total 50.28 last 11.84)
 - mkdir 966 (time 1786983886.77 total 60.47 last 9.81)
total: 1000 mkdir in 67.00 seconds: 14.93 ops/second
 - mkdir 141 (time 1786983835.79 total 10.02 last 14.07)
 - mkdir 358 (time 1786983845.83 total 20.07 last 21.60)
 - mkdir 563 (time 1786983855.85 total 30.08 last 20.47)
 - mkdir 734 (time 1786983865.91 total 40.15 last 16.99)
 - mkdir 851 (time 1786983875.94 total 50.17 last 11.67)
 - mkdir 952 (time 1786983886.01 total 60.25 last 10.02)
total: 1000 mkdir in 68.66 seconds: 14.57 ops/second
 - mkdir 145 (time 1786983836.00 total 10.01 last 14.48)
 - mkdir 360 (time 1786983846.01 total 20.03 last 21.46)
 - mkdir 558 (time 1786983856.02 total 30.04 last 19.78)
 - mkdir 734 (time 1786983866.08 total 40.09 last 17.51)
 - mkdir 849 (time 1786983876.13 total 50.15 last 11.44)
 - mkdir 950 (time 1786983886.24 total 60.26 last 9.99)
total: 1000 mkdir in 68.96 seconds: 14.50 ops/second
 - mkdir 149 (time 1786983836.39 total 10.05 last 14.82)
 - mkdir 361 (time 1786983846.44 total 20.10 last 21.10)
 - mkdir 569 (time 1786983856.44 total 30.11 last 20.79)
 - mkdir 731 (time 1786983866.52 total 40.18 last 16.09)
 - mkdir 845 (time 1786983876.52 total 50.18 last 11.39)
 - mkdir 944 (time 1786983886.67 total 60.33 last 9.76)
total: 1000 mkdir in 69.31 seconds: 14.43 ops/second
Time for file creation 84 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786983903 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786983903 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786983904 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786983904 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786983905 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786983905 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786983904 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1786983905 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786983905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1786983905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8