== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 03:25:18 (1789284318)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.34 ops/second
 - mkdir 187 (time 1789284337.35 total 10.02 last 18.66)
 - mkdir 368 (time 1789284347.38 total 20.05 last 18.05)
 - mkdir 541 (time 1789284357.41 total 30.08 last 17.25)
 - mkdir 712 (time 1789284367.42 total 40.09 last 17.08)
 - mkdir 883 (time 1789284377.46 total 50.13 last 17.03)
total: 1000 mkdir in 56.34 seconds: 17.75 ops/second
 - mkdir 197 (time 1789284339.14 total 10.03 last 19.65)
 - mkdir 387 (time 1789284349.17 total 20.05 last 18.95)
 - mkdir 554 (time 1789284359.19 total 30.07 last 16.67)
 - mkdir 741 (time 1789284369.23 total 40.12 last 18.62)
 - mkdir 912 (time 1789284379.30 total 50.18 last 16.99)
total: 1000 mkdir in 54.71 seconds: 18.28 ops/second
 - mkdir 180 (time 1789284337.19 total 10.01 last 17.98)
 - mkdir 363 (time 1789284347.22 total 20.03 last 18.26)
 - mkdir 531 (time 1789284357.26 total 30.08 last 16.72)
 - mkdir 706 (time 1789284367.30 total 40.11 last 17.44)
 - mkdir 876 (time 1789284377.31 total 50.13 last 16.98)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
 - mkdir 189 (time 1789284338.53 total 10.01 last 18.88)
 - mkdir 369 (time 1789284348.56 total 20.04 last 17.95)
 - mkdir 539 (time 1789284358.62 total 30.10 last 16.90)
 - mkdir 724 (time 1789284368.67 total 40.14 last 18.41)
 - mkdir 892 (time 1789284378.68 total 50.16 last 16.77)
total: 1000 mkdir in 56.45 seconds: 17.72 ops/second
 - mkdir 182 (time 1789284337.75 total 10.01 last 18.18)
 - mkdir 361 (time 1789284347.78 total 20.04 last 17.85)
 - mkdir 535 (time 1789284357.80 total 30.07 last 17.35)
 - mkdir 710 (time 1789284367.86 total 40.12 last 17.41)
 - mkdir 882 (time 1789284377.91 total 50.18 last 17.10)
total: 1000 mkdir in 57.38 seconds: 17.43 ops/second
 - mkdir 187 (time 1789284338.45 total 10.03 last 18.64)
 - mkdir 367 (time 1789284348.48 total 20.07 last 17.94)
 - mkdir 538 (time 1789284358.52 total 30.11 last 17.02)
 - mkdir 718 (time 1789284368.53 total 40.11 last 18.00)
 - mkdir 883 (time 1789284378.54 total 50.12 last 16.48)
total: 1000 mkdir in 56.91 seconds: 17.57 ops/second
 - mkdir 194 (time 1789284338.61 total 10.02 last 19.35)
 - mkdir 369 (time 1789284348.64 total 20.05 last 17.45)
 - mkdir 533 (time 1789284358.66 total 30.08 last 16.36)
 - mkdir 715 (time 1789284368.70 total 40.11 last 18.13)
 - mkdir 880 (time 1789284378.73 total 50.15 last 16.45)
total: 1000 mkdir in 57.58 seconds: 17.37 ops/second
 - mkdir 196 (time 1789284339.08 total 10.04 last 19.52)
 - mkdir 378 (time 1789284349.10 total 20.07 last 18.15)
 - mkdir 542 (time 1789284359.11 total 30.08 last 16.39)
 - mkdir 721 (time 1789284369.12 total 40.09 last 17.87)
 - mkdir 880 (time 1789284379.15 total 50.11 last 15.86)
total: 1000 mkdir in 58.16 seconds: 17.19 ops/second
 - mkdir 183 (time 1789284338.91 total 10.01 last 18.29)
 - mkdir 354 (time 1789284348.98 total 20.08 last 16.98)
 - mkdir 516 (time 1789284359.05 total 30.14 last 16.10)
 - mkdir 699 (time 1789284369.06 total 40.16 last 18.27)
 - mkdir 851 (time 1789284379.06 total 50.16 last 15.20)
 - mkdir 995 (time 1789284389.12 total 60.21 last 14.32)
total: 1000 mkdir in 60.45 seconds: 16.54 ops/second
 - mkdir 180 (time 1789284338.63 total 10.04 last 17.93)
 - mkdir 353 (time 1789284348.70 total 20.10 last 17.19)
 - mkdir 516 (time 1789284358.72 total 30.12 last 16.27)
 - mkdir 684 (time 1789284368.72 total 40.12 last 16.80)
 - mkdir 842 (time 1789284378.76 total 50.16 last 15.74)
 - mkdir 982 (time 1789284388.78 total 60.18 last 13.97)
total: 1000 mkdir in 61.21 seconds: 16.34 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 9 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.54 seconds: 18.37 ops/second
 - mkdir 157 (time 1789284907.12 total 10.01 last 15.69)
 - mkdir 305 (time 1789284917.18 total 20.07 last 14.71)
 - mkdir 466 (time 1789284927.23 total 30.12 last 16.02)
 - mkdir 629 (time 1789284937.24 total 40.13 last 16.28)
 - mkdir 802 (time 1789284947.27 total 50.16 last 17.25)
 - mkdir 991 (time 1789284957.30 total 60.19 last 18.85)
total: 1000 mkdir in 60.68 seconds: 16.48 ops/second
 - mkdir 150 (time 1789284906.65 total 10.04 last 14.94)
 - mkdir 303 (time 1789284916.67 total 20.06 last 15.26)
 - mkdir 454 (time 1789284926.70 total 30.09 last 15.06)
 - mkdir 613 (time 1789284936.71 total 40.10 last 15.88)
 - mkdir 780 (time 1789284946.71 total 50.10 last 16.69)
 - mkdir 960 (time 1789284956.73 total 60.12 last 17.97)
total: 1000 mkdir in 63.17 seconds: 15.83 ops/second
 - mkdir 155 (time 1789284906.73 total 10.05 last 15.43)
 - mkdir 303 (time 1789284916.77 total 20.08 last 14.74)
 - mkdir 459 (time 1789284926.81 total 30.12 last 15.54)
 - mkdir 617 (time 1789284936.87 total 40.18 last 15.70)
 - mkdir 781 (time 1789284946.88 total 50.19 last 16.38)
 - mkdir 964 (time 1789284956.90 total 60.21 last 18.27)
total: 1000 mkdir in 63.26 seconds: 15.81 ops/second
 - mkdir 151 (time 1789284907.31 total 10.07 last 15.00)
 - mkdir 301 (time 1789284917.32 total 20.08 last 14.98)
 - mkdir 456 (time 1789284927.35 total 30.11 last 15.45)
 - mkdir 610 (time 1789284937.38 total 40.14 last 15.34)
 - mkdir 778 (time 1789284947.42 total 50.18 last 16.74)
 - mkdir 964 (time 1789284957.51 total 60.27 last 18.43)
total: 1000 mkdir in 63.64 seconds: 15.71 ops/second
 - mkdir 144 (time 1789284906.49 total 10.04 last 14.35)
 - mkdir 291 (time 1789284916.54 total 20.08 last 14.63)
 - mkdir 442 (time 1789284926.61 total 30.15 last 15.00)
 - mkdir 599 (time 1789284936.69 total 40.23 last 15.57)
 - mkdir 766 (time 1789284946.70 total 50.25 last 16.68)
 - mkdir 948 (time 1789284956.74 total 60.28 last 18.14)
total: 1000 mkdir in 64.98 seconds: 15.39 ops/second
 - mkdir 154 (time 1789284907.05 total 10.03 last 15.36)
 - mkdir 304 (time 1789284917.06 total 20.03 last 14.99)
 - mkdir 456 (time 1789284927.07 total 30.04 last 15.18)
 - mkdir 612 (time 1789284937.16 total 40.13 last 15.46)
 - mkdir 773 (time 1789284947.18 total 50.15 last 16.07)
 - mkdir 953 (time 1789284957.20 total 60.17 last 17.96)
total: 1000 mkdir in 65.29 seconds: 15.32 ops/second
 - mkdir 147 (time 1789284907.19 total 10.00 last 14.70)
 - mkdir 295 (time 1789284917.21 total 20.02 last 14.78)
 - mkdir 449 (time 1789284927.24 total 30.04 last 15.36)
 - mkdir 604 (time 1789284937.26 total 40.07 last 15.47)
 - mkdir 770 (time 1789284947.27 total 50.08 last 16.57)
 - mkdir 951 (time 1789284957.30 total 60.10 last 18.06)
total: 1000 mkdir in 65.18 seconds: 15.34 ops/second
 - mkdir 146 (time 1789284907.38 total 10.03 last 14.56)
 - mkdir 290 (time 1789284917.43 total 20.07 last 14.34)
 - mkdir 441 (time 1789284927.44 total 30.09 last 15.08)
 - mkdir 602 (time 1789284937.54 total 40.18 last 15.95)
 - mkdir 769 (time 1789284947.56 total 50.20 last 16.66)
 - mkdir 948 (time 1789284957.58 total 60.22 last 17.87)
total: 1000 mkdir in 65.65 seconds: 15.23 ops/second
 - mkdir 145 (time 1789284906.68 total 10.04 last 14.44)
 - mkdir 289 (time 1789284916.76 total 20.11 last 14.29)
 - mkdir 443 (time 1789284926.81 total 30.16 last 15.32)
 - mkdir 594 (time 1789284936.83 total 40.18 last 15.07)
 - mkdir 754 (time 1789284946.84 total 50.19 last 15.98)
 - mkdir 933 (time 1789284956.87 total 60.23 last 17.84)
total: 1000 mkdir in 66.73 seconds: 14.99 ops/second
 - mkdir 147 (time 1789284907.51 total 10.03 last 14.65)
 - mkdir 285 (time 1789284917.57 total 20.09 last 13.72)
 - mkdir 431 (time 1789284927.62 total 30.14 last 14.53)
 - mkdir 579 (time 1789284937.66 total 40.19 last 14.73)
 - mkdir 742 (time 1789284947.68 total 50.21 last 16.27)
 - mkdir 912 (time 1789284957.72 total 60.24 last 16.94)
total: 1000 mkdir in 68.13 seconds: 14.68 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789284971 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1789284973 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1789284973 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1789284974 ; total 1 ; last 1)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1789284974 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
Time for file removal 38 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8