== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:55:01 (1786690501)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.81 seconds: 12.31 ops/second
 - mkdir 112 (time 1786690525.94 total 10.07 last 11.12)
 - mkdir 267 (time 1786690535.97 total 20.09 last 15.46)
 - mkdir 493 (time 1786690545.97 total 30.10 last 22.58)
 - mkdir 726 (time 1786690555.99 total 40.11 last 23.27)
 - mkdir 900 (time 1786690566.05 total 50.17 last 17.29)
total: 1000 mkdir in 56.22 seconds: 17.79 ops/second
 - mkdir 131 (time 1786690527.66 total 10.03 last 13.06)
 - mkdir 287 (time 1786690537.69 total 20.06 last 15.55)
 - mkdir 541 (time 1786690547.71 total 30.08 last 25.36)
 - mkdir 764 (time 1786690557.77 total 40.14 last 22.15)
 - mkdir 928 (time 1786690567.81 total 50.18 last 16.35)
total: 1000 mkdir in 54.67 seconds: 18.29 ops/second
 - mkdir 136 (time 1786690529.17 total 10.04 last 13.55)
 - mkdir 297 (time 1786690539.27 total 20.15 last 15.93)
 - mkdir 559 (time 1786690549.32 total 30.19 last 26.09)
 - mkdir 770 (time 1786690559.36 total 40.24 last 21.00)
 - mkdir 939 (time 1786690569.37 total 50.24 last 16.89)
total: 1000 mkdir in 55.72 seconds: 17.95 ops/second
 - mkdir 123 (time 1786690527.82 total 10.03 last 12.26)
 - mkdir 278 (time 1786690537.84 total 20.05 last 15.46)
 - mkdir 528 (time 1786690547.85 total 30.06 last 24.98)
 - mkdir 746 (time 1786690557.86 total 40.07 last 21.78)
 - mkdir 911 (time 1786690567.91 total 50.12 last 16.42)
total: 1000 mkdir in 57.62 seconds: 17.35 ops/second
 - mkdir 131 (time 1786690528.97 total 10.08 last 13.00)
 - mkdir 290 (time 1786690539.11 total 20.21 last 15.69)
 - mkdir 546 (time 1786690549.14 total 30.24 last 25.52)
 - mkdir 755 (time 1786690559.19 total 40.30 last 20.78)
 - mkdir 924 (time 1786690569.22 total 50.32 last 16.86)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
 - mkdir 131 (time 1786690529.24 total 10.04 last 13.05)
 - mkdir 290 (time 1786690539.25 total 20.06 last 15.88)
 - mkdir 551 (time 1786690549.26 total 30.06 last 26.08)
 - mkdir 762 (time 1786690559.31 total 40.11 last 20.99)
 - mkdir 928 (time 1786690569.34 total 50.14 last 16.55)
total: 1000 mkdir in 57.36 seconds: 17.43 ops/second
 - mkdir 126 (time 1786690528.53 total 10.07 last 12.51)
 - mkdir 277 (time 1786690538.54 total 20.08 last 15.08)
 - mkdir 533 (time 1786690548.57 total 30.11 last 25.53)
 - mkdir 745 (time 1786690558.57 total 40.11 last 21.20)
 - mkdir 912 (time 1786690568.58 total 50.12 last 16.68)
total: 1000 mkdir in 58.36 seconds: 17.14 ops/second
 - mkdir 134 (time 1786690529.09 total 10.03 last 13.36)
 - mkdir 289 (time 1786690539.10 total 20.04 last 15.49)
 - mkdir 545 (time 1786690549.12 total 30.05 last 25.56)
 - mkdir 751 (time 1786690559.14 total 40.07 last 20.56)
 - mkdir 920 (time 1786690569.18 total 50.11 last 16.83)
total: 1000 mkdir in 57.77 seconds: 17.31 ops/second
 - mkdir 123 (time 1786690527.46 total 10.02 last 12.28)
 - mkdir 266 (time 1786690537.50 total 20.06 last 14.24)
 - mkdir 509 (time 1786690547.52 total 30.07 last 24.27)
 - mkdir 725 (time 1786690557.53 total 40.09 last 21.56)
 - mkdir 891 (time 1786690567.63 total 50.18 last 16.44)
total: 1000 mkdir in 59.96 seconds: 16.68 ops/second
 - mkdir 133 (time 1786690528.91 total 10.05 last 13.23)
 - mkdir 289 (time 1786690538.91 total 20.05 last 15.60)
 - mkdir 542 (time 1786690548.96 total 30.11 last 25.16)
 - mkdir 749 (time 1786690559.00 total 40.15 last 20.63)
 - mkdir 917 (time 1786690569.02 total 50.16 last 16.77)
total: 1000 mkdir in 58.89 seconds: 16.98 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 18 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 23.78 ops/second
 - mkdir 166 (time 1786691107.63 total 10.06 last 16.51)
 - mkdir 336 (time 1786691117.66 total 20.08 last 16.96)
 - mkdir 494 (time 1786691127.69 total 30.11 last 15.74)
 - mkdir 635 (time 1786691137.79 total 40.21 last 13.96)
 - mkdir 757 (time 1786691147.82 total 50.24 last 12.17)
 - mkdir 888 (time 1786691157.89 total 60.32 last 13.00)
total: 1000 mkdir in 68.40 seconds: 14.62 ops/second
 - mkdir 157 (time 1786691106.72 total 10.04 last 15.64)
 - mkdir 323 (time 1786691116.80 total 20.11 last 16.48)
 - mkdir 481 (time 1786691126.84 total 30.16 last 15.72)
 - mkdir 614 (time 1786691136.90 total 40.22 last 13.22)
 - mkdir 734 (time 1786691146.91 total 50.23 last 11.99)
 - mkdir 859 (time 1786691156.97 total 60.28 last 12.43)
 - mkdir 989 (time 1786691167.05 total 70.36 last 12.90)
total: 1000 mkdir in 71.80 seconds: 13.93 ops/second
 - mkdir 154 (time 1786691107.22 total 10.06 last 15.31)
 - mkdir 319 (time 1786691117.23 total 20.07 last 16.48)
 - mkdir 473 (time 1786691127.28 total 30.12 last 15.33)
 - mkdir 607 (time 1786691137.31 total 40.14 last 13.36)
 - mkdir 731 (time 1786691147.33 total 50.17 last 12.37)
 - mkdir 850 (time 1786691157.37 total 60.21 last 11.85)
 - mkdir 975 (time 1786691167.39 total 70.23 last 12.48)
total: 1000 mkdir in 73.30 seconds: 13.64 ops/second
 - mkdir 166 (time 1786691107.63 total 10.02 last 16.57)
 - mkdir 327 (time 1786691117.65 total 20.04 last 16.07)
 - mkdir 477 (time 1786691127.65 total 30.04 last 15.00)
 - mkdir 613 (time 1786691137.67 total 40.06 last 13.57)
 - mkdir 732 (time 1786691147.68 total 50.07 last 11.89)
 - mkdir 854 (time 1786691157.78 total 60.17 last 12.07)
 - mkdir 981 (time 1786691167.83 total 70.23 last 12.63)
total: 1000 mkdir in 73.02 seconds: 13.69 ops/second
 - mkdir 170 (time 1786691109.01 total 10.00 last 16.99)
 - mkdir 341 (time 1786691119.03 total 20.03 last 17.07)
 - mkdir 488 (time 1786691129.09 total 30.09 last 14.60)
 - mkdir 626 (time 1786691139.13 total 40.13 last 13.75)
 - mkdir 753 (time 1786691149.20 total 50.20 last 12.61)
 - mkdir 871 (time 1786691159.23 total 60.23 last 11.77)
 - mkdir 986 (time 1786691169.23 total 70.23 last 11.49)
total: 1000 mkdir in 72.21 seconds: 13.85 ops/second
 - mkdir 169 (time 1786691108.92 total 10.10 last 16.73)
 - mkdir 340 (time 1786691118.94 total 20.12 last 17.06)
 - mkdir 481 (time 1786691128.95 total 30.13 last 14.09)
 - mkdir 619 (time 1786691138.97 total 40.15 last 13.77)
 - mkdir 745 (time 1786691149.04 total 50.22 last 12.52)
 - mkdir 867 (time 1786691159.04 total 60.22 last 12.20)
 - mkdir 985 (time 1786691169.14 total 70.32 last 11.69)
total: 1000 mkdir in 72.63 seconds: 13.77 ops/second
 - mkdir 166 (time 1786691108.65 total 10.04 last 16.54)
 - mkdir 328 (time 1786691118.67 total 20.05 last 16.18)
 - mkdir 473 (time 1786691128.75 total 30.13 last 14.39)
 - mkdir 607 (time 1786691138.80 total 40.18 last 13.34)
 - mkdir 730 (time 1786691148.89 total 50.28 last 12.18)
 - mkdir 853 (time 1786691158.92 total 60.30 last 12.27)
 - mkdir 970 (time 1786691169.00 total 70.38 last 11.60)
total: 1000 mkdir in 74.80 seconds: 13.37 ops/second
 - mkdir 163 (time 1786691108.74 total 10.02 last 16.27)
 - mkdir 324 (time 1786691118.78 total 20.07 last 16.02)
 - mkdir 467 (time 1786691128.83 total 30.11 last 14.23)
 - mkdir 602 (time 1786691138.87 total 40.15 last 13.45)
 - mkdir 720 (time 1786691148.88 total 50.16 last 11.79)
 - mkdir 843 (time 1786691158.89 total 60.17 last 12.29)
 - mkdir 970 (time 1786691169.11 total 70.39 last 12.43)
total: 1000 mkdir in 74.81 seconds: 13.37 ops/second
 - mkdir 161 (time 1786691108.99 total 10.07 last 15.99)
 - mkdir 318 (time 1786691119.00 total 20.08 last 15.68)
 - mkdir 467 (time 1786691129.12 total 30.20 last 14.72)
 - mkdir 597 (time 1786691139.24 total 40.32 last 12.85)
 - mkdir 719 (time 1786691149.25 total 50.34 last 12.18)
 - mkdir 843 (time 1786691159.26 total 60.34 last 12.40)
 - mkdir 959 (time 1786691169.30 total 70.38 last 11.56)
total: 1000 mkdir in 75.96 seconds: 13.16 ops/second
 - mkdir 158 (time 1786691108.76 total 10.05 last 15.72)
 - mkdir 312 (time 1786691118.77 total 20.07 last 15.38)
 - mkdir 451 (time 1786691128.81 total 30.10 last 13.85)
 - mkdir 574 (time 1786691138.87 total 40.16 last 12.23)
 - mkdir 690 (time 1786691148.96 total 50.25 last 11.49)
 - mkdir 808 (time 1786691158.96 total 60.25 last 11.80)
 - mkdir 928 (time 1786691169.00 total 70.29 last 11.95)
total: 1000 mkdir in 77.94 seconds: 12.83 ops/second
Time for file creation 90 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786691186 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786691186 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786691187 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786691187 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786691187 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786691188 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786691188 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786691188 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786691187 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786691188 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8