== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 22:14:42 (1781230482)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.72 seconds: 13.88 ops/second
 - mkdir 135 (time 1781230503.80 total 10.01 last 13.48)
 - mkdir 307 (time 1781230513.85 total 20.07 last 17.11)
 - mkdir 472 (time 1781230523.88 total 30.09 last 16.46)
 - mkdir 642 (time 1781230533.89 total 40.11 last 16.97)
 - mkdir 818 (time 1781230543.94 total 50.15 last 17.52)
 - mkdir 982 (time 1781230553.96 total 60.18 last 16.36)
total: 1000 mkdir in 61.35 seconds: 16.30 ops/second
 - mkdir 157 (time 1781230505.18 total 10.02 last 15.67)
 - mkdir 313 (time 1781230515.19 total 20.04 last 15.57)
 - mkdir 479 (time 1781230525.25 total 30.09 last 16.50)
 - mkdir 660 (time 1781230535.26 total 40.11 last 18.08)
 - mkdir 827 (time 1781230545.32 total 50.16 last 16.61)
 - mkdir 999 (time 1781230555.43 total 60.28 last 17.00)
total: 1000 mkdir in 60.28 seconds: 16.59 ops/second
 - mkdir 161 (time 1781230505.79 total 10.02 last 16.06)
 - mkdir 326 (time 1781230515.81 total 20.04 last 16.47)
 - mkdir 496 (time 1781230525.87 total 30.10 last 16.90)
 - mkdir 679 (time 1781230535.88 total 40.11 last 18.28)
 - mkdir 839 (time 1781230545.90 total 50.14 last 15.97)
total: 1000 mkdir in 60.13 seconds: 16.63 ops/second
 - mkdir 164 (time 1781230505.89 total 10.12 last 16.21)
 - mkdir 330 (time 1781230515.91 total 20.14 last 16.56)
 - mkdir 493 (time 1781230525.99 total 30.22 last 16.17)
 - mkdir 677 (time 1781230536.03 total 40.26 last 18.34)
 - mkdir 841 (time 1781230546.08 total 50.31 last 16.32)
total: 1000 mkdir in 60.26 seconds: 16.59 ops/second
 - mkdir 149 (time 1781230504.91 total 10.01 last 14.88)
 - mkdir 315 (time 1781230514.96 total 20.07 last 16.51)
 - mkdir 482 (time 1781230524.99 total 30.10 last 16.65)
 - mkdir 658 (time 1781230535.04 total 40.14 last 17.52)
 - mkdir 824 (time 1781230545.07 total 50.17 last 16.55)
 - mkdir 990 (time 1781230555.09 total 60.20 last 16.56)
total: 1000 mkdir in 61.22 seconds: 16.33 ops/second
 - mkdir 143 (time 1781230504.95 total 10.02 last 14.27)
 - mkdir 307 (time 1781230514.96 total 20.03 last 16.38)
 - mkdir 474 (time 1781230524.99 total 30.06 last 16.66)
 - mkdir 654 (time 1781230535.00 total 40.07 last 17.98)
 - mkdir 818 (time 1781230545.05 total 50.12 last 16.31)
 - mkdir 987 (time 1781230555.09 total 60.17 last 16.83)
total: 1000 mkdir in 61.40 seconds: 16.29 ops/second
 - mkdir 156 (time 1781230505.73 total 10.05 last 15.53)
 - mkdir 319 (time 1781230515.73 total 20.05 last 16.30)
 - mkdir 481 (time 1781230525.75 total 30.07 last 16.17)
 - mkdir 669 (time 1781230535.77 total 40.08 last 18.76)
 - mkdir 832 (time 1781230545.81 total 50.13 last 16.23)
 - mkdir 993 (time 1781230555.88 total 60.20 last 15.99)
total: 1000 mkdir in 60.73 seconds: 16.47 ops/second
 - mkdir 158 (time 1781230506.14 total 10.00 last 15.80)
 - mkdir 319 (time 1781230516.14 total 20.00 last 16.10)
 - mkdir 483 (time 1781230526.14 total 30.01 last 16.39)
 - mkdir 666 (time 1781230536.16 total 40.02 last 18.27)
 - mkdir 826 (time 1781230546.19 total 50.06 last 15.95)
 - mkdir 985 (time 1781230556.23 total 60.10 last 15.84)
total: 1000 mkdir in 61.36 seconds: 16.30 ops/second
 - mkdir 160 (time 1781230506.57 total 10.05 last 15.93)
 - mkdir 321 (time 1781230516.63 total 20.11 last 16.00)
 - mkdir 485 (time 1781230526.68 total 30.16 last 16.31)
 - mkdir 677 (time 1781230536.69 total 40.17 last 19.19)
 - mkdir 837 (time 1781230546.69 total 50.17 last 15.99)
 - mkdir 991 (time 1781230556.70 total 60.18 last 15.39)
total: 1000 mkdir in 61.04 seconds: 16.38 ops/second
 - mkdir 150 (time 1781230506.05 total 10.01 last 14.99)
 - mkdir 301 (time 1781230516.09 total 20.05 last 15.04)
 - mkdir 464 (time 1781230526.10 total 30.06 last 16.27)
 - mkdir 650 (time 1781230536.16 total 40.12 last 18.49)
 - mkdir 809 (time 1781230546.20 total 50.16 last 15.85)
 - mkdir 962 (time 1781230556.24 total 60.20 last 15.23)
total: 1000 mkdir in 63.63 seconds: 15.71 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.39 seconds: 25.62 ops/second
 - mkdir 153 (time 1781231087.72 total 10.04 last 15.24)
 - mkdir 312 (time 1781231097.73 total 20.05 last 15.88)
 - mkdir 445 (time 1781231107.75 total 30.07 last 13.27)
 - mkdir 574 (time 1781231117.82 total 40.14 last 12.81)
 - mkdir 697 (time 1781231127.84 total 50.17 last 12.27)
 - mkdir 815 (time 1781231137.99 total 60.31 last 11.63)
 - mkdir 951 (time 1781231148.00 total 70.33 last 13.58)
total: 1000 mkdir in 74.21 seconds: 13.48 ops/second
 - mkdir 153 (time 1781231087.23 total 10.01 last 15.28)
 - mkdir 305 (time 1781231097.29 total 20.07 last 15.11)
 - mkdir 436 (time 1781231107.29 total 30.08 last 13.09)
 - mkdir 564 (time 1781231117.34 total 40.12 last 12.74)
 - mkdir 686 (time 1781231127.35 total 50.13 last 12.19)
 - mkdir 800 (time 1781231137.35 total 60.13 last 11.40)
 - mkdir 927 (time 1781231147.37 total 70.16 last 12.67)
total: 1000 mkdir in 76.95 seconds: 13.00 ops/second
 - mkdir 151 (time 1781231087.29 total 10.06 last 15.01)
 - mkdir 308 (time 1781231097.35 total 20.11 last 15.62)
 - mkdir 440 (time 1781231107.40 total 30.17 last 13.13)
 - mkdir 569 (time 1781231117.44 total 40.21 last 12.84)
 - mkdir 690 (time 1781231127.48 total 50.24 last 12.06)
 - mkdir 802 (time 1781231137.55 total 60.31 last 11.12)
 - mkdir 927 (time 1781231147.57 total 70.33 last 12.48)
total: 1000 mkdir in 77.17 seconds: 12.96 ops/second
 - mkdir 158 (time 1781231087.72 total 10.11 last 15.64)
 - mkdir 314 (time 1781231097.78 total 20.16 last 15.51)
 - mkdir 438 (time 1781231107.79 total 30.18 last 12.39)
 - mkdir 567 (time 1781231117.92 total 40.30 last 12.74)
 - mkdir 684 (time 1781231127.98 total 50.36 last 11.63)
 - mkdir 795 (time 1781231138.09 total 60.47 last 10.98)
 - mkdir 931 (time 1781231148.12 total 70.50 last 13.56)
total: 1000 mkdir in 77.77 seconds: 12.86 ops/second
 - mkdir 150 (time 1781231087.58 total 10.01 last 14.98)
 - mkdir 306 (time 1781231097.60 total 20.03 last 15.57)
 - mkdir 435 (time 1781231107.64 total 30.07 last 12.85)
 - mkdir 560 (time 1781231117.71 total 40.14 last 12.42)
 - mkdir 679 (time 1781231127.84 total 50.27 last 11.74)
 - mkdir 793 (time 1781231137.95 total 60.38 last 11.28)
 - mkdir 926 (time 1781231147.98 total 70.41 last 13.25)
total: 1000 mkdir in 79.10 seconds: 12.64 ops/second
 - mkdir 145 (time 1781231086.00 total 10.08 last 14.39)
 - mkdir 294 (time 1781231096.01 total 20.09 last 14.89)
 - mkdir 423 (time 1781231106.03 total 30.11 last 12.87)
 - mkdir 543 (time 1781231116.05 total 40.13 last 11.97)
 - mkdir 665 (time 1781231126.12 total 50.20 last 12.11)
 - mkdir 770 (time 1781231136.22 total 60.30 last 10.40)
 - mkdir 901 (time 1781231146.23 total 70.31 last 13.09)
 - mkdir 997 (time 1781231156.51 total 80.59 last 9.34)
total: 1000 mkdir in 80.96 seconds: 12.35 ops/second
 - mkdir 155 (time 1781231087.46 total 10.02 last 15.47)
 - mkdir 310 (time 1781231097.48 total 20.03 last 15.48)
 - mkdir 433 (time 1781231107.49 total 30.05 last 12.28)
 - mkdir 560 (time 1781231117.56 total 40.11 last 12.62)
 - mkdir 678 (time 1781231127.60 total 50.15 last 11.75)
 - mkdir 795 (time 1781231137.76 total 60.31 last 11.52)
 - mkdir 924 (time 1781231147.82 total 70.37 last 12.83)
total: 1000 mkdir in 79.87 seconds: 12.52 ops/second
 - mkdir 146 (time 1781231086.82 total 10.01 last 14.59)
 - mkdir 299 (time 1781231096.84 total 20.03 last 15.27)
 - mkdir 428 (time 1781231106.89 total 30.07 last 12.84)
 - mkdir 558 (time 1781231116.91 total 40.09 last 12.97)
 - mkdir 673 (time 1781231126.91 total 50.10 last 11.50)
 - mkdir 779 (time 1781231136.92 total 60.10 last 10.59)
 - mkdir 906 (time 1781231147.01 total 70.20 last 12.58)
 - mkdir 995 (time 1781231157.08 total 80.27 last 8.84)
total: 1000 mkdir in 80.93 seconds: 12.36 ops/second
 - mkdir 148 (time 1781231087.02 total 10.03 last 14.75)
 - mkdir 294 (time 1781231097.04 total 20.05 last 14.57)
 - mkdir 417 (time 1781231107.08 total 30.09 last 12.25)
 - mkdir 543 (time 1781231117.15 total 40.16 last 12.51)
 - mkdir 660 (time 1781231127.24 total 50.25 last 11.60)
 - mkdir 769 (time 1781231137.24 total 60.25 last 10.90)
 - mkdir 892 (time 1781231147.29 total 70.31 last 12.23)
 - mkdir 982 (time 1781231157.50 total 80.52 last 8.82)
total: 1000 mkdir in 82.46 seconds: 12.13 ops/second
 - mkdir 143 (time 1781231086.68 total 10.08 last 14.19)
 - mkdir 287 (time 1781231096.72 total 20.12 last 14.34)
 - mkdir 406 (time 1781231106.74 total 30.14 last 11.87)
 - mkdir 526 (time 1781231116.81 total 40.21 last 11.92)
 - mkdir 642 (time 1781231126.91 total 50.31 last 11.49)
 - mkdir 746 (time 1781231136.95 total 60.35 last 10.35)
 - mkdir 870 (time 1781231146.96 total 70.36 last 12.39)
 - mkdir 956 (time 1781231157.08 total 80.48 last 8.49)
total: 1000 mkdir in 84.48 seconds: 11.84 ops/second
Time for file creation 94 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781231168 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231170 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1781231170 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231171 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1781231171 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231171 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231172 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1781231172 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231172 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1781231172 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
Time for file removal 50 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8