== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:47:16 (1787867236)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.40 seconds: 24.94 ops/second
 - mkdir 165 (time 1787867257.79 total 10.02 last 16.46)
 - mkdir 336 (time 1787867267.83 total 20.07 last 17.02)
 - mkdir 516 (time 1787867277.84 total 30.07 last 17.99)
 - mkdir 706 (time 1787867287.88 total 40.12 last 18.92)
 - mkdir 874 (time 1787867297.92 total 50.16 last 16.73)
total: 1000 mkdir in 58.48 seconds: 17.10 ops/second
 - mkdir 159 (time 1787867257.26 total 10.02 last 15.86)
 - mkdir 322 (time 1787867267.29 total 20.06 last 16.25)
 - mkdir 499 (time 1787867277.30 total 30.07 last 17.69)
 - mkdir 686 (time 1787867287.36 total 40.13 last 18.59)
 - mkdir 856 (time 1787867297.43 total 50.20 last 16.87)
total: 1000 mkdir in 59.75 seconds: 16.74 ops/second
 - mkdir 161 (time 1787867257.53 total 10.03 last 16.05)
 - mkdir 324 (time 1787867267.59 total 20.08 last 16.21)
 - mkdir 501 (time 1787867277.61 total 30.10 last 17.66)
 - mkdir 679 (time 1787867287.65 total 40.14 last 17.73)
 - mkdir 844 (time 1787867297.66 total 50.15 last 16.48)
 - mkdir 993 (time 1787867307.79 total 60.29 last 14.70)
total: 1000 mkdir in 60.83 seconds: 16.44 ops/second
 - mkdir 158 (time 1787867256.58 total 10.01 last 15.79)
 - mkdir 319 (time 1787867266.63 total 20.06 last 16.02)
 - mkdir 487 (time 1787867276.64 total 30.07 last 16.78)
 - mkdir 669 (time 1787867286.65 total 40.08 last 18.18)
 - mkdir 833 (time 1787867296.67 total 50.10 last 16.37)
 - mkdir 979 (time 1787867306.75 total 60.18 last 14.48)
total: 1000 mkdir in 62.39 seconds: 16.03 ops/second
 - mkdir 160 (time 1787867257.95 total 10.04 last 15.93)
 - mkdir 322 (time 1787867268.01 total 20.11 last 16.10)
 - mkdir 496 (time 1787867278.04 total 30.14 last 17.35)
 - mkdir 683 (time 1787867288.10 total 40.20 last 18.60)
 - mkdir 852 (time 1787867298.16 total 50.25 last 16.80)
 - mkdir 992 (time 1787867308.22 total 60.32 last 13.91)
total: 1000 mkdir in 61.20 seconds: 16.34 ops/second
 - mkdir 152 (time 1787867257.62 total 10.03 last 15.16)
 - mkdir 315 (time 1787867267.64 total 20.04 last 16.27)
 - mkdir 491 (time 1787867277.69 total 30.10 last 17.51)
 - mkdir 674 (time 1787867287.71 total 40.12 last 18.26)
 - mkdir 838 (time 1787867297.73 total 50.13 last 16.38)
 - mkdir 985 (time 1787867307.82 total 60.22 last 14.57)
total: 1000 mkdir in 61.81 seconds: 16.18 ops/second
 - mkdir 155 (time 1787867256.47 total 10.01 last 15.49)
 - mkdir 313 (time 1787867266.48 total 20.02 last 15.78)
 - mkdir 482 (time 1787867276.52 total 30.06 last 16.82)
 - mkdir 664 (time 1787867286.59 total 40.13 last 18.08)
 - mkdir 824 (time 1787867296.60 total 50.14 last 15.98)
 - mkdir 973 (time 1787867306.72 total 60.26 last 14.72)
total: 1000 mkdir in 63.00 seconds: 15.87 ops/second
 - mkdir 153 (time 1787867257.68 total 10.08 last 15.18)
 - mkdir 321 (time 1787867267.70 total 20.10 last 16.76)
 - mkdir 495 (time 1787867277.73 total 30.13 last 17.35)
 - mkdir 674 (time 1787867287.75 total 40.15 last 17.85)
 - mkdir 837 (time 1787867297.88 total 50.28 last 16.09)
 - mkdir 980 (time 1787867307.98 total 60.38 last 14.16)
total: 1000 mkdir in 62.12 seconds: 16.10 ops/second
 - mkdir 151 (time 1787867256.29 total 10.02 last 15.07)
 - mkdir 307 (time 1787867266.37 total 20.10 last 15.48)
 - mkdir 476 (time 1787867276.42 total 30.15 last 16.81)
 - mkdir 655 (time 1787867286.42 total 40.15 last 17.90)
 - mkdir 819 (time 1787867296.42 total 50.15 last 16.40)
 - mkdir 970 (time 1787867306.51 total 60.23 last 14.98)
total: 1000 mkdir in 63.52 seconds: 15.74 ops/second
 - mkdir 149 (time 1787867256.77 total 10.04 last 14.84)
 - mkdir 301 (time 1787867266.82 total 20.09 last 15.13)
 - mkdir 465 (time 1787867276.87 total 30.14 last 16.31)
 - mkdir 635 (time 1787867286.89 total 40.16 last 16.96)
 - mkdir 793 (time 1787867296.92 total 50.19 last 15.75)
 - mkdir 933 (time 1787867306.97 total 60.24 last 13.93)
total: 1000 mkdir in 65.38 seconds: 15.30 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 20.19 ops/second
 - mkdir 155 (time 1787867844.24 total 10.00 last 15.50)
 - mkdir 323 (time 1787867854.33 total 20.09 last 16.65)
 - mkdir 497 (time 1787867864.39 total 30.16 last 17.29)
 - mkdir 658 (time 1787867874.40 total 40.16 last 16.09)
 - mkdir 804 (time 1787867884.60 total 50.37 last 14.31)
 - mkdir 922 (time 1787867894.63 total 60.39 last 11.78)
total: 1000 mkdir in 65.46 seconds: 15.28 ops/second
 - mkdir 148 (time 1787867842.89 total 10.01 last 14.79)
 - mkdir 313 (time 1787867852.92 total 20.03 last 16.46)
 - mkdir 473 (time 1787867862.95 total 30.06 last 15.95)
 - mkdir 639 (time 1787867872.98 total 40.10 last 16.54)
 - mkdir 794 (time 1787867883.12 total 50.23 last 15.30)
 - mkdir 902 (time 1787867893.19 total 60.30 last 10.72)
total: 1000 mkdir in 67.37 seconds: 14.84 ops/second
 - mkdir 148 (time 1787867843.11 total 10.04 last 14.74)
 - mkdir 312 (time 1787867853.16 total 20.09 last 16.32)
 - mkdir 478 (time 1787867863.16 total 30.09 last 16.59)
 - mkdir 633 (time 1787867873.25 total 40.18 last 15.37)
 - mkdir 789 (time 1787867883.30 total 50.22 last 15.53)
 - mkdir 900 (time 1787867893.34 total 60.27 last 11.05)
total: 1000 mkdir in 67.51 seconds: 14.81 ops/second
 - mkdir 141 (time 1787867842.89 total 10.01 last 14.08)
 - mkdir 307 (time 1787867852.91 total 20.03 last 16.57)
 - mkdir 469 (time 1787867862.92 total 30.04 last 16.18)
 - mkdir 629 (time 1787867872.95 total 40.08 last 15.95)
 - mkdir 780 (time 1787867882.97 total 50.09 last 15.07)
 - mkdir 884 (time 1787867892.97 total 60.09 last 10.40)
total: 1000 mkdir in 68.88 seconds: 14.52 ops/second
 - mkdir 151 (time 1787867843.73 total 10.01 last 15.09)
 - mkdir 312 (time 1787867853.74 total 20.02 last 16.07)
 - mkdir 479 (time 1787867863.76 total 30.04 last 16.67)
 - mkdir 635 (time 1787867873.79 total 40.07 last 15.56)
 - mkdir 785 (time 1787867883.85 total 50.14 last 14.90)
 - mkdir 895 (time 1787867893.88 total 60.16 last 10.97)
total: 1000 mkdir in 69.39 seconds: 14.41 ops/second
 - mkdir 145 (time 1787867843.32 total 10.07 last 14.40)
 - mkdir 307 (time 1787867853.37 total 20.12 last 16.11)
 - mkdir 476 (time 1787867863.44 total 30.19 last 16.79)
 - mkdir 632 (time 1787867873.48 total 40.23 last 15.53)
 - mkdir 782 (time 1787867883.57 total 50.32 last 14.86)
 - mkdir 890 (time 1787867893.61 total 60.36 last 10.76)
total: 1000 mkdir in 70.29 seconds: 14.23 ops/second
 - mkdir 151 (time 1787867843.93 total 10.05 last 15.02)
 - mkdir 311 (time 1787867853.99 total 20.11 last 15.90)
 - mkdir 481 (time 1787867864.05 total 30.17 last 16.91)
 - mkdir 640 (time 1787867874.06 total 40.18 last 15.88)
 - mkdir 781 (time 1787867884.06 total 50.18 last 14.09)
 - mkdir 888 (time 1787867894.09 total 60.21 last 10.67)
 - mkdir 997 (time 1787867904.15 total 70.27 last 10.84)
total: 1000 mkdir in 70.45 seconds: 14.19 ops/second
 - mkdir 150 (time 1787867844.15 total 10.03 last 14.96)
 - mkdir 305 (time 1787867854.18 total 20.06 last 15.46)
 - mkdir 471 (time 1787867864.23 total 30.11 last 16.52)
 - mkdir 629 (time 1787867874.26 total 40.13 last 15.76)
 - mkdir 765 (time 1787867884.27 total 50.14 last 13.59)
 - mkdir 872 (time 1787867894.32 total 60.19 last 10.64)
 - mkdir 976 (time 1787867904.39 total 70.26 last 10.33)
total: 1000 mkdir in 73.09 seconds: 13.68 ops/second
 - mkdir 143 (time 1787867843.40 total 10.02 last 14.27)
 - mkdir 293 (time 1787867853.47 total 20.09 last 14.90)
 - mkdir 454 (time 1787867863.48 total 30.09 last 16.09)
 - mkdir 605 (time 1787867873.48 total 40.10 last 15.09)
 - mkdir 751 (time 1787867883.57 total 50.19 last 14.47)
 - mkdir 858 (time 1787867893.59 total 60.21 last 10.68)
 - mkdir 969 (time 1787867903.78 total 70.39 last 10.90)
total: 1000 mkdir in 74.13 seconds: 13.49 ops/second
 - mkdir 142 (time 1787867843.66 total 10.04 last 14.15)
 - mkdir 296 (time 1787867853.71 total 20.08 last 15.33)
 - mkdir 455 (time 1787867863.76 total 30.13 last 15.82)
 - mkdir 600 (time 1787867873.76 total 40.14 last 14.49)
 - mkdir 737 (time 1787867883.84 total 50.22 last 13.59)
 - mkdir 839 (time 1787867893.88 total 60.26 last 10.16)
 - mkdir 949 (time 1787867903.96 total 70.34 last 10.91)
total: 1000 mkdir in 75.23 seconds: 13.29 ops/second
Time for file creation 85 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787867918 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867918 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867918 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787867919 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 47 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8