== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:37:44 (1786419464)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.65 seconds: 15.33 ops/second
 - mkdir 137 (time 1786419487.92 total 10.02 last 13.67)
 - mkdir 259 (time 1786419497.99 total 20.09 last 12.12)
 - mkdir 411 (time 1786419508.02 total 30.12 last 15.15)
 - mkdir 561 (time 1786419518.05 total 40.15 last 14.96)
 - mkdir 719 (time 1786419528.05 total 50.15 last 15.79)
 - mkdir 880 (time 1786419538.10 total 60.20 last 16.03)
total: 1000 mkdir in 67.57 seconds: 14.80 ops/second
 - mkdir 144 (time 1786419489.49 total 10.02 last 14.37)
 - mkdir 273 (time 1786419499.53 total 20.06 last 12.85)
 - mkdir 432 (time 1786419509.54 total 30.07 last 15.88)
 - mkdir 585 (time 1786419519.60 total 40.14 last 15.20)
 - mkdir 745 (time 1786419529.63 total 50.17 last 15.95)
 - mkdir 898 (time 1786419539.67 total 60.20 last 15.25)
total: 1000 mkdir in 66.11 seconds: 15.13 ops/second
 - mkdir 147 (time 1786419489.08 total 10.43 last 14.09)
 - mkdir 273 (time 1786419499.08 total 20.43 last 12.60)
 - mkdir 422 (time 1786419509.17 total 30.52 last 14.77)
 - mkdir 572 (time 1786419519.31 total 40.66 last 14.79)
 - mkdir 733 (time 1786419529.33 total 50.68 last 16.08)
 - mkdir 890 (time 1786419539.36 total 60.71 last 15.65)
total: 1000 mkdir in 68.74 seconds: 14.55 ops/second
 - mkdir 138 (time 1786419489.06 total 10.05 last 13.72)
 - mkdir 269 (time 1786419499.07 total 20.07 last 13.08)
 - mkdir 416 (time 1786419509.08 total 30.08 last 14.69)
 - mkdir 569 (time 1786419519.23 total 40.23 last 15.07)
 - mkdir 728 (time 1786419529.26 total 50.26 last 15.86)
 - mkdir 884 (time 1786419539.26 total 60.26 last 15.60)
total: 1000 mkdir in 68.70 seconds: 14.56 ops/second
 - mkdir 137 (time 1786419489.09 total 10.13 last 13.53)
 - mkdir 261 (time 1786419499.09 total 20.13 last 12.40)
 - mkdir 408 (time 1786419509.09 total 30.13 last 14.70)
 - mkdir 562 (time 1786419519.23 total 40.27 last 15.18)
 - mkdir 720 (time 1786419529.24 total 50.28 last 15.79)
 - mkdir 879 (time 1786419539.26 total 60.30 last 15.86)
total: 1000 mkdir in 68.80 seconds: 14.54 ops/second
 - mkdir 137 (time 1786419489.04 total 10.09 last 13.58)
 - mkdir 262 (time 1786419499.09 total 20.13 last 12.45)
 - mkdir 412 (time 1786419509.18 total 30.23 last 14.86)
 - mkdir 559 (time 1786419519.31 total 40.36 last 14.51)
 - mkdir 721 (time 1786419529.33 total 50.37 last 16.18)
 - mkdir 880 (time 1786419539.36 total 60.41 last 15.84)
total: 1000 mkdir in 68.82 seconds: 14.53 ops/second
 - mkdir 134 (time 1786419488.01 total 10.03 last 13.37)
 - mkdir 256 (time 1786419498.01 total 20.03 last 12.20)
 - mkdir 406 (time 1786419508.04 total 30.06 last 14.96)
 - mkdir 552 (time 1786419518.11 total 40.13 last 14.50)
 - mkdir 707 (time 1786419528.12 total 50.14 last 15.48)
 - mkdir 864 (time 1786419538.12 total 60.14 last 15.70)
total: 1000 mkdir in 69.99 seconds: 14.29 ops/second
 - mkdir 134 (time 1786419489.55 total 10.01 last 13.39)
 - mkdir 258 (time 1786419499.57 total 20.03 last 12.37)
 - mkdir 411 (time 1786419509.66 total 30.11 last 15.17)
 - mkdir 560 (time 1786419519.72 total 40.18 last 14.80)
 - mkdir 723 (time 1786419529.76 total 50.22 last 16.24)
 - mkdir 873 (time 1786419539.79 total 60.24 last 14.97)
 - mkdir 997 (time 1786419549.82 total 70.28 last 12.35)
total: 1000 mkdir in 70.61 seconds: 14.16 ops/second
 - mkdir 128 (time 1786419488.24 total 10.01 last 12.79)
 - mkdir 245 (time 1786419498.28 total 20.05 last 11.65)
 - mkdir 388 (time 1786419508.31 total 30.08 last 14.26)
 - mkdir 539 (time 1786419518.32 total 40.09 last 15.09)
 - mkdir 697 (time 1786419528.35 total 50.12 last 15.75)
 - mkdir 854 (time 1786419538.40 total 60.17 last 15.62)
 - mkdir 985 (time 1786419548.51 total 70.28 last 12.96)
total: 1000 mkdir in 72.08 seconds: 13.87 ops/second
 - mkdir 125 (time 1786419489.07 total 10.04 last 12.45)
 - mkdir 244 (time 1786419499.11 total 20.08 last 11.85)
 - mkdir 389 (time 1786419509.19 total 30.15 last 14.39)
 - mkdir 539 (time 1786419519.23 total 40.19 last 14.94)
 - mkdir 694 (time 1786419529.25 total 50.22 last 15.46)
 - mkdir 849 (time 1786419539.28 total 60.25 last 15.45)
 - mkdir 970 (time 1786419549.32 total 70.28 last 12.06)
total: 1000 mkdir in 73.76 seconds: 13.56 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.44 seconds: 22.85 ops/second
 - mkdir 144 (time 1786420026.80 total 10.03 last 14.36)
 - mkdir 298 (time 1786420036.83 total 20.06 last 15.35)
 - mkdir 447 (time 1786420046.89 total 30.12 last 14.81)
 - mkdir 594 (time 1786420057.02 total 40.25 last 14.51)
 - mkdir 741 (time 1786420067.05 total 50.28 last 14.66)
 - mkdir 900 (time 1786420077.12 total 60.35 last 15.78)
total: 1000 mkdir in 68.02 seconds: 14.70 ops/second
 - mkdir 164 (time 1786420028.50 total 10.03 last 16.35)
 - mkdir 322 (time 1786420038.54 total 20.08 last 15.73)
 - mkdir 470 (time 1786420048.63 total 30.16 last 14.67)
 - mkdir 626 (time 1786420058.66 total 40.20 last 15.55)
 - mkdir 766 (time 1786420068.67 total 50.20 last 14.00)
 - mkdir 923 (time 1786420078.70 total 60.24 last 15.64)
total: 1000 mkdir in 66.33 seconds: 15.08 ops/second
 - mkdir 148 (time 1786420027.49 total 10.03 last 14.76)
 - mkdir 304 (time 1786420037.51 total 20.04 last 15.57)
 - mkdir 456 (time 1786420047.64 total 30.17 last 15.01)
 - mkdir 604 (time 1786420057.67 total 40.21 last 14.74)
 - mkdir 750 (time 1786420067.71 total 50.24 last 14.55)
 - mkdir 910 (time 1786420077.71 total 60.25 last 16.00)
total: 1000 mkdir in 67.40 seconds: 14.84 ops/second
 - mkdir 144 (time 1786420027.01 total 10.04 last 14.34)
 - mkdir 299 (time 1786420037.02 total 20.06 last 15.47)
 - mkdir 445 (time 1786420047.06 total 30.09 last 14.55)
 - mkdir 594 (time 1786420057.15 total 40.18 last 14.77)
 - mkdir 738 (time 1786420067.17 total 50.21 last 14.36)
 - mkdir 897 (time 1786420077.23 total 60.27 last 15.80)
total: 1000 mkdir in 68.10 seconds: 14.68 ops/second
 - mkdir 151 (time 1786420028.13 total 10.07 last 14.99)
 - mkdir 309 (time 1786420038.18 total 20.12 last 15.72)
 - mkdir 459 (time 1786420048.35 total 30.29 last 14.76)
 - mkdir 613 (time 1786420058.41 total 40.35 last 15.31)
 - mkdir 755 (time 1786420068.52 total 50.46 last 14.05)
 - mkdir 914 (time 1786420078.56 total 60.50 last 15.83)
total: 1000 mkdir in 67.43 seconds: 14.83 ops/second
 - mkdir 156 (time 1786420028.24 total 10.00 last 15.60)
 - mkdir 310 (time 1786420038.27 total 20.03 last 15.35)
 - mkdir 456 (time 1786420048.35 total 30.11 last 14.49)
 - mkdir 613 (time 1786420058.38 total 40.14 last 15.65)
 - mkdir 752 (time 1786420068.50 total 50.27 last 13.73)
 - mkdir 909 (time 1786420078.60 total 60.36 last 15.55)
total: 1000 mkdir in 68.28 seconds: 14.65 ops/second
 - mkdir 156 (time 1786420028.54 total 10.08 last 15.47)
 - mkdir 309 (time 1786420038.56 total 20.10 last 15.27)
 - mkdir 456 (time 1786420048.63 total 30.17 last 14.60)
 - mkdir 615 (time 1786420058.68 total 40.23 last 15.81)
 - mkdir 754 (time 1786420068.72 total 50.26 last 13.85)
 - mkdir 912 (time 1786420078.81 total 60.35 last 15.67)
total: 1000 mkdir in 68.14 seconds: 14.68 ops/second
 - mkdir 149 (time 1786420027.84 total 10.02 last 14.87)
 - mkdir 296 (time 1786420037.87 total 20.06 last 14.65)
 - mkdir 442 (time 1786420047.88 total 30.07 last 14.59)
 - mkdir 587 (time 1786420057.89 total 40.07 last 14.49)
 - mkdir 732 (time 1786420067.97 total 50.15 last 14.38)
 - mkdir 891 (time 1786420078.04 total 60.22 last 15.79)
 - mkdir 999 (time 1786420088.19 total 70.38 last 10.63)
total: 1000 mkdir in 70.38 seconds: 14.21 ops/second
 - mkdir 128 (time 1786420025.82 total 10.05 last 12.73)
 - mkdir 276 (time 1786420035.88 total 20.11 last 14.72)
 - mkdir 426 (time 1786420045.89 total 30.12 last 14.98)
 - mkdir 564 (time 1786420055.89 total 40.12 last 13.79)
 - mkdir 712 (time 1786420065.91 total 50.14 last 14.77)
 - mkdir 865 (time 1786420075.93 total 60.16 last 15.27)
 - mkdir 985 (time 1786420085.96 total 70.19 last 11.97)
total: 1000 mkdir in 72.62 seconds: 13.77 ops/second
 - mkdir 149 (time 1786420028.08 total 10.07 last 14.80)
 - mkdir 291 (time 1786420038.09 total 20.07 last 14.19)
 - mkdir 435 (time 1786420048.09 total 30.08 last 14.39)
 - mkdir 587 (time 1786420058.12 total 40.11 last 15.16)
 - mkdir 732 (time 1786420068.16 total 50.14 last 14.45)
 - mkdir 892 (time 1786420078.21 total 60.20 last 15.91)
 - mkdir 997 (time 1786420088.27 total 70.26 last 10.44)
total: 1000 mkdir in 70.68 seconds: 14.15 ops/second
Time for file creation 83 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786420098 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1786420098 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1786420100 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786420100 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786420100 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786420100 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786420100 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786420100 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786420100 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1786420101 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8