== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 10:18:01 (1787408281)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.06 ops/second
 - mkdir 189 (time 1787408301.03 total 10.03 last 18.85)
 - mkdir 342 (time 1787408311.10 total 20.09 last 15.20)
 - mkdir 535 (time 1787408321.11 total 30.10 last 19.29)
 - mkdir 722 (time 1787408331.16 total 40.15 last 18.60)
 - mkdir 922 (time 1787408341.19 total 50.18 last 19.94)
total: 1000 mkdir in 54.49 seconds: 18.35 ops/second
 - mkdir 194 (time 1787408301.04 total 10.00 last 19.40)
 - mkdir 343 (time 1787408311.10 total 20.07 last 14.80)
 - mkdir 535 (time 1787408321.12 total 30.08 last 19.17)
 - mkdir 723 (time 1787408331.14 total 40.10 last 18.76)
 - mkdir 924 (time 1787408341.17 total 50.13 last 20.05)
total: 1000 mkdir in 54.78 seconds: 18.25 ops/second
 - mkdir 190 (time 1787408300.33 total 10.04 last 18.92)
 - mkdir 340 (time 1787408310.35 total 20.07 last 14.96)
 - mkdir 524 (time 1787408320.41 total 30.13 last 18.29)
 - mkdir 707 (time 1787408330.42 total 40.14 last 18.28)
 - mkdir 903 (time 1787408340.43 total 50.14 last 19.59)
total: 1000 mkdir in 55.69 seconds: 17.96 ops/second
 - mkdir 200 (time 1787408301.76 total 10.06 last 19.89)
 - mkdir 358 (time 1787408311.80 total 20.10 last 15.73)
 - mkdir 553 (time 1787408321.81 total 30.10 last 19.49)
 - mkdir 735 (time 1787408331.81 total 40.10 last 18.20)
 - mkdir 929 (time 1787408341.88 total 50.17 last 19.26)
total: 1000 mkdir in 54.40 seconds: 18.38 ops/second
 - mkdir 188 (time 1787408301.09 total 10.02 last 18.76)
 - mkdir 339 (time 1787408311.12 total 20.05 last 15.06)
 - mkdir 532 (time 1787408321.12 total 30.06 last 19.29)
 - mkdir 722 (time 1787408331.23 total 40.16 last 18.81)
 - mkdir 920 (time 1787408341.27 total 50.20 last 19.71)
total: 1000 mkdir in 55.33 seconds: 18.07 ops/second
 - mkdir 187 (time 1787408300.97 total 10.06 last 18.59)
 - mkdir 337 (time 1787408311.02 total 20.10 last 14.94)
 - mkdir 530 (time 1787408321.02 total 30.10 last 19.30)
 - mkdir 716 (time 1787408331.05 total 40.14 last 18.53)
 - mkdir 912 (time 1787408341.08 total 50.17 last 19.55)
total: 1000 mkdir in 55.69 seconds: 17.96 ops/second
 - mkdir 191 (time 1787408301.64 total 10.06 last 18.99)
 - mkdir 344 (time 1787408311.65 total 20.08 last 15.27)
 - mkdir 539 (time 1787408321.68 total 30.11 last 19.45)
 - mkdir 723 (time 1787408331.74 total 40.16 last 18.30)
 - mkdir 922 (time 1787408341.79 total 50.22 last 19.78)
total: 1000 mkdir in 55.54 seconds: 18.01 ops/second
 - mkdir 190 (time 1787408301.48 total 10.07 last 18.86)
 - mkdir 341 (time 1787408311.50 total 20.09 last 15.07)
 - mkdir 531 (time 1787408321.51 total 30.11 last 18.97)
 - mkdir 710 (time 1787408331.55 total 40.14 last 17.84)
 - mkdir 903 (time 1787408341.56 total 50.15 last 19.28)
total: 1000 mkdir in 56.76 seconds: 17.62 ops/second
 - mkdir 182 (time 1787408301.60 total 10.03 last 18.15)
 - mkdir 331 (time 1787408311.65 total 20.07 last 14.83)
 - mkdir 515 (time 1787408321.65 total 30.08 last 18.39)
 - mkdir 705 (time 1787408331.70 total 40.13 last 18.91)
 - mkdir 901 (time 1787408341.73 total 50.16 last 19.54)
total: 1000 mkdir in 56.97 seconds: 17.55 ops/second
 - mkdir 177 (time 1787408301.06 total 10.07 last 17.58)
 - mkdir 323 (time 1787408311.13 total 20.14 last 14.50)
 - mkdir 504 (time 1787408321.15 total 30.17 last 18.05)
 - mkdir 691 (time 1787408331.19 total 40.21 last 18.63)
 - mkdir 891 (time 1787408341.24 total 50.25 last 19.92)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
Time for file creation 67 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.41 seconds: 24.13 ops/second
 - mkdir 200 (time 1787408826.38 total 10.03 last 19.94)
 - mkdir 443 (time 1787408836.39 total 20.04 last 24.27)
 - mkdir 674 (time 1787408846.41 total 30.05 last 23.07)
 - mkdir 908 (time 1787408856.42 total 40.07 last 23.36)
total: 1000 mkdir in 43.98 seconds: 22.74 ops/second
 - mkdir 200 (time 1787408826.32 total 10.02 last 19.97)
 - mkdir 445 (time 1787408836.33 total 20.02 last 24.48)
 - mkdir 674 (time 1787408846.34 total 30.04 last 22.87)
 - mkdir 911 (time 1787408856.37 total 40.06 last 23.64)
total: 1000 mkdir in 44.03 seconds: 22.71 ops/second
 - mkdir 206 (time 1787408826.57 total 10.03 last 20.54)
 - mkdir 448 (time 1787408836.59 total 20.05 last 24.15)
 - mkdir 677 (time 1787408846.61 total 30.07 last 22.86)
 - mkdir 911 (time 1787408856.66 total 40.12 last 23.28)
total: 1000 mkdir in 44.35 seconds: 22.55 ops/second
 - mkdir 199 (time 1787408826.62 total 10.03 last 19.83)
 - mkdir 443 (time 1787408836.62 total 20.04 last 24.39)
 - mkdir 674 (time 1787408846.64 total 30.05 last 23.07)
 - mkdir 902 (time 1787408856.69 total 40.10 last 22.69)
total: 1000 mkdir in 45.03 seconds: 22.21 ops/second
 - mkdir 202 (time 1787408827.01 total 10.01 last 20.19)
 - mkdir 444 (time 1787408837.04 total 20.03 last 24.14)
 - mkdir 672 (time 1787408847.09 total 30.08 last 22.68)
 - mkdir 910 (time 1787408857.10 total 40.10 last 23.77)
total: 1000 mkdir in 44.86 seconds: 22.29 ops/second
 - mkdir 198 (time 1787408826.74 total 10.01 last 19.77)
 - mkdir 437 (time 1787408836.77 total 20.05 last 23.82)
 - mkdir 659 (time 1787408846.83 total 30.10 last 22.07)
 - mkdir 899 (time 1787408856.89 total 40.16 last 23.87)
total: 1000 mkdir in 45.66 seconds: 21.90 ops/second
 - mkdir 186 (time 1787408826.07 total 10.04 last 18.53)
 - mkdir 426 (time 1787408836.08 total 20.05 last 23.98)
 - mkdir 651 (time 1787408846.12 total 30.08 last 22.42)
 - mkdir 878 (time 1787408856.14 total 40.11 last 22.65)
total: 1000 mkdir in 46.38 seconds: 21.56 ops/second
 - mkdir 183 (time 1787408825.19 total 10.03 last 18.25)
 - mkdir 415 (time 1787408835.26 total 20.10 last 23.04)
 - mkdir 625 (time 1787408845.30 total 30.14 last 20.91)
 - mkdir 857 (time 1787408855.34 total 40.18 last 23.12)
total: 1000 mkdir in 47.84 seconds: 20.90 ops/second
 - mkdir 197 (time 1787408826.88 total 10.00 last 19.69)
 - mkdir 434 (time 1787408836.91 total 20.04 last 23.61)
 - mkdir 657 (time 1787408846.95 total 30.08 last 22.22)
 - mkdir 887 (time 1787408856.98 total 40.11 last 22.92)
total: 1000 mkdir in 46.52 seconds: 21.50 ops/second
 - mkdir 195 (time 1787408826.72 total 10.02 last 19.45)
 - mkdir 424 (time 1787408836.75 total 20.06 last 22.83)
 - mkdir 641 (time 1787408846.77 total 30.07 last 21.66)
 - mkdir 878 (time 1787408856.79 total 40.10 last 23.65)
total: 1000 mkdir in 46.94 seconds: 21.30 ops/second
Time for file creation 55 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787408868 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1787408869 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1787408869 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1787408869 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787408870 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
Time for file removal 34 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8