== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 05:28:39 (1790760519)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.13 ops/second
 - mkdir 214 (time 1790760539.03 total 10.00 last 21.39)
 - mkdir 408 (time 1790760549.05 total 20.02 last 19.37)
 - mkdir 610 (time 1790760559.08 total 30.05 last 20.13)
 - mkdir 779 (time 1790760569.12 total 40.09 last 16.84)
 - mkdir 956 (time 1790760579.13 total 50.10 last 17.68)
total: 1000 mkdir in 53.23 seconds: 18.79 ops/second
 - mkdir 210 (time 1790760539.41 total 10.06 last 20.87)
 - mkdir 395 (time 1790760549.44 total 20.09 last 18.46)
 - mkdir 592 (time 1790760559.46 total 30.11 last 19.66)
 - mkdir 765 (time 1790760569.50 total 40.15 last 17.23)
 - mkdir 940 (time 1790760579.53 total 50.18 last 17.44)
total: 1000 mkdir in 55.97 seconds: 17.87 ops/second
 - mkdir 213 (time 1790760539.52 total 10.00 last 21.29)
 - mkdir 397 (time 1790760549.52 total 20.01 last 18.39)
 - mkdir 593 (time 1790760559.56 total 30.04 last 19.53)
 - mkdir 762 (time 1790760569.58 total 40.06 last 16.87)
 - mkdir 940 (time 1790760579.60 total 50.09 last 17.76)
total: 1000 mkdir in 56.06 seconds: 17.84 ops/second
 - mkdir 213 (time 1790760539.20 total 10.03 last 21.23)
 - mkdir 399 (time 1790760549.21 total 20.04 last 18.58)
 - mkdir 590 (time 1790760559.22 total 30.05 last 19.09)
 - mkdir 759 (time 1790760569.27 total 40.10 last 16.82)
 - mkdir 930 (time 1790760579.32 total 50.15 last 17.01)
total: 1000 mkdir in 56.94 seconds: 17.56 ops/second
 - mkdir 212 (time 1790760538.64 total 10.04 last 21.11)
 - mkdir 397 (time 1790760548.68 total 20.08 last 18.43)
 - mkdir 585 (time 1790760558.76 total 30.16 last 18.65)
 - mkdir 751 (time 1790760568.79 total 40.19 last 16.55)
 - mkdir 925 (time 1790760578.83 total 50.23 last 17.34)
total: 1000 mkdir in 57.51 seconds: 17.39 ops/second
 - mkdir 221 (time 1790760539.40 total 10.04 last 22.02)
 - mkdir 401 (time 1790760549.41 total 20.05 last 17.98)
 - mkdir 595 (time 1790760559.44 total 30.08 last 19.33)
 - mkdir 762 (time 1790760569.49 total 40.12 last 16.62)
 - mkdir 932 (time 1790760579.53 total 50.16 last 16.94)
total: 1000 mkdir in 56.85 seconds: 17.59 ops/second
 - mkdir 220 (time 1790760539.49 total 10.02 last 21.95)
 - mkdir 399 (time 1790760549.54 total 20.07 last 17.82)
 - mkdir 590 (time 1790760559.58 total 30.11 last 19.02)
 - mkdir 761 (time 1790760569.59 total 40.12 last 17.09)
 - mkdir 935 (time 1790760579.63 total 50.16 last 17.33)
total: 1000 mkdir in 56.82 seconds: 17.60 ops/second
 - mkdir 210 (time 1790760539.20 total 10.00 last 21.00)
 - mkdir 393 (time 1790760549.21 total 20.01 last 18.28)
 - mkdir 591 (time 1790760559.25 total 30.05 last 19.73)
 - mkdir 758 (time 1790760569.29 total 40.08 last 16.64)
 - mkdir 925 (time 1790760579.34 total 50.14 last 16.61)
total: 1000 mkdir in 57.86 seconds: 17.28 ops/second
 - mkdir 208 (time 1790760539.33 total 10.07 last 20.65)
 - mkdir 391 (time 1790760549.40 total 20.14 last 18.17)
 - mkdir 580 (time 1790760559.44 total 30.19 last 18.81)
 - mkdir 752 (time 1790760569.48 total 40.22 last 17.15)
 - mkdir 917 (time 1790760579.53 total 50.27 last 16.42)
total: 1000 mkdir in 58.71 seconds: 17.03 ops/second
 - mkdir 202 (time 1790760538.64 total 10.03 last 20.14)
 - mkdir 385 (time 1790760548.66 total 20.06 last 18.26)
 - mkdir 573 (time 1790760558.74 total 30.14 last 18.65)
 - mkdir 733 (time 1790760568.75 total 40.14 last 15.99)
 - mkdir 898 (time 1790760578.76 total 50.15 last 16.49)
total: 1000 mkdir in 60.08 seconds: 16.64 ops/second
Time for file creation 67 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.34 ops/second
 - mkdir 193 (time 1790761107.39 total 10.04 last 19.23)
 - mkdir 402 (time 1790761117.39 total 20.04 last 20.90)
 - mkdir 566 (time 1790761127.44 total 30.08 last 16.33)
 - mkdir 729 (time 1790761137.45 total 40.09 last 16.28)
 - mkdir 905 (time 1790761147.49 total 50.14 last 17.52)
total: 1000 mkdir in 56.00 seconds: 17.86 ops/second
 - mkdir 187 (time 1790761107.11 total 10.01 last 18.68)
 - mkdir 390 (time 1790761117.11 total 20.01 last 20.29)
 - mkdir 552 (time 1790761127.16 total 30.07 last 16.11)
 - mkdir 714 (time 1790761137.17 total 40.07 last 16.19)
 - mkdir 890 (time 1790761147.21 total 50.11 last 17.53)
total: 1000 mkdir in 57.73 seconds: 17.32 ops/second
 - mkdir 200 (time 1790761106.87 total 10.07 last 19.87)
 - mkdir 402 (time 1790761116.90 total 20.10 last 20.14)
 - mkdir 561 (time 1790761126.92 total 30.12 last 15.86)
 - mkdir 719 (time 1790761136.94 total 40.14 last 15.77)
 - mkdir 892 (time 1790761146.99 total 50.19 last 17.22)
total: 1000 mkdir in 58.38 seconds: 17.13 ops/second
 - mkdir 188 (time 1790761106.97 total 10.02 last 18.75)
 - mkdir 393 (time 1790761117.02 total 20.07 last 20.40)
 - mkdir 548 (time 1790761127.07 total 30.12 last 15.43)
 - mkdir 707 (time 1790761137.14 total 40.19 last 15.78)
 - mkdir 886 (time 1790761147.23 total 50.28 last 17.75)
total: 1000 mkdir in 58.61 seconds: 17.06 ops/second
 - mkdir 194 (time 1790761107.23 total 10.04 last 19.32)
 - mkdir 391 (time 1790761117.25 total 20.06 last 19.67)
 - mkdir 550 (time 1790761127.28 total 30.09 last 15.85)
 - mkdir 704 (time 1790761137.36 total 40.17 last 15.27)
 - mkdir 883 (time 1790761147.38 total 50.19 last 17.87)
total: 1000 mkdir in 58.80 seconds: 17.01 ops/second
 - mkdir 191 (time 1790761107.48 total 10.08 last 18.94)
 - mkdir 396 (time 1790761117.49 total 20.09 last 20.49)
 - mkdir 552 (time 1790761127.56 total 30.16 last 15.49)
 - mkdir 711 (time 1790761137.62 total 40.22 last 15.80)
 - mkdir 884 (time 1790761147.63 total 50.23 last 17.28)
total: 1000 mkdir in 59.26 seconds: 16.87 ops/second
 - mkdir 184 (time 1790761106.72 total 10.00 last 18.40)
 - mkdir 383 (time 1790761116.72 total 20.00 last 19.90)
 - mkdir 543 (time 1790761126.77 total 30.05 last 15.93)
 - mkdir 695 (time 1790761136.78 total 40.06 last 15.18)
 - mkdir 865 (time 1790761146.80 total 50.08 last 16.96)
 - mkdir 993 (time 1790761156.95 total 60.23 last 12.62)
total: 1000 mkdir in 61.12 seconds: 16.36 ops/second
 - mkdir 190 (time 1790761107.53 total 10.06 last 18.89)
 - mkdir 395 (time 1790761117.54 total 20.07 last 20.47)
 - mkdir 546 (time 1790761127.56 total 30.09 last 15.07)
 - mkdir 700 (time 1790761137.62 total 40.15 last 15.31)
 - mkdir 875 (time 1790761147.64 total 50.17 last 17.47)
 - mkdir 997 (time 1790761157.83 total 60.36 last 11.97)
total: 1000 mkdir in 60.61 seconds: 16.50 ops/second
 - mkdir 194 (time 1790761107.78 total 10.03 last 19.34)
 - mkdir 396 (time 1790761117.80 total 20.05 last 20.16)
 - mkdir 546 (time 1790761127.83 total 30.08 last 14.96)
 - mkdir 704 (time 1790761137.85 total 40.10 last 15.77)
 - mkdir 873 (time 1790761147.91 total 50.15 last 16.80)
 - mkdir 995 (time 1790761158.00 total 60.25 last 12.09)
total: 1000 mkdir in 60.79 seconds: 16.45 ops/second
 - mkdir 182 (time 1790761106.89 total 10.01 last 18.19)
 - mkdir 381 (time 1790761116.92 total 20.03 last 19.86)
 - mkdir 539 (time 1790761126.92 total 30.04 last 15.79)
 - mkdir 688 (time 1790761136.95 total 40.06 last 14.86)
 - mkdir 857 (time 1790761146.98 total 50.10 last 16.84)
 - mkdir 979 (time 1790761157.03 total 60.14 last 12.14)
total: 1000 mkdir in 62.55 seconds: 15.99 ops/second
Time for file creation 71 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790761169 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1790761170 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790761170 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790761171 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790761171 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8