== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:27:52 (1788640072)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.52 seconds: 19.27 ops/second
 - mkdir 179 (time 1788640091.90 total 10.01 last 17.89)
 - mkdir 369 (time 1788640101.91 total 20.02 last 18.98)
 - mkdir 543 (time 1788640111.92 total 30.02 last 17.39)
 - mkdir 720 (time 1788640121.95 total 40.05 last 17.65)
 - mkdir 885 (time 1788640131.99 total 50.09 last 16.44)
total: 1000 mkdir in 56.35 seconds: 17.75 ops/second
 - mkdir 183 (time 1788640092.72 total 10.02 last 18.27)
 - mkdir 380 (time 1788640102.77 total 20.07 last 19.60)
 - mkdir 548 (time 1788640112.82 total 30.12 last 16.72)
 - mkdir 715 (time 1788640122.86 total 40.15 last 16.64)
 - mkdir 886 (time 1788640132.95 total 50.24 last 16.96)
total: 1000 mkdir in 57.04 seconds: 17.53 ops/second
 - mkdir 185 (time 1788640093.38 total 10.03 last 18.45)
 - mkdir 385 (time 1788640103.44 total 20.08 last 19.89)
 - mkdir 555 (time 1788640113.47 total 30.12 last 16.95)
 - mkdir 724 (time 1788640123.52 total 40.16 last 16.83)
 - mkdir 892 (time 1788640133.56 total 50.20 last 16.73)
total: 1000 mkdir in 56.74 seconds: 17.62 ops/second
 - mkdir 181 (time 1788640093.38 total 10.09 last 17.94)
 - mkdir 375 (time 1788640103.39 total 20.10 last 19.37)
 - mkdir 546 (time 1788640113.50 total 30.21 last 16.92)
 - mkdir 717 (time 1788640123.55 total 40.26 last 17.01)
 - mkdir 885 (time 1788640133.55 total 50.26 last 16.80)
total: 1000 mkdir in 57.05 seconds: 17.53 ops/second
 - mkdir 185 (time 1788640093.47 total 10.01 last 18.48)
 - mkdir 381 (time 1788640103.54 total 20.08 last 19.47)
 - mkdir 546 (time 1788640113.58 total 30.12 last 16.43)
 - mkdir 719 (time 1788640123.60 total 40.14 last 17.27)
 - mkdir 887 (time 1788640133.60 total 50.14 last 16.80)
total: 1000 mkdir in 57.20 seconds: 17.48 ops/second
 - mkdir 182 (time 1788640093.27 total 10.03 last 18.15)
 - mkdir 373 (time 1788640103.34 total 20.09 last 18.97)
 - mkdir 543 (time 1788640113.40 total 30.16 last 16.89)
 - mkdir 710 (time 1788640123.41 total 40.17 last 16.69)
 - mkdir 877 (time 1788640133.43 total 50.19 last 16.67)
total: 1000 mkdir in 57.65 seconds: 17.35 ops/second
 - mkdir 171 (time 1788640093.08 total 10.00 last 17.09)
 - mkdir 368 (time 1788640103.15 total 20.07 last 19.58)
 - mkdir 536 (time 1788640113.17 total 30.09 last 16.76)
 - mkdir 707 (time 1788640123.20 total 40.13 last 17.04)
 - mkdir 874 (time 1788640133.25 total 50.17 last 16.63)
total: 1000 mkdir in 58.06 seconds: 17.23 ops/second
 - mkdir 178 (time 1788640093.65 total 10.04 last 17.73)
 - mkdir 375 (time 1788640103.74 total 20.12 last 19.53)
 - mkdir 542 (time 1788640113.77 total 30.16 last 16.64)
 - mkdir 711 (time 1788640123.81 total 40.20 last 16.83)
 - mkdir 881 (time 1788640133.84 total 50.22 last 16.96)
total: 1000 mkdir in 58.03 seconds: 17.23 ops/second
 - mkdir 171 (time 1788640093.19 total 10.02 last 17.07)
 - mkdir 367 (time 1788640103.23 total 20.06 last 19.52)
 - mkdir 529 (time 1788640113.32 total 30.14 last 16.06)
 - mkdir 692 (time 1788640123.39 total 40.21 last 16.19)
 - mkdir 865 (time 1788640133.40 total 50.22 last 17.28)
total: 1000 mkdir in 59.31 seconds: 16.86 ops/second
 - mkdir 169 (time 1788640093.30 total 10.04 last 16.83)
 - mkdir 357 (time 1788640103.35 total 20.09 last 18.71)
 - mkdir 517 (time 1788640113.40 total 30.14 last 15.92)
 - mkdir 679 (time 1788640123.41 total 40.15 last 16.18)
 - mkdir 846 (time 1788640133.44 total 50.18 last 16.65)
 - mkdir 996 (time 1788640143.49 total 60.23 last 14.93)
total: 1000 mkdir in 60.36 seconds: 16.57 ops/second
Time for file creation 68 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 9 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.47 seconds: 21.38 ops/second
 - mkdir 166 (time 1788640683.56 total 10.03 last 16.56)
 - mkdir 327 (time 1788640693.60 total 20.06 last 16.05)
 - mkdir 455 (time 1788640703.61 total 30.08 last 12.78)
 - mkdir 598 (time 1788640713.64 total 40.10 last 14.27)
 - mkdir 766 (time 1788640723.73 total 50.20 last 16.64)
 - mkdir 943 (time 1788640733.75 total 60.21 last 17.67)
total: 1000 mkdir in 63.80 seconds: 15.67 ops/second
 - mkdir 162 (time 1788640682.92 total 10.04 last 16.13)
 - mkdir 320 (time 1788640692.96 total 20.09 last 15.73)
 - mkdir 447 (time 1788640703.07 total 30.20 last 12.56)
 - mkdir 583 (time 1788640713.11 total 40.24 last 13.55)
 - mkdir 742 (time 1788640723.13 total 50.25 last 15.88)
 - mkdir 911 (time 1788640733.13 total 60.25 last 16.90)
total: 1000 mkdir in 67.62 seconds: 14.79 ops/second
 - mkdir 160 (time 1788640684.22 total 10.05 last 15.92)
 - mkdir 310 (time 1788640694.25 total 20.08 last 14.95)
 - mkdir 444 (time 1788640704.26 total 30.09 last 13.39)
 - mkdir 584 (time 1788640714.27 total 40.10 last 13.98)
 - mkdir 751 (time 1788640724.34 total 50.17 last 16.60)
 - mkdir 920 (time 1788640734.37 total 60.20 last 16.85)
total: 1000 mkdir in 67.16 seconds: 14.89 ops/second
 - mkdir 164 (time 1788640684.15 total 10.03 last 16.35)
 - mkdir 318 (time 1788640694.24 total 20.13 last 15.25)
 - mkdir 445 (time 1788640704.26 total 30.14 last 12.68)
 - mkdir 577 (time 1788640714.34 total 40.22 last 13.10)
 - mkdir 742 (time 1788640724.36 total 50.24 last 16.47)
 - mkdir 908 (time 1788640734.40 total 60.29 last 16.52)
total: 1000 mkdir in 68.61 seconds: 14.58 ops/second
 - mkdir 163 (time 1788640684.47 total 10.00 last 16.29)
 - mkdir 314 (time 1788640694.50 total 20.04 last 15.05)
 - mkdir 443 (time 1788640704.52 total 30.06 last 12.87)
 - mkdir 583 (time 1788640714.54 total 40.08 last 13.97)
 - mkdir 749 (time 1788640724.54 total 50.08 last 16.59)
 - mkdir 915 (time 1788640734.57 total 60.11 last 16.56)
total: 1000 mkdir in 68.32 seconds: 14.64 ops/second
 - mkdir 150 (time 1788640683.75 total 10.02 last 14.97)
 - mkdir 304 (time 1788640693.77 total 20.04 last 15.36)
 - mkdir 433 (time 1788640703.81 total 30.08 last 12.86)
 - mkdir 568 (time 1788640713.85 total 40.12 last 13.45)
 - mkdir 726 (time 1788640723.86 total 50.13 last 15.78)
 - mkdir 899 (time 1788640733.92 total 60.19 last 17.19)
total: 1000 mkdir in 69.30 seconds: 14.43 ops/second
 - mkdir 160 (time 1788640684.63 total 10.06 last 15.90)
 - mkdir 304 (time 1788640694.75 total 20.18 last 14.23)
 - mkdir 436 (time 1788640704.77 total 30.20 last 13.18)
 - mkdir 575 (time 1788640714.78 total 40.22 last 13.87)
 - mkdir 740 (time 1788640724.84 total 50.28 last 16.41)
 - mkdir 912 (time 1788640734.89 total 60.32 last 17.12)
total: 1000 mkdir in 68.92 seconds: 14.51 ops/second
 - mkdir 155 (time 1788640683.45 total 10.00 last 15.49)
 - mkdir 300 (time 1788640693.49 total 20.04 last 14.45)
 - mkdir 427 (time 1788640703.52 total 30.07 last 12.66)
 - mkdir 562 (time 1788640713.54 total 40.09 last 13.47)
 - mkdir 723 (time 1788640723.57 total 50.12 last 16.06)
 - mkdir 889 (time 1788640733.62 total 60.17 last 16.51)
 - mkdir 993 (time 1788640743.73 total 70.28 last 10.30)
total: 1000 mkdir in 70.77 seconds: 14.13 ops/second
 - mkdir 152 (time 1788640682.85 total 10.04 last 15.14)
 - mkdir 307 (time 1788640692.95 total 20.14 last 15.34)
 - mkdir 423 (time 1788640702.96 total 30.15 last 11.59)
 - mkdir 551 (time 1788640712.99 total 40.18 last 12.76)
 - mkdir 700 (time 1788640723.07 total 50.26 last 14.78)
 - mkdir 865 (time 1788640733.10 total 60.29 last 16.46)
 - mkdir 972 (time 1788640743.12 total 70.31 last 10.67)
total: 1000 mkdir in 72.85 seconds: 13.73 ops/second
 - mkdir 155 (time 1788640684.55 total 10.03 last 15.45)
 - mkdir 300 (time 1788640694.59 total 20.07 last 14.45)
 - mkdir 424 (time 1788640704.64 total 30.12 last 12.34)
 - mkdir 561 (time 1788640714.64 total 40.12 last 13.69)
 - mkdir 722 (time 1788640724.71 total 50.19 last 16.00)
 - mkdir 890 (time 1788640734.73 total 60.21 last 16.77)
 - mkdir 989 (time 1788640744.77 total 70.26 last 9.85)
total: 1000 mkdir in 71.17 seconds: 14.05 ops/second
Time for file creation 81 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788640754 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640754 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640754 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640755 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640755 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788640755 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788640756 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640755 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788640756 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788640756 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8