== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:07:08 (1790701628)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.50 seconds: 19.87 ops/second
 - mkdir 204 (time 1790701650.21 total 10.01 last 20.38)
 - mkdir 397 (time 1790701660.26 total 20.06 last 19.20)
 - mkdir 554 (time 1790701670.26 total 30.06 last 15.70)
 - mkdir 686 (time 1790701680.28 total 40.09 last 13.17)
 - mkdir 793 (time 1790701690.32 total 50.12 last 10.66)
 - mkdir 964 (time 1790701700.37 total 60.18 last 17.01)
total: 1000 mkdir in 62.43 seconds: 16.02 ops/second
 - mkdir 196 (time 1790701650.22 total 10.03 last 19.54)
 - mkdir 385 (time 1790701660.24 total 20.05 last 18.87)
 - mkdir 537 (time 1790701670.24 total 30.05 last 15.20)
 - mkdir 671 (time 1790701680.27 total 40.08 last 13.35)
 - mkdir 781 (time 1790701690.36 total 50.17 last 10.90)
 - mkdir 952 (time 1790701700.42 total 60.23 last 17.00)
total: 1000 mkdir in 64.22 seconds: 15.57 ops/second
 - mkdir 197 (time 1790701650.01 total 10.07 last 19.57)
 - mkdir 384 (time 1790701660.04 total 20.10 last 18.64)
 - mkdir 538 (time 1790701670.18 total 30.24 last 15.18)
 - mkdir 668 (time 1790701680.20 total 40.27 last 12.97)
 - mkdir 778 (time 1790701690.22 total 50.28 last 10.99)
 - mkdir 942 (time 1790701700.26 total 60.32 last 16.34)
total: 1000 mkdir in 65.21 seconds: 15.33 ops/second
 - mkdir 199 (time 1790701650.43 total 10.02 last 19.86)
 - mkdir 385 (time 1790701660.44 total 20.03 last 18.58)
 - mkdir 535 (time 1790701670.48 total 30.07 last 14.95)
 - mkdir 669 (time 1790701680.50 total 40.09 last 13.37)
 - mkdir 771 (time 1790701690.57 total 50.16 last 10.13)
 - mkdir 941 (time 1790701700.59 total 60.18 last 16.95)
total: 1000 mkdir in 65.60 seconds: 15.24 ops/second
 - mkdir 207 (time 1790701651.17 total 10.03 last 20.64)
 - mkdir 399 (time 1790701661.19 total 20.05 last 19.15)
 - mkdir 552 (time 1790701671.28 total 30.14 last 15.17)
 - mkdir 682 (time 1790701681.29 total 40.16 last 12.98)
 - mkdir 791 (time 1790701691.38 total 50.24 last 10.81)
 - mkdir 955 (time 1790701701.39 total 60.25 last 16.39)
total: 1000 mkdir in 64.90 seconds: 15.41 ops/second
 - mkdir 198 (time 1790701650.66 total 10.03 last 19.74)
 - mkdir 390 (time 1790701660.70 total 20.08 last 19.11)
 - mkdir 541 (time 1790701670.75 total 30.13 last 15.02)
 - mkdir 673 (time 1790701680.81 total 40.18 last 13.13)
 - mkdir 777 (time 1790701690.90 total 50.27 last 10.30)
 - mkdir 942 (time 1790701700.91 total 60.28 last 16.48)
total: 1000 mkdir in 66.04 seconds: 15.14 ops/second
 - mkdir 205 (time 1790701650.98 total 10.04 last 20.41)
 - mkdir 390 (time 1790701661.00 total 20.07 last 18.46)
 - mkdir 536 (time 1790701671.03 total 30.10 last 14.55)
 - mkdir 667 (time 1790701681.08 total 40.14 last 13.05)
 - mkdir 772 (time 1790701691.12 total 50.18 last 10.46)
 - mkdir 938 (time 1790701701.19 total 60.25 last 16.49)
total: 1000 mkdir in 66.82 seconds: 14.97 ops/second
 - mkdir 203 (time 1790701651.15 total 10.05 last 20.20)
 - mkdir 392 (time 1790701661.23 total 20.13 last 18.74)
 - mkdir 538 (time 1790701671.28 total 30.18 last 14.53)
 - mkdir 668 (time 1790701681.29 total 40.19 last 12.99)
 - mkdir 771 (time 1790701691.31 total 50.21 last 10.28)
 - mkdir 939 (time 1790701701.41 total 60.31 last 16.63)
total: 1000 mkdir in 67.01 seconds: 14.92 ops/second
 - mkdir 195 (time 1790701649.20 total 10.00 last 19.50)
 - mkdir 366 (time 1790701659.21 total 20.01 last 17.09)
 - mkdir 524 (time 1790701669.29 total 30.09 last 15.67)
 - mkdir 646 (time 1790701679.33 total 40.13 last 12.15)
 - mkdir 749 (time 1790701689.53 total 50.33 last 10.10)
 - mkdir 908 (time 1790701699.62 total 60.42 last 15.75)
total: 1000 mkdir in 69.17 seconds: 14.46 ops/second
 - mkdir 187 (time 1790701650.58 total 10.02 last 18.67)
 - mkdir 373 (time 1790701660.66 total 20.10 last 18.45)
 - mkdir 518 (time 1790701670.69 total 30.13 last 14.46)
 - mkdir 642 (time 1790701680.79 total 40.23 last 12.27)
 - mkdir 744 (time 1790701690.89 total 50.33 last 10.10)
 - mkdir 907 (time 1790701700.91 total 60.35 last 16.27)
total: 1000 mkdir in 70.21 seconds: 14.24 ops/second
Time for file creation 81 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.59 seconds: 16.99 ops/second
 - mkdir 164 (time 1790702248.32 total 10.00 last 16.40)
 - mkdir 367 (time 1790702258.35 total 20.03 last 20.24)
 - mkdir 549 (time 1790702268.43 total 30.11 last 18.05)
 - mkdir 755 (time 1790702278.45 total 40.14 last 20.55)
 - mkdir 984 (time 1790702288.48 total 50.16 last 22.85)
total: 1000 mkdir in 50.58 seconds: 19.77 ops/second
 - mkdir 163 (time 1790702248.26 total 10.03 last 16.25)
 - mkdir 361 (time 1790702258.29 total 20.06 last 19.75)
 - mkdir 538 (time 1790702268.32 total 30.09 last 17.64)
 - mkdir 739 (time 1790702278.34 total 40.11 last 20.06)
 - mkdir 965 (time 1790702288.36 total 50.13 last 22.55)
total: 1000 mkdir in 51.82 seconds: 19.30 ops/second
 - mkdir 155 (time 1790702246.83 total 10.06 last 15.40)
 - mkdir 348 (time 1790702256.89 total 20.12 last 19.19)
 - mkdir 529 (time 1790702267.02 total 30.25 last 17.87)
 - mkdir 705 (time 1790702277.06 total 40.29 last 17.53)
 - mkdir 939 (time 1790702287.09 total 50.32 last 23.33)
total: 1000 mkdir in 53.41 seconds: 18.72 ops/second
 - mkdir 151 (time 1790702247.18 total 10.03 last 15.06)
 - mkdir 345 (time 1790702257.24 total 20.09 last 19.28)
 - mkdir 526 (time 1790702267.26 total 30.10 last 18.07)
 - mkdir 702 (time 1790702277.30 total 40.15 last 17.52)
 - mkdir 940 (time 1790702287.31 total 50.16 last 23.78)
total: 1000 mkdir in 53.32 seconds: 18.76 ops/second
 - mkdir 165 (time 1790702248.42 total 10.07 last 16.39)
 - mkdir 357 (time 1790702258.47 total 20.12 last 19.09)
 - mkdir 538 (time 1790702268.52 total 30.17 last 18.02)
 - mkdir 740 (time 1790702278.53 total 40.18 last 20.17)
 - mkdir 969 (time 1790702288.54 total 50.19 last 22.89)
total: 1000 mkdir in 52.35 seconds: 19.10 ops/second
 - mkdir 155 (time 1790702247.76 total 10.01 last 15.48)
 - mkdir 350 (time 1790702257.82 total 20.07 last 19.39)
 - mkdir 532 (time 1790702267.86 total 30.11 last 18.13)
 - mkdir 720 (time 1790702277.91 total 40.16 last 18.71)
 - mkdir 952 (time 1790702287.95 total 50.20 last 23.11)
total: 1000 mkdir in 53.34 seconds: 18.75 ops/second
 - mkdir 163 (time 1790702248.66 total 10.01 last 16.28)
 - mkdir 362 (time 1790702258.67 total 20.02 last 19.89)
 - mkdir 539 (time 1790702268.70 total 30.05 last 17.65)
 - mkdir 739 (time 1790702278.71 total 40.06 last 19.98)
 - mkdir 970 (time 1790702288.73 total 50.08 last 23.05)
total: 1000 mkdir in 52.45 seconds: 19.07 ops/second
 - mkdir 153 (time 1790702246.94 total 10.09 last 15.16)
 - mkdir 345 (time 1790702256.99 total 20.14 last 19.12)
 - mkdir 523 (time 1790702267.02 total 30.16 last 17.75)
 - mkdir 693 (time 1790702277.03 total 40.18 last 16.98)
 - mkdir 928 (time 1790702287.06 total 50.21 last 23.43)
total: 1000 mkdir in 54.72 seconds: 18.28 ops/second
 - mkdir 154 (time 1790702248.04 total 10.03 last 15.36)
 - mkdir 347 (time 1790702258.10 total 20.09 last 19.19)
 - mkdir 529 (time 1790702268.10 total 30.09 last 18.19)
 - mkdir 725 (time 1790702278.14 total 40.12 last 19.53)
 - mkdir 946 (time 1790702288.21 total 50.20 last 21.94)
total: 1000 mkdir in 54.00 seconds: 18.52 ops/second
 - mkdir 152 (time 1790702248.24 total 10.01 last 15.19)
 - mkdir 340 (time 1790702258.28 total 20.06 last 18.71)
 - mkdir 505 (time 1790702268.31 total 30.09 last 16.45)
 - mkdir 694 (time 1790702278.36 total 40.13 last 18.81)
 - mkdir 911 (time 1790702288.36 total 50.13 last 21.70)
total: 1000 mkdir in 56.81 seconds: 17.60 ops/second
Time for file creation 69 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790702304 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790702304 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790702304 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790702305 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8