== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:40:05 (1787866805)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.51 seconds: 19.69 ops/second
 - mkdir 161 (time 1787866824.66 total 10.06 last 16.01)
 - mkdir 375 (time 1787866834.69 total 20.08 last 21.35)
 - mkdir 534 (time 1787866844.70 total 30.09 last 15.88)
 - mkdir 694 (time 1787866854.75 total 40.15 last 15.91)
 - mkdir 882 (time 1787866864.79 total 50.18 last 18.74)
total: 1000 mkdir in 56.83 seconds: 17.60 ops/second
 - mkdir 167 (time 1787866825.07 total 10.01 last 16.69)
 - mkdir 370 (time 1787866835.07 total 20.01 last 20.30)
 - mkdir 540 (time 1787866845.09 total 30.03 last 16.97)
 - mkdir 702 (time 1787866855.16 total 40.09 last 16.09)
 - mkdir 883 (time 1787866865.20 total 50.14 last 18.02)
total: 1000 mkdir in 57.29 seconds: 17.45 ops/second
 - mkdir 152 (time 1787866824.49 total 10.01 last 15.19)
 - mkdir 366 (time 1787866834.51 total 20.03 last 21.36)
 - mkdir 525 (time 1787866844.52 total 30.03 last 15.89)
 - mkdir 681 (time 1787866854.55 total 40.06 last 15.55)
 - mkdir 867 (time 1787866864.56 total 50.07 last 18.58)
total: 1000 mkdir in 58.18 seconds: 17.19 ops/second
 - mkdir 156 (time 1787866824.56 total 10.05 last 15.53)
 - mkdir 363 (time 1787866834.62 total 20.11 last 20.58)
 - mkdir 524 (time 1787866844.67 total 30.15 last 16.02)
 - mkdir 683 (time 1787866854.67 total 40.16 last 15.90)
 - mkdir 870 (time 1787866864.71 total 50.20 last 18.62)
total: 1000 mkdir in 58.42 seconds: 17.12 ops/second
 - mkdir 160 (time 1787866825.24 total 10.03 last 15.95)
 - mkdir 365 (time 1787866835.31 total 20.10 last 20.36)
 - mkdir 533 (time 1787866845.33 total 30.12 last 16.77)
 - mkdir 692 (time 1787866855.37 total 40.16 last 15.83)
 - mkdir 878 (time 1787866865.37 total 50.17 last 18.59)
total: 1000 mkdir in 57.80 seconds: 17.30 ops/second
 - mkdir 162 (time 1787866825.38 total 10.06 last 16.11)
 - mkdir 368 (time 1787866835.42 total 20.10 last 20.52)
 - mkdir 534 (time 1787866845.42 total 30.10 last 16.60)
 - mkdir 694 (time 1787866855.42 total 40.10 last 16.00)
 - mkdir 879 (time 1787866865.45 total 50.13 last 18.45)
total: 1000 mkdir in 58.27 seconds: 17.16 ops/second
 - mkdir 164 (time 1787866825.47 total 10.01 last 16.38)
 - mkdir 369 (time 1787866835.49 total 20.03 last 20.46)
 - mkdir 535 (time 1787866845.50 total 30.05 last 16.57)
 - mkdir 695 (time 1787866855.52 total 40.07 last 15.97)
 - mkdir 877 (time 1787866865.57 total 50.12 last 18.10)
total: 1000 mkdir in 58.28 seconds: 17.16 ops/second
 - mkdir 156 (time 1787866825.49 total 10.03 last 15.55)
 - mkdir 364 (time 1787866835.56 total 20.10 last 20.65)
 - mkdir 530 (time 1787866845.57 total 30.12 last 16.58)
 - mkdir 682 (time 1787866855.61 total 40.15 last 15.14)
 - mkdir 866 (time 1787866865.61 total 50.16 last 18.39)
total: 1000 mkdir in 58.87 seconds: 16.99 ops/second
 - mkdir 152 (time 1787866825.18 total 10.01 last 15.19)
 - mkdir 357 (time 1787866835.20 total 20.03 last 20.46)
 - mkdir 518 (time 1787866845.22 total 30.04 last 16.07)
 - mkdir 678 (time 1787866855.30 total 40.12 last 15.87)
 - mkdir 861 (time 1787866865.36 total 50.19 last 18.19)
total: 1000 mkdir in 59.62 seconds: 16.77 ops/second
 - mkdir 147 (time 1787866825.26 total 10.04 last 14.64)
 - mkdir 342 (time 1787866835.34 total 20.12 last 19.35)
 - mkdir 499 (time 1787866845.42 total 30.20 last 15.57)
 - mkdir 660 (time 1787866855.47 total 40.25 last 16.02)
 - mkdir 838 (time 1787866865.50 total 50.28 last 17.75)
 - mkdir 977 (time 1787866875.52 total 60.29 last 13.88)
total: 1000 mkdir in 62.13 seconds: 16.10 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.63 ops/second
 - mkdir 119 (time 1787867423.25 total 10.02 last 11.87)
 - mkdir 279 (time 1787867433.28 total 20.05 last 15.95)
 - mkdir 433 (time 1787867443.33 total 30.11 last 15.32)
 - mkdir 593 (time 1787867453.37 total 40.14 last 15.94)
 - mkdir 763 (time 1787867463.39 total 50.16 last 16.98)
 - mkdir 909 (time 1787867473.48 total 60.25 last 14.46)
total: 1000 mkdir in 66.14 seconds: 15.12 ops/second
 - mkdir 126 (time 1787867424.75 total 10.05 last 12.53)
 - mkdir 289 (time 1787867434.77 total 20.07 last 16.27)
 - mkdir 445 (time 1787867444.84 total 30.15 last 15.48)
 - mkdir 615 (time 1787867454.85 total 40.15 last 16.99)
 - mkdir 789 (time 1787867464.89 total 50.20 last 17.32)
 - mkdir 929 (time 1787867474.93 total 60.24 last 13.94)
total: 1000 mkdir in 64.83 seconds: 15.42 ops/second
 - mkdir 107 (time 1787867421.97 total 10.18 last 10.51)
 - mkdir 268 (time 1787867432.01 total 20.22 last 16.04)
 - mkdir 418 (time 1787867442.06 total 30.27 last 14.93)
 - mkdir 564 (time 1787867452.08 total 40.29 last 14.56)
 - mkdir 732 (time 1787867462.15 total 50.36 last 16.69)
 - mkdir 887 (time 1787867472.22 total 60.43 last 15.39)
total: 1000 mkdir in 69.13 seconds: 14.46 ops/second
 - mkdir 136 (time 1787867425.61 total 10.07 last 13.51)
 - mkdir 301 (time 1787867435.62 total 20.08 last 16.48)
 - mkdir 456 (time 1787867445.70 total 30.17 last 15.37)
 - mkdir 619 (time 1787867455.72 total 40.19 last 16.27)
 - mkdir 786 (time 1787867465.75 total 50.21 last 16.65)
 - mkdir 927 (time 1787867475.81 total 60.27 last 14.02)
total: 1000 mkdir in 65.96 seconds: 15.16 ops/second
 - mkdir 132 (time 1787867425.66 total 10.02 last 13.17)
 - mkdir 296 (time 1787867435.69 total 20.04 last 16.36)
 - mkdir 451 (time 1787867445.76 total 30.12 last 15.39)
 - mkdir 616 (time 1787867455.78 total 40.13 last 16.48)
 - mkdir 784 (time 1787867465.83 total 50.19 last 16.71)
 - mkdir 921 (time 1787867475.84 total 60.19 last 13.69)
total: 1000 mkdir in 66.67 seconds: 15.00 ops/second
 - mkdir 127 (time 1787867424.99 total 10.10 last 12.58)
 - mkdir 282 (time 1787867435.02 total 20.13 last 15.45)
 - mkdir 433 (time 1787867445.05 total 30.15 last 15.06)
 - mkdir 603 (time 1787867455.10 total 40.21 last 16.91)
 - mkdir 768 (time 1787867465.11 total 50.22 last 16.48)
 - mkdir 903 (time 1787867475.12 total 60.22 last 13.49)
total: 1000 mkdir in 67.67 seconds: 14.78 ops/second
 - mkdir 128 (time 1787867425.21 total 10.04 last 12.75)
 - mkdir 287 (time 1787867435.23 total 20.07 last 15.86)
 - mkdir 439 (time 1787867445.25 total 30.09 last 15.17)
 - mkdir 603 (time 1787867455.25 total 40.09 last 16.40)
 - mkdir 771 (time 1787867465.27 total 50.11 last 16.77)
 - mkdir 910 (time 1787867475.30 total 60.14 last 13.86)
total: 1000 mkdir in 67.50 seconds: 14.81 ops/second
 - mkdir 126 (time 1787867425.52 total 10.02 last 12.57)
 - mkdir 289 (time 1787867435.57 total 20.07 last 16.23)
 - mkdir 438 (time 1787867445.57 total 30.07 last 14.89)
 - mkdir 602 (time 1787867455.62 total 40.12 last 16.31)
 - mkdir 770 (time 1787867465.64 total 50.14 last 16.77)
 - mkdir 904 (time 1787867475.65 total 60.15 last 13.38)
total: 1000 mkdir in 68.15 seconds: 14.67 ops/second
 - mkdir 133 (time 1787867425.84 total 10.02 last 13.27)
 - mkdir 289 (time 1787867435.88 total 20.06 last 15.54)
 - mkdir 436 (time 1787867445.89 total 30.07 last 14.68)
 - mkdir 598 (time 1787867455.93 total 40.11 last 16.14)
 - mkdir 760 (time 1787867465.95 total 50.13 last 16.16)
 - mkdir 891 (time 1787867475.98 total 60.16 last 13.06)
total: 1000 mkdir in 69.39 seconds: 14.41 ops/second
 - mkdir 123 (time 1787867425.65 total 10.08 last 12.20)
 - mkdir 274 (time 1787867435.67 total 20.10 last 15.07)
 - mkdir 413 (time 1787867445.68 total 30.11 last 13.88)
 - mkdir 569 (time 1787867455.68 total 40.11 last 15.60)
 - mkdir 730 (time 1787867465.68 total 50.11 last 16.10)
 - mkdir 854 (time 1787867475.70 total 60.13 last 12.37)
 - mkdir 975 (time 1787867485.73 total 70.16 last 12.07)
total: 1000 mkdir in 71.35 seconds: 14.02 ops/second
Time for file creation 83 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787867494 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787867495 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8