== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:09:06 (1787875746)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.56 seconds: 17.91 ops/second
 - mkdir 175 (time 1787875767.89 total 10.02 last 17.47)
 - mkdir 331 (time 1787875777.89 total 20.02 last 15.60)
 - mkdir 438 (time 1787875787.90 total 30.04 last 10.69)
 - mkdir 557 (time 1787875798.02 total 40.15 last 11.77)
 - mkdir 696 (time 1787875808.03 total 50.16 last 13.87)
 - mkdir 884 (time 1787875818.06 total 60.19 last 18.75)
total: 1000 mkdir in 67.13 seconds: 14.90 ops/second
 - mkdir 171 (time 1787875766.64 total 10.03 last 17.06)
 - mkdir 322 (time 1787875776.66 total 20.04 last 15.07)
 - mkdir 433 (time 1787875786.71 total 30.10 last 11.04)
 - mkdir 548 (time 1787875796.80 total 40.18 last 11.40)
 - mkdir 672 (time 1787875806.86 total 50.24 last 12.33)
 - mkdir 856 (time 1787875816.87 total 60.25 last 18.38)
total: 1000 mkdir in 69.25 seconds: 14.44 ops/second
 - mkdir 170 (time 1787875767.56 total 10.02 last 16.96)
 - mkdir 327 (time 1787875777.57 total 20.04 last 15.67)
 - mkdir 432 (time 1787875787.61 total 30.08 last 10.46)
 - mkdir 548 (time 1787875797.63 total 40.10 last 11.58)
 - mkdir 680 (time 1787875807.70 total 50.16 last 13.11)
 - mkdir 862 (time 1787875817.76 total 60.23 last 18.08)
total: 1000 mkdir in 69.41 seconds: 14.41 ops/second
 - mkdir 169 (time 1787875766.99 total 10.03 last 16.84)
 - mkdir 324 (time 1787875777.02 total 20.06 last 15.45)
 - mkdir 425 (time 1787875787.09 total 30.14 last 10.03)
 - mkdir 541 (time 1787875797.16 total 40.20 last 11.53)
 - mkdir 667 (time 1787875807.18 total 50.22 last 12.57)
 - mkdir 846 (time 1787875817.20 total 60.24 last 17.86)
total: 1000 mkdir in 70.15 seconds: 14.25 ops/second
 - mkdir 172 (time 1787875767.93 total 10.01 last 17.19)
 - mkdir 327 (time 1787875777.99 total 20.06 last 15.42)
 - mkdir 428 (time 1787875787.99 total 30.06 last 10.10)
 - mkdir 546 (time 1787875798.04 total 40.11 last 11.74)
 - mkdir 679 (time 1787875808.08 total 50.15 last 13.25)
 - mkdir 861 (time 1787875818.12 total 60.19 last 18.14)
total: 1000 mkdir in 69.32 seconds: 14.43 ops/second
 - mkdir 171 (time 1787875767.07 total 10.03 last 17.05)
 - mkdir 326 (time 1787875777.15 total 20.11 last 15.38)
 - mkdir 427 (time 1787875787.17 total 30.13 last 10.08)
 - mkdir 537 (time 1787875797.19 total 40.15 last 10.98)
 - mkdir 665 (time 1787875807.22 total 50.18 last 12.76)
 - mkdir 850 (time 1787875817.24 total 60.20 last 18.46)
 - mkdir 997 (time 1787875827.34 total 70.30 last 14.56)
total: 1000 mkdir in 70.44 seconds: 14.20 ops/second
 - mkdir 169 (time 1787875767.31 total 10.01 last 16.88)
 - mkdir 320 (time 1787875777.37 total 20.06 last 15.02)
 - mkdir 419 (time 1787875787.41 total 30.11 last 9.86)
 - mkdir 531 (time 1787875797.45 total 40.15 last 11.15)
 - mkdir 658 (time 1787875807.45 total 50.15 last 12.70)
 - mkdir 837 (time 1787875817.45 total 60.15 last 17.90)
 - mkdir 990 (time 1787875827.54 total 70.24 last 15.17)
total: 1000 mkdir in 71.13 seconds: 14.06 ops/second
 - mkdir 162 (time 1787875766.11 total 10.00 last 16.19)
 - mkdir 314 (time 1787875776.17 total 20.06 last 15.11)
 - mkdir 422 (time 1787875786.19 total 30.09 last 10.77)
 - mkdir 529 (time 1787875796.23 total 40.12 last 10.66)
 - mkdir 649 (time 1787875806.23 total 50.12 last 12.00)
 - mkdir 826 (time 1787875816.28 total 60.17 last 17.63)
 - mkdir 979 (time 1787875826.31 total 70.20 last 15.25)
total: 1000 mkdir in 72.46 seconds: 13.80 ops/second
 - mkdir 166 (time 1787875767.86 total 10.03 last 16.55)
 - mkdir 313 (time 1787875777.90 total 20.07 last 14.65)
 - mkdir 410 (time 1787875787.91 total 30.08 last 9.69)
 - mkdir 525 (time 1787875797.98 total 40.16 last 11.41)
 - mkdir 656 (time 1787875808.00 total 50.17 last 13.08)
 - mkdir 833 (time 1787875818.04 total 60.21 last 17.63)
 - mkdir 975 (time 1787875828.07 total 70.25 last 14.16)
total: 1000 mkdir in 72.65 seconds: 13.76 ops/second
 - mkdir 161 (time 1787875765.80 total 10.02 last 16.08)
 - mkdir 308 (time 1787875775.81 total 20.03 last 14.68)
 - mkdir 413 (time 1787875785.87 total 30.09 last 10.44)
 - mkdir 510 (time 1787875795.90 total 40.12 last 9.67)
 - mkdir 626 (time 1787875805.97 total 50.19 last 11.52)
 - mkdir 797 (time 1787875816.00 total 60.22 last 17.05)
 - mkdir 950 (time 1787875826.09 total 70.31 last 15.17)
total: 1000 mkdir in 74.93 seconds: 13.35 ops/second
Time for file creation 83 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.83 seconds: 12.05 ops/second
 - mkdir 123 (time 1787876490.89 total 10.00 last 12.29)
 - mkdir 280 (time 1787876500.91 total 20.03 last 15.66)
 - mkdir 435 (time 1787876510.97 total 30.09 last 15.40)
 - mkdir 558 (time 1787876521.02 total 40.14 last 12.24)
 - mkdir 677 (time 1787876531.08 total 50.20 last 11.83)
 - mkdir 789 (time 1787876541.11 total 60.22 last 11.17)
 - mkdir 907 (time 1787876551.14 total 70.26 last 11.76)
total: 1000 mkdir in 77.28 seconds: 12.94 ops/second
 - mkdir 120 (time 1787876490.41 total 10.03 last 11.97)
 - mkdir 267 (time 1787876500.44 total 20.06 last 14.66)
 - mkdir 428 (time 1787876510.53 total 30.15 last 15.95)
 - mkdir 546 (time 1787876520.74 total 40.36 last 11.56)
 - mkdir 658 (time 1787876530.76 total 50.38 last 11.17)
 - mkdir 762 (time 1787876540.78 total 60.40 last 10.38)
 - mkdir 882 (time 1787876550.84 total 70.46 last 11.93)
total: 1000 mkdir in 80.06 seconds: 12.49 ops/second
 - mkdir 118 (time 1787876490.23 total 10.00 last 11.80)
 - mkdir 264 (time 1787876500.23 total 20.00 last 14.60)
 - mkdir 430 (time 1787876510.26 total 30.03 last 16.56)
 - mkdir 550 (time 1787876520.40 total 40.17 last 11.83)
 - mkdir 661 (time 1787876530.56 total 50.33 last 10.92)
 - mkdir 763 (time 1787876540.63 total 60.40 last 10.13)
 - mkdir 882 (time 1787876550.69 total 70.46 last 11.83)
total: 1000 mkdir in 80.21 seconds: 12.47 ops/second
 - mkdir 128 (time 1787876491.27 total 10.07 last 12.72)
 - mkdir 275 (time 1787876501.32 total 20.12 last 14.62)
 - mkdir 422 (time 1787876511.39 total 30.19 last 14.60)
 - mkdir 541 (time 1787876521.40 total 40.20 last 11.88)
 - mkdir 652 (time 1787876531.53 total 50.32 last 10.96)
 - mkdir 763 (time 1787876541.60 total 60.40 last 11.02)
 - mkdir 880 (time 1787876551.63 total 70.43 last 11.66)
 - mkdir 995 (time 1787876561.70 total 80.49 last 11.43)
total: 1000 mkdir in 81.10 seconds: 12.33 ops/second
 - mkdir 121 (time 1787876491.13 total 10.02 last 12.08)
 - mkdir 271 (time 1787876501.15 total 20.04 last 14.97)
 - mkdir 421 (time 1787876511.18 total 30.06 last 14.96)
 - mkdir 538 (time 1787876521.22 total 40.10 last 11.65)
 - mkdir 651 (time 1787876531.28 total 50.16 last 11.23)
 - mkdir 758 (time 1787876541.29 total 60.18 last 10.69)
 - mkdir 874 (time 1787876551.36 total 70.24 last 11.52)
 - mkdir 990 (time 1787876561.43 total 80.31 last 11.52)
total: 1000 mkdir in 81.64 seconds: 12.25 ops/second
 - mkdir 115 (time 1787876490.43 total 10.05 last 11.44)
 - mkdir 261 (time 1787876500.47 total 20.09 last 14.55)
 - mkdir 415 (time 1787876510.52 total 30.14 last 15.33)
 - mkdir 532 (time 1787876520.53 total 40.15 last 11.69)
 - mkdir 642 (time 1787876530.60 total 50.21 last 10.93)
 - mkdir 746 (time 1787876540.70 total 60.32 last 10.29)
 - mkdir 864 (time 1787876550.75 total 70.37 last 11.74)
 - mkdir 982 (time 1787876560.84 total 80.46 last 11.69)
total: 1000 mkdir in 82.60 seconds: 12.11 ops/second
 - mkdir 113 (time 1787876490.08 total 10.02 last 11.28)
 - mkdir 254 (time 1787876500.12 total 20.06 last 14.04)
 - mkdir 412 (time 1787876510.15 total 30.09 last 15.75)
 - mkdir 527 (time 1787876520.24 total 40.18 last 11.40)
 - mkdir 638 (time 1787876530.30 total 50.24 last 11.03)
 - mkdir 743 (time 1787876540.32 total 60.26 last 10.48)
 - mkdir 859 (time 1787876550.46 total 70.40 last 11.44)
 - mkdir 976 (time 1787876560.55 total 80.49 last 11.60)
total: 1000 mkdir in 83.25 seconds: 12.01 ops/second
 - mkdir 122 (time 1787876489.74 total 10.05 last 12.14)
 - mkdir 261 (time 1787876499.77 total 20.08 last 13.86)
 - mkdir 417 (time 1787876509.77 total 30.08 last 15.60)
 - mkdir 538 (time 1787876519.88 total 40.19 last 11.96)
 - mkdir 639 (time 1787876529.89 total 50.21 last 10.09)
 - mkdir 741 (time 1787876539.96 total 60.28 last 10.13)
 - mkdir 858 (time 1787876550.04 total 70.35 last 11.62)
 - mkdir 974 (time 1787876560.08 total 80.40 last 11.54)
total: 1000 mkdir in 83.67 seconds: 11.95 ops/second
 - mkdir 123 (time 1787876491.68 total 10.06 last 12.23)
 - mkdir 271 (time 1787876501.74 total 20.12 last 14.72)
 - mkdir 423 (time 1787876511.79 total 30.17 last 15.12)
 - mkdir 541 (time 1787876521.83 total 40.21 last 11.76)
 - mkdir 652 (time 1787876531.90 total 50.28 last 11.02)
 - mkdir 759 (time 1787876541.95 total 60.33 last 10.65)
 - mkdir 873 (time 1787876551.96 total 70.34 last 11.38)
 - mkdir 987 (time 1787876562.09 total 80.47 last 11.25)
total: 1000 mkdir in 82.02 seconds: 12.19 ops/second
 - mkdir 115 (time 1787876491.02 total 10.02 last 11.48)
 - mkdir 258 (time 1787876501.04 total 20.04 last 14.28)
 - mkdir 398 (time 1787876511.04 total 30.04 last 13.99)
 - mkdir 506 (time 1787876521.06 total 40.05 last 10.79)
 - mkdir 617 (time 1787876531.10 total 50.09 last 11.06)
 - mkdir 717 (time 1787876541.17 total 60.16 last 9.93)
 - mkdir 830 (time 1787876551.24 total 70.24 last 11.22)
 - mkdir 950 (time 1787876561.32 total 80.31 last 11.91)
total: 1000 mkdir in 85.17 seconds: 11.74 ops/second
Time for file creation 94 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787876574 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787876575 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787876575 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787876576 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 52 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8