== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:32:41 (1787812361)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.36 ops/second
 - mkdir 156 (time 1787812382.00 total 10.11 last 15.43)
 - mkdir 330 (time 1787812392.04 total 20.15 last 17.32)
 - mkdir 492 (time 1787812402.06 total 30.18 last 16.16)
 - mkdir 656 (time 1787812412.10 total 40.21 last 16.34)
 - mkdir 820 (time 1787812422.14 total 50.25 last 16.34)
total: 1000 mkdir in 59.69 seconds: 16.75 ops/second
 - mkdir 147 (time 1787812381.01 total 10.06 last 14.61)
 - mkdir 315 (time 1787812391.03 total 20.09 last 16.76)
 - mkdir 467 (time 1787812401.06 total 30.12 last 15.15)
 - mkdir 636 (time 1787812411.08 total 40.14 last 16.86)
 - mkdir 799 (time 1787812421.09 total 50.15 last 16.29)
 - mkdir 983 (time 1787812431.14 total 60.19 last 18.32)
total: 1000 mkdir in 61.93 seconds: 16.15 ops/second
 - mkdir 159 (time 1787812383.12 total 10.06 last 15.81)
 - mkdir 327 (time 1787812393.14 total 20.08 last 16.76)
 - mkdir 491 (time 1787812403.15 total 30.08 last 16.40)
 - mkdir 659 (time 1787812413.21 total 40.14 last 16.70)
 - mkdir 827 (time 1787812423.23 total 50.16 last 16.76)
 - mkdir 998 (time 1787812433.23 total 60.16 last 17.10)
total: 1000 mkdir in 60.30 seconds: 16.59 ops/second
 - mkdir 146 (time 1787812381.44 total 10.07 last 14.50)
 - mkdir 309 (time 1787812391.49 total 20.12 last 16.22)
 - mkdir 453 (time 1787812401.51 total 30.14 last 14.37)
 - mkdir 624 (time 1787812411.61 total 40.24 last 16.93)
 - mkdir 785 (time 1787812421.66 total 50.29 last 16.02)
 - mkdir 973 (time 1787812431.74 total 60.37 last 18.65)
total: 1000 mkdir in 63.15 seconds: 15.84 ops/second
 - mkdir 164 (time 1787812383.18 total 10.04 last 16.33)
 - mkdir 329 (time 1787812393.19 total 20.05 last 16.49)
 - mkdir 493 (time 1787812403.19 total 30.05 last 16.40)
 - mkdir 655 (time 1787812413.19 total 40.05 last 16.19)
 - mkdir 815 (time 1787812423.22 total 50.08 last 15.96)
 - mkdir 985 (time 1787812433.32 total 60.18 last 16.83)
total: 1000 mkdir in 61.50 seconds: 16.26 ops/second
 - mkdir 161 (time 1787812383.35 total 10.00 last 16.09)
 - mkdir 321 (time 1787812393.36 total 20.02 last 15.97)
 - mkdir 483 (time 1787812403.38 total 30.04 last 16.17)
 - mkdir 648 (time 1787812413.41 total 40.07 last 16.45)
 - mkdir 817 (time 1787812423.43 total 50.09 last 16.88)
 - mkdir 986 (time 1787812433.54 total 60.19 last 16.72)
total: 1000 mkdir in 61.49 seconds: 16.26 ops/second
 - mkdir 143 (time 1787812382.10 total 10.01 last 14.29)
 - mkdir 306 (time 1787812392.11 total 20.02 last 16.28)
 - mkdir 459 (time 1787812402.16 total 30.06 last 15.24)
 - mkdir 621 (time 1787812412.16 total 40.07 last 16.19)
 - mkdir 788 (time 1787812422.19 total 50.10 last 16.65)
 - mkdir 972 (time 1787812432.30 total 60.21 last 18.21)
total: 1000 mkdir in 63.22 seconds: 15.82 ops/second
 - mkdir 157 (time 1787812383.48 total 10.03 last 15.66)
 - mkdir 322 (time 1787812393.49 total 20.04 last 16.48)
 - mkdir 486 (time 1787812403.53 total 30.08 last 16.33)
 - mkdir 652 (time 1787812413.57 total 40.11 last 16.55)
 - mkdir 814 (time 1787812423.58 total 50.13 last 16.17)
 - mkdir 984 (time 1787812433.70 total 60.24 last 16.81)
total: 1000 mkdir in 61.87 seconds: 16.16 ops/second
 - mkdir 157 (time 1787812383.19 total 10.05 last 15.62)
 - mkdir 321 (time 1787812393.19 total 20.05 last 16.40)
 - mkdir 488 (time 1787812403.28 total 30.14 last 16.55)
 - mkdir 650 (time 1787812413.29 total 40.15 last 16.18)
 - mkdir 814 (time 1787812423.32 total 50.18 last 16.35)
 - mkdir 980 (time 1787812433.43 total 60.29 last 16.42)
total: 1000 mkdir in 62.53 seconds: 15.99 ops/second
 - mkdir 153 (time 1787812383.19 total 10.03 last 15.26)
 - mkdir 319 (time 1787812393.23 total 20.07 last 16.54)
 - mkdir 478 (time 1787812403.23 total 30.07 last 15.89)
 - mkdir 642 (time 1787812413.25 total 40.08 last 16.38)
 - mkdir 807 (time 1787812423.29 total 50.13 last 16.43)
 - mkdir 977 (time 1787812433.35 total 60.19 last 16.90)
total: 1000 mkdir in 62.51 seconds: 16.00 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.38 seconds: 26.54 ops/second
 - mkdir 205 (time 1787812941.77 total 10.02 last 20.46)
 - mkdir 386 (time 1787812951.81 total 20.06 last 18.02)
 - mkdir 569 (time 1787812961.83 total 30.08 last 18.26)
 - mkdir 759 (time 1787812971.83 total 40.08 last 19.00)
 - mkdir 933 (time 1787812981.86 total 50.11 last 17.35)
total: 1000 mkdir in 54.59 seconds: 18.32 ops/second
 - mkdir 216 (time 1787812942.73 total 10.07 last 21.45)
 - mkdir 393 (time 1787812952.78 total 20.12 last 17.60)
 - mkdir 578 (time 1787812962.81 total 30.15 last 18.44)
 - mkdir 765 (time 1787812972.83 total 40.17 last 18.67)
 - mkdir 937 (time 1787812982.92 total 50.26 last 17.05)
total: 1000 mkdir in 54.25 seconds: 18.43 ops/second
 - mkdir 201 (time 1787812941.68 total 10.01 last 20.07)
 - mkdir 380 (time 1787812951.70 total 20.03 last 17.87)
 - mkdir 559 (time 1787812961.74 total 30.07 last 17.83)
 - mkdir 750 (time 1787812971.76 total 40.09 last 19.07)
 - mkdir 924 (time 1787812981.86 total 50.19 last 17.22)
total: 1000 mkdir in 55.55 seconds: 18.00 ops/second
 - mkdir 202 (time 1787812941.26 total 10.01 last 20.17)
 - mkdir 378 (time 1787812951.29 total 20.05 last 17.54)
 - mkdir 555 (time 1787812961.30 total 30.06 last 17.69)
 - mkdir 741 (time 1787812971.34 total 40.10 last 18.53)
 - mkdir 916 (time 1787812981.37 total 50.13 last 17.44)
total: 1000 mkdir in 56.02 seconds: 17.85 ops/second
 - mkdir 207 (time 1787812942.01 total 10.00 last 20.69)
 - mkdir 382 (time 1787812952.02 total 20.02 last 17.48)
 - mkdir 566 (time 1787812962.06 total 30.05 last 18.33)
 - mkdir 756 (time 1787812972.09 total 40.09 last 18.94)
 - mkdir 925 (time 1787812982.11 total 50.11 last 16.87)
total: 1000 mkdir in 55.28 seconds: 18.09 ops/second
 - mkdir 202 (time 1787812942.02 total 10.00 last 20.19)
 - mkdir 380 (time 1787812952.05 total 20.04 last 17.73)
 - mkdir 563 (time 1787812962.06 total 30.05 last 18.29)
 - mkdir 747 (time 1787812972.12 total 40.11 last 18.29)
 - mkdir 918 (time 1787812982.14 total 50.13 last 17.06)
total: 1000 mkdir in 56.37 seconds: 17.74 ops/second
 - mkdir 213 (time 1787812942.98 total 10.00 last 21.30)
 - mkdir 397 (time 1787812953.00 total 20.02 last 18.37)
 - mkdir 571 (time 1787812963.01 total 30.03 last 17.38)
 - mkdir 760 (time 1787812973.01 total 40.03 last 18.89)
 - mkdir 923 (time 1787812983.08 total 50.10 last 16.19)
total: 1000 mkdir in 55.51 seconds: 18.01 ops/second
 - mkdir 198 (time 1787812941.42 total 10.04 last 19.72)
 - mkdir 369 (time 1787812951.46 total 20.08 last 17.03)
 - mkdir 540 (time 1787812961.51 total 30.13 last 17.01)
 - mkdir 728 (time 1787812971.53 total 40.15 last 18.76)
 - mkdir 905 (time 1787812981.60 total 50.23 last 17.57)
total: 1000 mkdir in 57.26 seconds: 17.46 ops/second
 - mkdir 203 (time 1787812942.77 total 10.05 last 20.20)
 - mkdir 383 (time 1787812952.82 total 20.09 last 17.93)
 - mkdir 552 (time 1787812962.83 total 30.10 last 16.88)
 - mkdir 741 (time 1787812972.86 total 40.14 last 18.84)
 - mkdir 911 (time 1787812982.92 total 50.19 last 16.91)
total: 1000 mkdir in 57.04 seconds: 17.53 ops/second
 - mkdir 205 (time 1787812942.73 total 10.04 last 20.43)
 - mkdir 380 (time 1787812952.77 total 20.08 last 17.42)
 - mkdir 550 (time 1787812962.82 total 30.13 last 16.92)
 - mkdir 735 (time 1787812972.86 total 40.17 last 18.42)
 - mkdir 905 (time 1787812982.89 total 50.20 last 16.95)
total: 1000 mkdir in 57.58 seconds: 17.37 ops/second
Time for file creation 66 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787812998 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787812999 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787812999 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787812999 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787813000 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787812999 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787813000 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787813000 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787813000 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787813000 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 39 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8