== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:30:37 (1787862637)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.45 seconds: 22.14 ops/second
 - mkdir 163 (time 1787862661.81 total 10.04 last 16.24)
 - mkdir 338 (time 1787862671.82 total 20.05 last 17.49)
 - mkdir 520 (time 1787862681.88 total 30.10 last 18.10)
 - mkdir 704 (time 1787862691.92 total 40.15 last 18.31)
 - mkdir 905 (time 1787862701.95 total 50.18 last 20.04)
total: 1000 mkdir in 54.80 seconds: 18.25 ops/second
 - mkdir 149 (time 1787862660.75 total 10.04 last 14.84)
 - mkdir 317 (time 1787862670.80 total 20.10 last 16.71)
 - mkdir 510 (time 1787862680.85 total 30.15 last 19.20)
 - mkdir 683 (time 1787862690.87 total 40.16 last 17.27)
 - mkdir 879 (time 1787862700.89 total 50.18 last 19.56)
total: 1000 mkdir in 56.89 seconds: 17.58 ops/second
 - mkdir 160 (time 1787862662.26 total 10.05 last 15.92)
 - mkdir 332 (time 1787862672.29 total 20.08 last 17.15)
 - mkdir 514 (time 1787862682.33 total 30.12 last 18.12)
 - mkdir 698 (time 1787862692.35 total 40.14 last 18.38)
 - mkdir 889 (time 1787862702.42 total 50.22 last 18.95)
total: 1000 mkdir in 57.66 seconds: 17.34 ops/second
 - mkdir 167 (time 1787862662.58 total 10.01 last 16.68)
 - mkdir 346 (time 1787862672.60 total 20.04 last 17.85)
 - mkdir 523 (time 1787862682.65 total 30.09 last 17.61)
 - mkdir 703 (time 1787862692.66 total 40.10 last 17.98)
 - mkdir 895 (time 1787862702.69 total 50.12 last 19.15)
total: 1000 mkdir in 57.31 seconds: 17.45 ops/second
 - mkdir 162 (time 1787862662.41 total 10.02 last 16.17)
 - mkdir 340 (time 1787862672.43 total 20.04 last 17.76)
 - mkdir 519 (time 1787862682.46 total 30.07 last 17.85)
 - mkdir 697 (time 1787862692.47 total 40.08 last 17.78)
 - mkdir 889 (time 1787862702.48 total 50.09 last 19.18)
total: 1000 mkdir in 57.65 seconds: 17.35 ops/second
 - mkdir 153 (time 1787862661.48 total 10.04 last 15.24)
 - mkdir 324 (time 1787862671.49 total 20.05 last 17.08)
 - mkdir 508 (time 1787862681.50 total 30.06 last 18.39)
 - mkdir 682 (time 1787862691.51 total 40.07 last 17.37)
 - mkdir 871 (time 1787862701.53 total 50.09 last 18.87)
total: 1000 mkdir in 58.75 seconds: 17.02 ops/second
 - mkdir 164 (time 1787862662.59 total 10.02 last 16.37)
 - mkdir 340 (time 1787862672.59 total 20.02 last 17.60)
 - mkdir 516 (time 1787862682.61 total 30.04 last 17.57)
 - mkdir 692 (time 1787862692.63 total 40.06 last 17.55)
 - mkdir 888 (time 1787862702.64 total 50.07 last 19.59)
total: 1000 mkdir in 57.97 seconds: 17.25 ops/second
 - mkdir 141 (time 1787862659.96 total 10.08 last 13.99)
 - mkdir 307 (time 1787862670.01 total 20.12 last 16.53)
 - mkdir 493 (time 1787862680.09 total 30.20 last 18.45)
 - mkdir 656 (time 1787862690.11 total 40.22 last 16.27)
 - mkdir 847 (time 1787862700.20 total 50.31 last 18.93)
 - mkdir 997 (time 1787862710.22 total 60.33 last 14.97)
total: 1000 mkdir in 60.66 seconds: 16.49 ops/second
 - mkdir 161 (time 1787862662.77 total 10.05 last 16.02)
 - mkdir 340 (time 1787862672.80 total 20.08 last 17.85)
 - mkdir 517 (time 1787862682.82 total 30.10 last 17.67)
 - mkdir 697 (time 1787862692.90 total 40.18 last 17.85)
 - mkdir 887 (time 1787862702.95 total 50.23 last 18.90)
total: 1000 mkdir in 58.46 seconds: 17.11 ops/second
 - mkdir 153 (time 1787862662.90 total 10.02 last 15.27)
 - mkdir 324 (time 1787862672.95 total 20.06 last 17.02)
 - mkdir 496 (time 1787862683.00 total 30.11 last 17.12)
 - mkdir 668 (time 1787862693.05 total 40.16 last 17.11)
 - mkdir 855 (time 1787862703.07 total 50.18 last 18.66)
 - mkdir 989 (time 1787862713.09 total 60.21 last 13.37)
total: 1000 mkdir in 60.86 seconds: 16.43 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.10 ops/second
 - mkdir 156 (time 1787863212.53 total 10.02 last 15.57)
 - mkdir 329 (time 1787863222.54 total 20.03 last 17.28)
 - mkdir 557 (time 1787863232.56 total 30.05 last 22.74)
 - mkdir 728 (time 1787863242.61 total 40.10 last 17.01)
 - mkdir 922 (time 1787863252.66 total 50.15 last 19.30)
total: 1000 mkdir in 53.08 seconds: 18.84 ops/second
 - mkdir 140 (time 1787863210.90 total 10.08 last 13.89)
 - mkdir 309 (time 1787863220.92 total 20.11 last 16.85)
 - mkdir 530 (time 1787863230.96 total 30.14 last 22.03)
 - mkdir 697 (time 1787863241.00 total 40.18 last 16.63)
 - mkdir 891 (time 1787863251.01 total 50.19 last 19.38)
total: 1000 mkdir in 55.02 seconds: 18.18 ops/second
 - mkdir 148 (time 1787863212.74 total 10.01 last 14.79)
 - mkdir 317 (time 1787863222.74 total 20.01 last 16.90)
 - mkdir 539 (time 1787863232.81 total 30.08 last 22.04)
 - mkdir 714 (time 1787863242.83 total 40.10 last 17.47)
 - mkdir 909 (time 1787863252.87 total 50.14 last 19.41)
total: 1000 mkdir in 54.95 seconds: 18.20 ops/second
 - mkdir 145 (time 1787863213.21 total 10.01 last 14.48)
 - mkdir 327 (time 1787863223.22 total 20.02 last 18.19)
 - mkdir 551 (time 1787863233.25 total 30.05 last 22.34)
 - mkdir 719 (time 1787863243.27 total 40.07 last 16.76)
 - mkdir 913 (time 1787863253.29 total 50.09 last 19.36)
total: 1000 mkdir in 54.98 seconds: 18.19 ops/second
 - mkdir 148 (time 1787863213.33 total 10.06 last 14.71)
 - mkdir 320 (time 1787863223.35 total 20.08 last 17.17)
 - mkdir 545 (time 1787863233.38 total 30.10 last 22.44)
 - mkdir 713 (time 1787863243.51 total 40.24 last 16.58)
 - mkdir 912 (time 1787863253.52 total 50.24 last 19.89)
total: 1000 mkdir in 55.85 seconds: 17.91 ops/second
 - mkdir 149 (time 1787863213.68 total 10.01 last 14.89)
 - mkdir 329 (time 1787863223.68 total 20.01 last 17.99)
 - mkdir 548 (time 1787863233.69 total 30.02 last 21.89)
 - mkdir 716 (time 1787863243.70 total 40.03 last 16.77)
 - mkdir 914 (time 1787863253.76 total 50.09 last 19.69)
total: 1000 mkdir in 55.64 seconds: 17.97 ops/second
 - mkdir 150 (time 1787863213.49 total 10.08 last 14.88)
 - mkdir 325 (time 1787863223.49 total 20.08 last 17.49)
 - mkdir 539 (time 1787863233.51 total 30.10 last 21.36)
 - mkdir 706 (time 1787863243.54 total 40.14 last 16.64)
 - mkdir 909 (time 1787863253.60 total 50.19 last 20.20)
total: 1000 mkdir in 56.07 seconds: 17.83 ops/second
 - mkdir 149 (time 1787863213.06 total 10.02 last 14.87)
 - mkdir 318 (time 1787863223.06 total 20.03 last 16.89)
 - mkdir 536 (time 1787863233.09 total 30.05 last 21.74)
 - mkdir 708 (time 1787863243.09 total 40.06 last 17.19)
 - mkdir 900 (time 1787863253.13 total 50.09 last 19.13)
total: 1000 mkdir in 56.46 seconds: 17.71 ops/second
 - mkdir 136 (time 1787863211.71 total 10.04 last 13.55)
 - mkdir 293 (time 1787863221.74 total 20.08 last 15.65)
 - mkdir 510 (time 1787863231.74 total 30.08 last 21.70)
 - mkdir 676 (time 1787863241.78 total 40.12 last 16.54)
 - mkdir 874 (time 1787863251.80 total 50.13 last 19.77)
total: 1000 mkdir in 58.24 seconds: 17.17 ops/second
 - mkdir 153 (time 1787863213.87 total 10.04 last 15.24)
 - mkdir 328 (time 1787863223.89 total 20.06 last 17.47)
 - mkdir 540 (time 1787863233.92 total 30.08 last 21.14)
 - mkdir 701 (time 1787863243.98 total 40.14 last 16.00)
 - mkdir 900 (time 1787863253.99 total 50.16 last 19.87)
total: 1000 mkdir in 57.00 seconds: 17.54 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787863271 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787863272 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787863272 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863273 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863274 ; total 1 ; last 1)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 49 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8