== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:49:09 (1787334549)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.40 seconds: 25.04 ops/second
 - mkdir 157 (time 1787334571.66 total 10.03 last 15.66)
 - mkdir 309 (time 1787334581.71 total 20.09 last 15.11)
 - mkdir 479 (time 1787334591.75 total 30.12 last 16.94)
 - mkdir 652 (time 1787334601.80 total 40.17 last 17.21)
 - mkdir 842 (time 1787334611.84 total 50.21 last 18.92)
total: 1000 mkdir in 59.27 seconds: 16.87 ops/second
 - mkdir 151 (time 1787334569.85 total 10.00 last 15.09)
 - mkdir 300 (time 1787334579.86 total 20.01 last 14.89)
 - mkdir 470 (time 1787334589.91 total 30.06 last 16.92)
 - mkdir 629 (time 1787334599.95 total 40.10 last 15.84)
 - mkdir 811 (time 1787334609.97 total 50.12 last 18.16)
 - mkdir 984 (time 1787334619.98 total 60.13 last 17.28)
total: 1000 mkdir in 61.37 seconds: 16.30 ops/second
 - mkdir 156 (time 1787334570.62 total 10.00 last 15.60)
 - mkdir 301 (time 1787334580.68 total 20.06 last 14.42)
 - mkdir 464 (time 1787334590.72 total 30.10 last 16.23)
 - mkdir 638 (time 1787334600.73 total 40.11 last 17.38)
 - mkdir 825 (time 1787334610.74 total 50.12 last 18.68)
 - mkdir 992 (time 1787334620.76 total 60.13 last 16.68)
total: 1000 mkdir in 60.60 seconds: 16.50 ops/second
 - mkdir 150 (time 1787334571.66 total 10.03 last 14.96)
 - mkdir 302 (time 1787334581.71 total 20.08 last 15.12)
 - mkdir 467 (time 1787334591.80 total 30.17 last 16.36)
 - mkdir 640 (time 1787334601.84 total 40.21 last 17.23)
 - mkdir 829 (time 1787334611.91 total 50.28 last 18.76)
 - mkdir 986 (time 1787334621.96 total 60.33 last 15.62)
total: 1000 mkdir in 61.72 seconds: 16.20 ops/second
 - mkdir 150 (time 1787334571.05 total 10.05 last 14.93)
 - mkdir 302 (time 1787334581.08 total 20.08 last 15.15)
 - mkdir 465 (time 1787334591.10 total 30.10 last 16.27)
 - mkdir 631 (time 1787334601.10 total 40.10 last 16.59)
 - mkdir 817 (time 1787334611.12 total 50.12 last 18.56)
 - mkdir 980 (time 1787334621.20 total 60.20 last 16.18)
total: 1000 mkdir in 62.38 seconds: 16.03 ops/second
 - mkdir 156 (time 1787334571.60 total 10.03 last 15.56)
 - mkdir 309 (time 1787334581.60 total 20.03 last 15.29)
 - mkdir 471 (time 1787334591.68 total 30.11 last 16.08)
 - mkdir 643 (time 1787334601.73 total 40.16 last 17.11)
 - mkdir 826 (time 1787334611.77 total 50.20 last 18.22)
 - mkdir 983 (time 1787334621.82 total 60.25 last 15.63)
total: 1000 mkdir in 62.02 seconds: 16.12 ops/second
 - mkdir 153 (time 1787334571.57 total 10.05 last 15.23)
 - mkdir 304 (time 1787334581.59 total 20.07 last 15.06)
 - mkdir 465 (time 1787334591.67 total 30.15 last 15.97)
 - mkdir 633 (time 1787334601.68 total 40.16 last 16.78)
 - mkdir 815 (time 1787334611.73 total 50.21 last 18.12)
 - mkdir 971 (time 1787334621.78 total 60.26 last 15.52)
total: 1000 mkdir in 63.38 seconds: 15.78 ops/second
 - mkdir 154 (time 1787334571.95 total 10.02 last 15.36)
 - mkdir 302 (time 1787334581.98 total 20.06 last 14.75)
 - mkdir 461 (time 1787334592.06 total 30.13 last 15.79)
 - mkdir 627 (time 1787334602.13 total 40.20 last 16.48)
 - mkdir 810 (time 1787334612.18 total 50.26 last 18.20)
 - mkdir 966 (time 1787334622.18 total 60.26 last 15.60)
total: 1000 mkdir in 64.32 seconds: 15.55 ops/second
 - mkdir 146 (time 1787334571.05 total 10.01 last 14.59)
 - mkdir 290 (time 1787334581.11 total 20.07 last 14.31)
 - mkdir 453 (time 1787334591.14 total 30.10 last 16.25)
 - mkdir 612 (time 1787334601.16 total 40.12 last 15.87)
 - mkdir 793 (time 1787334611.16 total 50.12 last 18.10)
 - mkdir 952 (time 1787334621.24 total 60.21 last 15.76)
total: 1000 mkdir in 65.72 seconds: 15.22 ops/second
 - mkdir 139 (time 1787334571.26 total 10.01 last 13.88)
 - mkdir 281 (time 1787334581.29 total 20.04 last 14.16)
 - mkdir 440 (time 1787334591.39 total 30.14 last 15.74)
 - mkdir 603 (time 1787334601.42 total 40.17 last 16.25)
 - mkdir 783 (time 1787334611.46 total 50.21 last 17.93)
 - mkdir 937 (time 1787334621.51 total 60.26 last 15.33)
total: 1000 mkdir in 66.53 seconds: 15.03 ops/second
Time for file creation 77 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.93 ops/second
 - mkdir 175 (time 1787335144.39 total 10.03 last 17.45)
 - mkdir 346 (time 1787335154.41 total 20.05 last 17.07)
 - mkdir 535 (time 1787335164.49 total 30.13 last 18.74)
 - mkdir 710 (time 1787335174.51 total 40.15 last 17.46)
 - mkdir 877 (time 1787335184.53 total 50.17 last 16.67)
total: 1000 mkdir in 57.49 seconds: 17.40 ops/second
 - mkdir 177 (time 1787335146.04 total 10.06 last 17.59)
 - mkdir 358 (time 1787335156.10 total 20.13 last 17.99)
 - mkdir 546 (time 1787335166.11 total 30.13 last 18.79)
 - mkdir 723 (time 1787335176.19 total 40.22 last 17.55)
 - mkdir 897 (time 1787335186.28 total 50.30 last 17.25)
total: 1000 mkdir in 56.30 seconds: 17.76 ops/second
 - mkdir 182 (time 1787335145.10 total 10.12 last 17.98)
 - mkdir 361 (time 1787335155.12 total 20.14 last 17.86)
 - mkdir 540 (time 1787335165.17 total 30.20 last 17.80)
 - mkdir 712 (time 1787335175.19 total 40.22 last 17.17)
 - mkdir 882 (time 1787335185.25 total 50.27 last 16.90)
total: 1000 mkdir in 58.39 seconds: 17.13 ops/second
 - mkdir 176 (time 1787335145.72 total 10.07 last 17.47)
 - mkdir 356 (time 1787335155.82 total 20.17 last 17.83)
 - mkdir 546 (time 1787335165.84 total 30.19 last 18.96)
 - mkdir 722 (time 1787335175.85 total 40.19 last 17.59)
 - mkdir 890 (time 1787335185.88 total 50.23 last 16.74)
total: 1000 mkdir in 57.92 seconds: 17.26 ops/second
 - mkdir 176 (time 1787335146.56 total 10.13 last 17.37)
 - mkdir 361 (time 1787335156.60 total 20.17 last 18.42)
 - mkdir 549 (time 1787335166.61 total 30.19 last 18.78)
 - mkdir 719 (time 1787335176.63 total 40.21 last 16.96)
 - mkdir 897 (time 1787335186.70 total 50.28 last 17.68)
total: 1000 mkdir in 57.41 seconds: 17.42 ops/second
 - mkdir 171 (time 1787335145.77 total 10.04 last 17.03)
 - mkdir 352 (time 1787335155.81 total 20.08 last 18.03)
 - mkdir 534 (time 1787335165.84 total 30.11 last 18.15)
 - mkdir 711 (time 1787335175.85 total 40.12 last 17.68)
 - mkdir 880 (time 1787335185.86 total 50.13 last 16.88)
total: 1000 mkdir in 58.48 seconds: 17.10 ops/second
 - mkdir 176 (time 1787335146.34 total 10.06 last 17.49)
 - mkdir 357 (time 1787335156.39 total 20.12 last 18.01)
 - mkdir 546 (time 1787335166.41 total 30.14 last 18.86)
 - mkdir 713 (time 1787335176.43 total 40.16 last 16.67)
 - mkdir 888 (time 1787335186.47 total 50.20 last 17.43)
total: 1000 mkdir in 58.20 seconds: 17.18 ops/second
 - mkdir 170 (time 1787335146.24 total 10.00 last 16.99)
 - mkdir 349 (time 1787335156.26 total 20.03 last 17.86)
 - mkdir 535 (time 1787335166.27 total 30.04 last 18.58)
 - mkdir 711 (time 1787335176.28 total 40.04 last 17.59)
 - mkdir 876 (time 1787335186.29 total 50.05 last 16.49)
total: 1000 mkdir in 58.75 seconds: 17.02 ops/second
 - mkdir 166 (time 1787335145.81 total 10.00 last 16.60)
 - mkdir 346 (time 1787335155.88 total 20.07 last 17.87)
 - mkdir 532 (time 1787335165.89 total 30.09 last 18.58)
 - mkdir 703 (time 1787335175.94 total 40.13 last 17.03)
 - mkdir 869 (time 1787335185.95 total 50.15 last 16.57)
 - mkdir 995 (time 1787335196.10 total 60.29 last 12.42)
total: 1000 mkdir in 60.81 seconds: 16.44 ops/second
 - mkdir 164 (time 1787335145.56 total 10.05 last 16.32)
 - mkdir 337 (time 1787335155.60 total 20.09 last 17.22)
 - mkdir 511 (time 1787335165.65 total 30.14 last 17.31)
 - mkdir 678 (time 1787335175.68 total 40.17 last 16.66)
 - mkdir 842 (time 1787335185.72 total 50.21 last 16.33)
 - mkdir 972 (time 1787335195.82 total 60.31 last 12.87)
total: 1000 mkdir in 62.72 seconds: 15.94 ops/second
Time for file creation 71 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787335204 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787335204 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787335205 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
Time for file removal 37 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8