== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:40:43 (1787881243)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.58 ops/second
 - mkdir 149 (time 1787881264.54 total 10.01 last 14.88)
 - mkdir 360 (time 1787881274.57 total 20.04 last 21.04)
 - mkdir 542 (time 1787881284.61 total 30.09 last 18.12)
 - mkdir 814 (time 1787881294.68 total 40.16 last 27.02)
 - mkdir 989 (time 1787881304.72 total 50.20 last 17.43)
total: 1000 mkdir in 50.72 seconds: 19.72 ops/second
 - mkdir 140 (time 1787881264.53 total 10.00 last 14.00)
 - mkdir 348 (time 1787881274.57 total 20.04 last 20.72)
 - mkdir 528 (time 1787881284.59 total 30.07 last 17.95)
 - mkdir 802 (time 1787881294.65 total 40.13 last 27.24)
 - mkdir 977 (time 1787881304.67 total 50.14 last 17.48)
total: 1000 mkdir in 52.04 seconds: 19.22 ops/second
 - mkdir 167 (time 1787881266.59 total 10.05 last 16.61)
 - mkdir 379 (time 1787881276.60 total 20.06 last 21.19)
 - mkdir 593 (time 1787881286.60 total 30.06 last 21.38)
 - mkdir 836 (time 1787881296.65 total 40.11 last 24.18)
 - mkdir 999 (time 1787881306.78 total 50.24 last 16.09)
total: 1000 mkdir in 50.24 seconds: 19.90 ops/second
 - mkdir 163 (time 1787881266.76 total 10.07 last 16.18)
 - mkdir 372 (time 1787881276.78 total 20.10 last 20.84)
 - mkdir 586 (time 1787881286.81 total 30.13 last 21.34)
 - mkdir 826 (time 1787881296.88 total 40.20 last 23.84)
 - mkdir 995 (time 1787881306.91 total 50.22 last 16.86)
total: 1000 mkdir in 50.69 seconds: 19.73 ops/second
 - mkdir 160 (time 1787881266.31 total 10.02 last 15.97)
 - mkdir 361 (time 1787881276.33 total 20.05 last 20.05)
 - mkdir 573 (time 1787881286.41 total 30.12 last 21.05)
 - mkdir 821 (time 1787881296.42 total 40.13 last 24.76)
 - mkdir 991 (time 1787881306.48 total 50.19 last 16.91)
total: 1000 mkdir in 51.15 seconds: 19.55 ops/second
 - mkdir 161 (time 1787881266.04 total 10.06 last 16.00)
 - mkdir 365 (time 1787881276.06 total 20.09 last 20.35)
 - mkdir 574 (time 1787881286.07 total 30.10 last 20.88)
 - mkdir 819 (time 1787881296.15 total 40.17 last 24.32)
 - mkdir 988 (time 1787881306.17 total 50.20 last 16.86)
total: 1000 mkdir in 51.55 seconds: 19.40 ops/second
 - mkdir 155 (time 1787881266.46 total 10.00 last 15.49)
 - mkdir 358 (time 1787881276.48 total 20.02 last 20.26)
 - mkdir 566 (time 1787881286.50 total 30.04 last 20.78)
 - mkdir 808 (time 1787881296.53 total 40.07 last 24.11)
 - mkdir 979 (time 1787881306.64 total 50.18 last 16.91)
total: 1000 mkdir in 52.70 seconds: 18.98 ops/second
 - mkdir 152 (time 1787881266.08 total 10.03 last 15.16)
 - mkdir 352 (time 1787881276.19 total 20.14 last 19.78)
 - mkdir 562 (time 1787881286.21 total 30.16 last 20.95)
 - mkdir 806 (time 1787881296.23 total 40.18 last 24.35)
 - mkdir 974 (time 1787881306.31 total 50.25 last 16.68)
total: 1000 mkdir in 53.42 seconds: 18.72 ops/second
 - mkdir 140 (time 1787881265.35 total 10.00 last 14.00)
 - mkdir 337 (time 1787881275.42 total 20.07 last 19.56)
 - mkdir 528 (time 1787881285.45 total 30.10 last 19.05)
 - mkdir 783 (time 1787881295.46 total 40.11 last 25.47)
 - mkdir 960 (time 1787881305.58 total 50.23 last 17.49)
total: 1000 mkdir in 54.88 seconds: 18.22 ops/second
 - mkdir 151 (time 1787881266.18 total 10.01 last 15.08)
 - mkdir 344 (time 1787881276.21 total 20.05 last 19.23)
 - mkdir 553 (time 1787881286.22 total 30.05 last 20.89)
 - mkdir 797 (time 1787881296.28 total 40.11 last 24.26)
 - mkdir 964 (time 1787881306.37 total 50.20 last 16.55)
total: 1000 mkdir in 54.54 seconds: 18.34 ops/second
Time for file creation 66 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.70 ops/second
 - mkdir 179 (time 1787881843.90 total 10.01 last 17.88)
 - mkdir 358 (time 1787881853.93 total 20.05 last 17.84)
 - mkdir 545 (time 1787881863.99 total 30.10 last 18.60)
 - mkdir 715 (time 1787881874.07 total 40.18 last 16.87)
 - mkdir 893 (time 1787881884.07 total 50.18 last 17.80)
total: 1000 mkdir in 56.88 seconds: 17.58 ops/second
 - mkdir 180 (time 1787881844.58 total 10.07 last 17.87)
 - mkdir 359 (time 1787881854.62 total 20.12 last 17.82)
 - mkdir 550 (time 1787881864.63 total 30.12 last 19.09)
 - mkdir 721 (time 1787881874.63 total 40.13 last 17.09)
 - mkdir 890 (time 1787881884.69 total 50.19 last 16.80)
total: 1000 mkdir in 57.17 seconds: 17.49 ops/second
 - mkdir 179 (time 1787881843.21 total 10.02 last 17.86)
 - mkdir 358 (time 1787881853.23 total 20.04 last 17.88)
 - mkdir 531 (time 1787881863.30 total 30.11 last 17.17)
 - mkdir 696 (time 1787881873.34 total 40.15 last 16.43)
 - mkdir 871 (time 1787881883.34 total 50.15 last 17.50)
total: 1000 mkdir in 58.75 seconds: 17.02 ops/second
 - mkdir 177 (time 1787881844.31 total 10.03 last 17.64)
 - mkdir 349 (time 1787881854.36 total 20.09 last 17.10)
 - mkdir 534 (time 1787881864.38 total 30.11 last 18.46)
 - mkdir 705 (time 1787881874.39 total 40.12 last 17.08)
 - mkdir 883 (time 1787881884.44 total 50.16 last 17.73)
total: 1000 mkdir in 57.97 seconds: 17.25 ops/second
 - mkdir 189 (time 1787881844.58 total 10.05 last 18.81)
 - mkdir 360 (time 1787881854.58 total 20.05 last 17.09)
 - mkdir 540 (time 1787881864.59 total 30.06 last 17.99)
 - mkdir 711 (time 1787881874.63 total 40.10 last 17.03)
 - mkdir 882 (time 1787881884.65 total 50.13 last 17.06)
total: 1000 mkdir in 58.20 seconds: 17.18 ops/second
 - mkdir 183 (time 1787881844.17 total 10.06 last 18.20)
 - mkdir 353 (time 1787881854.23 total 20.11 last 16.90)
 - mkdir 535 (time 1787881864.30 total 30.18 last 18.07)
 - mkdir 698 (time 1787881874.32 total 40.21 last 16.26)
 - mkdir 872 (time 1787881884.34 total 50.22 last 17.38)
total: 1000 mkdir in 59.49 seconds: 16.81 ops/second
 - mkdir 173 (time 1787881843.84 total 10.02 last 17.27)
 - mkdir 343 (time 1787881853.90 total 20.08 last 16.89)
 - mkdir 518 (time 1787881863.91 total 30.09 last 17.49)
 - mkdir 686 (time 1787881873.95 total 40.13 last 16.73)
 - mkdir 862 (time 1787881883.98 total 50.17 last 17.54)
total: 1000 mkdir in 60.07 seconds: 16.65 ops/second
 - mkdir 174 (time 1787881844.52 total 10.01 last 17.38)
 - mkdir 343 (time 1787881854.53 total 20.02 last 16.88)
 - mkdir 530 (time 1787881864.56 total 30.05 last 18.64)
 - mkdir 695 (time 1787881874.62 total 40.11 last 16.40)
 - mkdir 871 (time 1787881884.67 total 50.17 last 17.51)
 - mkdir 999 (time 1787881894.83 total 60.32 last 12.60)
total: 1000 mkdir in 60.32 seconds: 16.58 ops/second
 - mkdir 180 (time 1787881844.93 total 10.01 last 17.97)
 - mkdir 352 (time 1787881854.96 total 20.05 last 17.14)
 - mkdir 535 (time 1787881864.97 total 30.06 last 18.28)
 - mkdir 695 (time 1787881874.99 total 40.08 last 15.97)
 - mkdir 867 (time 1787881885.02 total 50.11 last 17.15)
total: 1000 mkdir in 59.98 seconds: 16.67 ops/second
 - mkdir 172 (time 1787881844.36 total 10.03 last 17.15)
 - mkdir 334 (time 1787881854.42 total 20.09 last 16.11)
 - mkdir 509 (time 1787881864.43 total 30.11 last 17.47)
 - mkdir 678 (time 1787881874.47 total 40.15 last 16.83)
 - mkdir 857 (time 1787881884.48 total 50.15 last 17.88)
 - mkdir 992 (time 1787881894.56 total 60.23 last 13.39)
total: 1000 mkdir in 60.94 seconds: 16.41 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787881903 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787881904 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787881904 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787881905 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8