== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:51:29 (1790963489)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.65 seconds: 15.41 ops/second
 - mkdir 141 (time 1790963512.63 total 10.01 last 14.09)
 - mkdir 290 (time 1790963522.65 total 20.03 last 14.87)
 - mkdir 463 (time 1790963532.67 total 30.05 last 17.27)
 - mkdir 646 (time 1790963542.70 total 40.08 last 18.24)
 - mkdir 877 (time 1790963552.74 total 50.11 last 23.02)
total: 1000 mkdir in 55.38 seconds: 18.06 ops/second
 - mkdir 148 (time 1790963512.01 total 10.04 last 14.74)
 - mkdir 294 (time 1790963522.04 total 20.07 last 14.56)
 - mkdir 462 (time 1790963532.06 total 30.08 last 16.77)
 - mkdir 638 (time 1790963542.10 total 40.13 last 17.52)
 - mkdir 857 (time 1790963552.10 total 50.13 last 21.89)
total: 1000 mkdir in 56.12 seconds: 17.82 ops/second
 - mkdir 151 (time 1790963511.41 total 10.03 last 15.06)
 - mkdir 292 (time 1790963521.46 total 20.08 last 14.03)
 - mkdir 463 (time 1790963531.51 total 30.13 last 17.01)
 - mkdir 634 (time 1790963541.55 total 40.17 last 17.03)
 - mkdir 848 (time 1790963551.58 total 50.20 last 21.33)
total: 1000 mkdir in 56.92 seconds: 17.57 ops/second
 - mkdir 139 (time 1790963512.71 total 10.06 last 13.82)
 - mkdir 290 (time 1790963522.72 total 20.07 last 15.08)
 - mkdir 462 (time 1790963532.77 total 30.12 last 17.11)
 - mkdir 639 (time 1790963542.80 total 40.15 last 17.65)
 - mkdir 872 (time 1790963552.84 total 50.19 last 23.21)
total: 1000 mkdir in 55.89 seconds: 17.89 ops/second
 - mkdir 152 (time 1790963511.23 total 10.06 last 15.10)
 - mkdir 288 (time 1790963521.26 total 20.10 last 13.56)
 - mkdir 454 (time 1790963531.27 total 30.11 last 16.58)
 - mkdir 619 (time 1790963541.31 total 40.14 last 16.44)
 - mkdir 828 (time 1790963551.33 total 50.16 last 20.86)
total: 1000 mkdir in 57.78 seconds: 17.31 ops/second
 - mkdir 142 (time 1790963512.78 total 10.02 last 14.17)
 - mkdir 293 (time 1790963522.82 total 20.06 last 15.05)
 - mkdir 469 (time 1790963532.82 total 30.06 last 17.59)
 - mkdir 638 (time 1790963542.85 total 40.09 last 16.85)
 - mkdir 866 (time 1790963552.91 total 50.15 last 22.68)
total: 1000 mkdir in 56.25 seconds: 17.78 ops/second
 - mkdir 145 (time 1790963511.89 total 10.15 last 14.29)
 - mkdir 286 (time 1790963521.90 total 20.16 last 14.09)
 - mkdir 456 (time 1790963531.94 total 30.20 last 16.93)
 - mkdir 630 (time 1790963541.99 total 40.25 last 17.31)
 - mkdir 847 (time 1790963552.03 total 50.28 last 21.63)
total: 1000 mkdir in 57.30 seconds: 17.45 ops/second
 - mkdir 141 (time 1790963512.63 total 10.00 last 14.10)
 - mkdir 280 (time 1790963522.73 total 20.10 last 13.76)
 - mkdir 453 (time 1790963532.74 total 30.11 last 17.29)
 - mkdir 626 (time 1790963542.77 total 40.14 last 17.25)
 - mkdir 856 (time 1790963552.78 total 50.15 last 22.98)
total: 1000 mkdir in 56.68 seconds: 17.64 ops/second
 - mkdir 138 (time 1790963512.65 total 10.01 last 13.79)
 - mkdir 282 (time 1790963522.74 total 20.10 last 14.27)
 - mkdir 455 (time 1790963532.78 total 30.14 last 17.23)
 - mkdir 631 (time 1790963542.80 total 40.16 last 17.57)
 - mkdir 858 (time 1790963552.80 total 50.16 last 22.70)
total: 1000 mkdir in 56.93 seconds: 17.57 ops/second
 - mkdir 139 (time 1790963511.83 total 10.05 last 13.83)
 - mkdir 271 (time 1790963521.86 total 20.09 last 13.16)
 - mkdir 435 (time 1790963531.87 total 30.10 last 16.38)
 - mkdir 604 (time 1790963541.90 total 40.13 last 16.84)
 - mkdir 816 (time 1790963551.91 total 50.13 last 21.19)
total: 1000 mkdir in 58.73 seconds: 17.03 ops/second
Time for file creation 68 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 9 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.55 seconds: 18.14 ops/second
 - mkdir 148 (time 1790964050.55 total 10.08 last 14.68)
 - mkdir 312 (time 1790964060.69 total 20.22 last 16.17)
 - mkdir 467 (time 1790964070.71 total 30.24 last 15.46)
 - mkdir 627 (time 1790964080.71 total 40.25 last 16.00)
 - mkdir 818 (time 1790964090.74 total 50.27 last 19.05)
total: 1000 mkdir in 60.15 seconds: 16.62 ops/second
 - mkdir 133 (time 1790964049.52 total 10.01 last 13.29)
 - mkdir 299 (time 1790964059.52 total 20.01 last 16.60)
 - mkdir 442 (time 1790964069.55 total 30.04 last 14.26)
 - mkdir 602 (time 1790964079.56 total 40.06 last 15.98)
 - mkdir 791 (time 1790964089.58 total 50.07 last 18.87)
 - mkdir 978 (time 1790964099.61 total 60.10 last 18.65)
total: 1000 mkdir in 61.80 seconds: 16.18 ops/second
 - mkdir 160 (time 1790964051.31 total 10.00 last 15.99)
 - mkdir 311 (time 1790964061.32 total 20.01 last 15.09)
 - mkdir 472 (time 1790964071.39 total 30.09 last 15.98)
 - mkdir 637 (time 1790964081.47 total 40.16 last 16.38)
 - mkdir 824 (time 1790964091.48 total 50.17 last 18.68)
total: 1000 mkdir in 60.04 seconds: 16.66 ops/second
 - mkdir 158 (time 1790964051.94 total 10.04 last 15.73)
 - mkdir 311 (time 1790964061.99 total 20.09 last 15.23)
 - mkdir 476 (time 1790964072.07 total 30.17 last 16.36)
 - mkdir 638 (time 1790964082.09 total 40.19 last 16.17)
 - mkdir 837 (time 1790964092.13 total 50.23 last 19.82)
total: 1000 mkdir in 59.74 seconds: 16.74 ops/second
 - mkdir 158 (time 1790964052.07 total 10.05 last 15.72)
 - mkdir 311 (time 1790964062.15 total 20.13 last 15.17)
 - mkdir 478 (time 1790964072.17 total 30.15 last 16.68)
 - mkdir 637 (time 1790964082.23 total 40.21 last 15.80)
 - mkdir 836 (time 1790964092.27 total 50.25 last 19.82)
 - mkdir 999 (time 1790964102.37 total 60.35 last 16.13)
total: 1000 mkdir in 60.35 seconds: 16.57 ops/second
 - mkdir 152 (time 1790964052.58 total 10.06 last 15.11)
 - mkdir 307 (time 1790964062.61 total 20.09 last 15.45)
 - mkdir 478 (time 1790964072.65 total 30.14 last 17.03)
 - mkdir 639 (time 1790964082.67 total 40.15 last 16.07)
 - mkdir 838 (time 1790964092.69 total 50.17 last 19.86)
total: 1000 mkdir in 60.13 seconds: 16.63 ops/second
 - mkdir 156 (time 1790964051.43 total 10.04 last 15.54)
 - mkdir 299 (time 1790964061.55 total 20.16 last 14.13)
 - mkdir 461 (time 1790964071.57 total 30.18 last 16.17)
 - mkdir 625 (time 1790964081.63 total 40.24 last 16.31)
 - mkdir 817 (time 1790964091.64 total 50.25 last 19.18)
 - mkdir 990 (time 1790964101.72 total 60.33 last 17.15)
total: 1000 mkdir in 61.31 seconds: 16.31 ops/second
 - mkdir 155 (time 1790964051.50 total 10.00 last 15.49)
 - mkdir 304 (time 1790964061.58 total 20.09 last 14.77)
 - mkdir 465 (time 1790964071.60 total 30.11 last 16.07)
 - mkdir 626 (time 1790964081.65 total 40.15 last 16.02)
 - mkdir 814 (time 1790964091.66 total 50.17 last 18.78)
 - mkdir 988 (time 1790964101.75 total 60.26 last 17.23)
total: 1000 mkdir in 61.53 seconds: 16.25 ops/second
 - mkdir 147 (time 1790964051.98 total 10.06 last 14.61)
 - mkdir 296 (time 1790964062.02 total 20.10 last 14.84)
 - mkdir 453 (time 1790964072.10 total 30.18 last 15.57)
 - mkdir 618 (time 1790964082.15 total 40.23 last 16.42)
 - mkdir 816 (time 1790964092.18 total 50.26 last 19.75)
 - mkdir 982 (time 1790964102.29 total 60.37 last 16.41)
total: 1000 mkdir in 62.10 seconds: 16.10 ops/second
 - mkdir 141 (time 1790964051.72 total 10.01 last 14.09)
 - mkdir 281 (time 1790964061.73 total 20.02 last 13.98)
 - mkdir 437 (time 1790964071.79 total 30.08 last 15.51)
 - mkdir 599 (time 1790964081.87 total 40.16 last 16.08)
 - mkdir 795 (time 1790964091.92 total 50.22 last 19.49)
 - mkdir 963 (time 1790964101.99 total 60.28 last 16.69)
total: 1000 mkdir in 63.88 seconds: 15.65 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790964113 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790964114 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964114 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790964114 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964114 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964114 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964114 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964115 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964115 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790964115 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8