== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 18:45:23 (1787870723)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.38 seconds: 26.41 ops/second
 - mkdir 232 (time 1787870747.30 total 10.02 last 23.14)
 - mkdir 445 (time 1787870757.33 total 20.06 last 21.24)
 - mkdir 675 (time 1787870767.36 total 30.08 last 22.93)
 - mkdir 907 (time 1787870777.37 total 40.09 last 23.18)
total: 1000 mkdir in 44.96 seconds: 22.24 ops/second
 - mkdir 216 (time 1787870745.84 total 10.04 last 21.51)
 - mkdir 415 (time 1787870755.86 total 20.07 last 19.85)
 - mkdir 632 (time 1787870765.87 total 30.07 last 21.69)
 - mkdir 864 (time 1787870775.90 total 40.10 last 23.14)
total: 1000 mkdir in 47.49 seconds: 21.06 ops/second
 - mkdir 217 (time 1787870747.13 total 10.06 last 21.58)
 - mkdir 429 (time 1787870757.18 total 20.10 last 21.11)
 - mkdir 649 (time 1787870767.19 total 30.11 last 21.98)
 - mkdir 885 (time 1787870777.19 total 40.11 last 23.60)
total: 1000 mkdir in 46.25 seconds: 21.62 ops/second
 - mkdir 214 (time 1787870746.59 total 10.03 last 21.34)
 - mkdir 414 (time 1787870756.60 total 20.04 last 19.98)
 - mkdir 645 (time 1787870766.60 total 30.05 last 23.08)
 - mkdir 868 (time 1787870776.62 total 40.07 last 22.25)
total: 1000 mkdir in 47.42 seconds: 21.09 ops/second
 - mkdir 214 (time 1787870746.53 total 10.04 last 21.32)
 - mkdir 412 (time 1787870756.56 total 20.07 last 19.74)
 - mkdir 634 (time 1787870766.57 total 30.08 last 22.19)
 - mkdir 860 (time 1787870776.58 total 40.09 last 22.57)
total: 1000 mkdir in 47.99 seconds: 20.84 ops/second
 - mkdir 208 (time 1787870745.82 total 10.03 last 20.73)
 - mkdir 405 (time 1787870755.86 total 20.07 last 19.62)
 - mkdir 617 (time 1787870765.87 total 30.08 last 21.18)
 - mkdir 846 (time 1787870775.89 total 40.10 last 22.85)
total: 1000 mkdir in 48.90 seconds: 20.45 ops/second
 - mkdir 214 (time 1787870747.08 total 10.05 last 21.29)
 - mkdir 418 (time 1787870757.10 total 20.07 last 20.35)
 - mkdir 640 (time 1787870767.17 total 30.14 last 22.07)
 - mkdir 869 (time 1787870777.18 total 40.15 last 22.86)
total: 1000 mkdir in 48.25 seconds: 20.72 ops/second
 - mkdir 226 (time 1787870747.56 total 10.04 last 22.51)
 - mkdir 434 (time 1787870757.57 total 20.05 last 20.78)
 - mkdir 653 (time 1787870767.60 total 30.08 last 21.84)
 - mkdir 880 (time 1787870777.61 total 40.09 last 22.66)
total: 1000 mkdir in 47.97 seconds: 20.85 ops/second
 - mkdir 217 (time 1787870747.07 total 10.04 last 21.60)
 - mkdir 414 (time 1787870757.07 total 20.05 last 19.69)
 - mkdir 630 (time 1787870767.12 total 30.10 last 21.50)
 - mkdir 859 (time 1787870777.15 total 40.13 last 22.83)
total: 1000 mkdir in 49.86 seconds: 20.06 ops/second
 - mkdir 214 (time 1787870746.99 total 10.03 last 21.33)
 - mkdir 409 (time 1787870757.00 total 20.04 last 19.48)
 - mkdir 622 (time 1787870767.07 total 30.11 last 21.15)
 - mkdir 847 (time 1787870777.09 total 40.12 last 22.48)
 - mkdir 994 (time 1787870787.15 total 50.19 last 14.60)
total: 1000 mkdir in 50.62 seconds: 19.76 ops/second
Time for file creation 62 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.47 seconds: 21.19 ops/second
 - mkdir 253 (time 1787871248.00 total 10.00 last 25.29)
 - mkdir 511 (time 1787871258.02 total 20.02 last 25.75)
 - mkdir 739 (time 1787871268.03 total 30.04 last 22.77)
 - mkdir 947 (time 1787871278.06 total 40.07 last 20.74)
total: 1000 mkdir in 42.82 seconds: 23.35 ops/second
 - mkdir 272 (time 1787871249.24 total 10.02 last 27.15)
 - mkdir 512 (time 1787871259.28 total 20.05 last 23.92)
 - mkdir 739 (time 1787871269.29 total 30.06 last 22.68)
 - mkdir 947 (time 1787871279.30 total 40.08 last 20.77)
total: 1000 mkdir in 44.36 seconds: 22.54 ops/second
 - mkdir 273 (time 1787871249.51 total 10.00 last 27.29)
 - mkdir 511 (time 1787871259.53 total 20.02 last 23.76)
 - mkdir 730 (time 1787871269.56 total 30.06 last 21.82)
 - mkdir 944 (time 1787871279.57 total 40.06 last 21.39)
total: 1000 mkdir in 44.92 seconds: 22.26 ops/second
 - mkdir 262 (time 1787871248.83 total 10.01 last 26.17)
 - mkdir 499 (time 1787871258.84 total 20.03 last 23.66)
 - mkdir 717 (time 1787871268.86 total 30.04 last 21.77)
 - mkdir 928 (time 1787871278.87 total 40.05 last 21.08)
total: 1000 mkdir in 45.74 seconds: 21.86 ops/second
 - mkdir 250 (time 1787871248.58 total 10.00 last 24.99)
 - mkdir 485 (time 1787871258.66 total 20.09 last 23.30)
 - mkdir 706 (time 1787871268.70 total 30.13 last 22.01)
 - mkdir 919 (time 1787871278.71 total 40.14 last 21.28)
total: 1000 mkdir in 46.39 seconds: 21.55 ops/second
 - mkdir 264 (time 1787871249.25 total 10.02 last 26.35)
 - mkdir 494 (time 1787871259.25 total 20.02 last 22.99)
 - mkdir 711 (time 1787871269.27 total 30.04 last 21.66)
 - mkdir 931 (time 1787871279.28 total 40.05 last 21.98)
total: 1000 mkdir in 45.79 seconds: 21.84 ops/second
 - mkdir 280 (time 1787871249.59 total 10.06 last 27.83)
 - mkdir 515 (time 1787871259.64 total 20.11 last 23.39)
 - mkdir 737 (time 1787871269.69 total 30.16 last 22.09)
 - mkdir 941 (time 1787871279.76 total 40.23 last 20.26)
total: 1000 mkdir in 45.57 seconds: 21.95 ops/second
 - mkdir 272 (time 1787871249.56 total 10.03 last 27.11)
 - mkdir 503 (time 1787871259.59 total 20.05 last 23.05)
 - mkdir 727 (time 1787871269.60 total 30.07 last 22.36)
 - mkdir 938 (time 1787871279.65 total 40.12 last 21.00)
total: 1000 mkdir in 45.57 seconds: 21.94 ops/second
 - mkdir 270 (time 1787871249.40 total 10.02 last 26.94)
 - mkdir 497 (time 1787871259.42 total 20.04 last 22.65)
 - mkdir 722 (time 1787871269.45 total 30.07 last 22.43)
 - mkdir 935 (time 1787871279.48 total 40.11 last 21.22)
total: 1000 mkdir in 45.95 seconds: 21.76 ops/second
 - mkdir 255 (time 1787871249.20 total 10.02 last 25.46)
 - mkdir 478 (time 1787871259.22 total 20.03 last 22.27)
 - mkdir 689 (time 1787871269.24 total 30.05 last 21.05)
 - mkdir 906 (time 1787871279.25 total 40.06 last 21.68)
total: 1000 mkdir in 47.94 seconds: 20.86 ops/second
Time for file creation 59 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787871294 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787871296 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787871296 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787871296 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787871297 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787871297 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787871297 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787871297 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787871298 ; total 1 ; last 1)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1787871297 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
Time for file removal 38 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8