== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:09:27 (1786057767)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.76 seconds: 13.18 ops/second
 - mkdir 187 (time 1786057788.51 total 10.02 last 18.66)
 - mkdir 357 (time 1786057798.64 total 20.14 last 16.79)
 - mkdir 484 (time 1786057808.70 total 30.21 last 12.61)
 - mkdir 591 (time 1786057818.76 total 40.26 last 10.64)
 - mkdir 715 (time 1786057828.89 total 50.40 last 12.23)
 - mkdir 860 (time 1786057838.95 total 60.46 last 14.42)
total: 1000 mkdir in 69.14 seconds: 14.46 ops/second
 - mkdir 187 (time 1786057788.78 total 10.02 last 18.66)
 - mkdir 359 (time 1786057798.83 total 20.07 last 17.11)
 - mkdir 477 (time 1786057808.86 total 30.10 last 11.77)
 - mkdir 585 (time 1786057818.87 total 40.11 last 10.79)
 - mkdir 708 (time 1786057828.97 total 50.21 last 12.18)
 - mkdir 855 (time 1786057839.04 total 60.28 last 14.59)
total: 1000 mkdir in 68.99 seconds: 14.50 ops/second
 - mkdir 206 (time 1786057790.35 total 10.01 last 20.58)
 - mkdir 363 (time 1786057800.40 total 20.07 last 15.61)
 - mkdir 473 (time 1786057810.41 total 30.07 last 10.99)
 - mkdir 587 (time 1786057820.48 total 40.15 last 11.32)
 - mkdir 720 (time 1786057830.52 total 50.18 last 13.26)
 - mkdir 864 (time 1786057840.56 total 60.22 last 14.34)
total: 1000 mkdir in 67.77 seconds: 14.76 ops/second
 - mkdir 201 (time 1786057790.10 total 10.02 last 20.07)
 - mkdir 360 (time 1786057800.11 total 20.02 last 15.90)
 - mkdir 468 (time 1786057810.11 total 30.03 last 10.79)
 - mkdir 581 (time 1786057820.20 total 40.11 last 11.20)
 - mkdir 711 (time 1786057830.20 total 50.12 last 13.00)
 - mkdir 853 (time 1786057840.34 total 60.25 last 14.00)
total: 1000 mkdir in 69.74 seconds: 14.34 ops/second
 - mkdir 209 (time 1786057791.04 total 10.07 last 20.76)
 - mkdir 362 (time 1786057801.12 total 20.15 last 15.18)
 - mkdir 473 (time 1786057811.14 total 30.17 last 11.08)
 - mkdir 587 (time 1786057821.29 total 40.31 last 11.24)
 - mkdir 722 (time 1786057831.32 total 50.35 last 13.45)
 - mkdir 863 (time 1786057841.38 total 60.41 last 14.01)
total: 1000 mkdir in 69.50 seconds: 14.39 ops/second
 - mkdir 206 (time 1786057790.61 total 10.02 last 20.56)
 - mkdir 356 (time 1786057800.61 total 20.03 last 14.99)
 - mkdir 462 (time 1786057810.66 total 30.07 last 10.55)
 - mkdir 575 (time 1786057820.74 total 40.15 last 11.21)
 - mkdir 701 (time 1786057830.77 total 50.19 last 12.56)
 - mkdir 841 (time 1786057840.80 total 60.22 last 13.96)
 - mkdir 993 (time 1786057850.83 total 70.25 last 15.15)
total: 1000 mkdir in 70.86 seconds: 14.11 ops/second
 - mkdir 193 (time 1786057790.14 total 10.01 last 19.29)
 - mkdir 345 (time 1786057800.18 total 20.04 last 15.15)
 - mkdir 456 (time 1786057810.22 total 30.08 last 11.05)
 - mkdir 567 (time 1786057820.30 total 40.16 last 11.01)
 - mkdir 690 (time 1786057830.30 total 50.17 last 12.29)
 - mkdir 833 (time 1786057840.32 total 60.18 last 14.28)
 - mkdir 983 (time 1786057850.35 total 70.21 last 14.95)
total: 1000 mkdir in 72.19 seconds: 13.85 ops/second
 - mkdir 189 (time 1786057790.16 total 10.01 last 18.88)
 - mkdir 346 (time 1786057800.16 total 20.01 last 15.70)
 - mkdir 446 (time 1786057810.37 total 30.23 last 9.79)
 - mkdir 557 (time 1786057820.48 total 40.34 last 10.98)
 - mkdir 686 (time 1786057830.50 total 50.36 last 12.88)
 - mkdir 824 (time 1786057840.54 total 60.40 last 13.74)
 - mkdir 971 (time 1786057850.60 total 70.45 last 14.62)
total: 1000 mkdir in 73.41 seconds: 13.62 ops/second
 - mkdir 196 (time 1786057790.47 total 10.03 last 19.55)
 - mkdir 349 (time 1786057800.51 total 20.07 last 15.24)
 - mkdir 449 (time 1786057810.55 total 30.11 last 9.95)
 - mkdir 558 (time 1786057820.55 total 40.11 last 10.90)
 - mkdir 684 (time 1786057830.56 total 50.12 last 12.59)
 - mkdir 819 (time 1786057840.69 total 60.25 last 13.33)
 - mkdir 968 (time 1786057850.75 total 70.30 last 14.82)
total: 1000 mkdir in 73.20 seconds: 13.66 ops/second
 - mkdir 200 (time 1786057790.96 total 10.08 last 19.83)
 - mkdir 341 (time 1786057801.01 total 20.13 last 14.03)
 - mkdir 441 (time 1786057811.05 total 30.17 last 9.96)
 - mkdir 544 (time 1786057821.08 total 40.20 last 10.26)
 - mkdir 668 (time 1786057831.10 total 50.22 last 12.38)
 - mkdir 802 (time 1786057841.16 total 60.29 last 13.32)
 - mkdir 948 (time 1786057851.22 total 70.34 last 14.52)
total: 1000 mkdir in 74.57 seconds: 13.41 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 23.59 ops/second
 - mkdir 153 (time 1786058342.61 total 10.06 last 15.22)
 - mkdir 378 (time 1786058352.64 total 20.09 last 22.43)
 - mkdir 546 (time 1786058362.70 total 30.14 last 16.71)
 - mkdir 727 (time 1786058372.70 total 40.14 last 18.09)
 - mkdir 871 (time 1786058382.71 total 50.15 last 14.38)
total: 1000 mkdir in 59.15 seconds: 16.91 ops/second
 - mkdir 190 (time 1786058345.34 total 10.02 last 18.97)
 - mkdir 393 (time 1786058355.37 total 20.05 last 20.23)
 - mkdir 580 (time 1786058365.41 total 30.10 last 18.62)
 - mkdir 745 (time 1786058375.42 total 40.10 last 16.49)
 - mkdir 878 (time 1786058385.51 total 50.19 last 13.19)
total: 1000 mkdir in 59.01 seconds: 16.95 ops/second
 - mkdir 190 (time 1786058344.88 total 10.05 last 18.90)
 - mkdir 386 (time 1786058354.88 total 20.05 last 19.60)
 - mkdir 570 (time 1786058364.92 total 30.10 last 18.32)
 - mkdir 736 (time 1786058374.95 total 40.13 last 16.55)
 - mkdir 873 (time 1786058384.97 total 50.14 last 13.67)
total: 1000 mkdir in 59.99 seconds: 16.67 ops/second
 - mkdir 178 (time 1786058344.48 total 10.03 last 17.75)
 - mkdir 378 (time 1786058354.53 total 20.07 last 19.91)
 - mkdir 558 (time 1786058364.54 total 30.09 last 17.97)
 - mkdir 725 (time 1786058374.61 total 40.16 last 16.58)
 - mkdir 862 (time 1786058384.64 total 50.19 last 13.66)
 - mkdir 997 (time 1786058394.68 total 60.22 last 13.45)
total: 1000 mkdir in 60.53 seconds: 16.52 ops/second
 - mkdir 185 (time 1786058344.88 total 10.02 last 18.47)
 - mkdir 379 (time 1786058354.89 total 20.02 last 19.39)
 - mkdir 557 (time 1786058364.89 total 30.03 last 17.79)
 - mkdir 728 (time 1786058374.93 total 40.07 last 17.03)
 - mkdir 866 (time 1786058384.94 total 50.07 last 13.80)
 - mkdir 999 (time 1786058395.04 total 60.17 last 13.17)
total: 1000 mkdir in 60.17 seconds: 16.62 ops/second
 - mkdir 191 (time 1786058345.34 total 10.01 last 19.08)
 - mkdir 385 (time 1786058355.35 total 20.03 last 19.37)
 - mkdir 570 (time 1786058365.43 total 30.10 last 18.37)
 - mkdir 730 (time 1786058375.50 total 40.17 last 15.89)
 - mkdir 865 (time 1786058385.51 total 50.18 last 13.49)
 - mkdir 995 (time 1786058395.52 total 60.19 last 12.99)
total: 1000 mkdir in 60.84 seconds: 16.44 ops/second
 - mkdir 191 (time 1786058345.60 total 10.01 last 19.08)
 - mkdir 380 (time 1786058355.70 total 20.11 last 18.71)
 - mkdir 565 (time 1786058365.75 total 30.16 last 18.41)
 - mkdir 730 (time 1786058375.78 total 40.19 last 16.45)
 - mkdir 865 (time 1786058385.86 total 50.27 last 13.39)
 - mkdir 994 (time 1786058395.90 total 60.31 last 12.85)
total: 1000 mkdir in 61.03 seconds: 16.38 ops/second
 - mkdir 192 (time 1786058345.76 total 10.00 last 19.20)
 - mkdir 382 (time 1786058355.80 total 20.04 last 18.92)
 - mkdir 561 (time 1786058365.82 total 30.07 last 17.85)
 - mkdir 725 (time 1786058375.89 total 40.13 last 16.30)
 - mkdir 859 (time 1786058385.89 total 50.14 last 13.40)
 - mkdir 990 (time 1786058396.00 total 60.25 last 12.96)
total: 1000 mkdir in 61.77 seconds: 16.19 ops/second
 - mkdir 174 (time 1786058344.51 total 10.01 last 17.38)
 - mkdir 364 (time 1786058354.54 total 20.04 last 18.95)
 - mkdir 542 (time 1786058364.60 total 30.10 last 17.68)
 - mkdir 707 (time 1786058374.64 total 40.14 last 16.44)
 - mkdir 842 (time 1786058384.68 total 50.18 last 13.44)
 - mkdir 976 (time 1786058394.75 total 60.25 last 13.32)
total: 1000 mkdir in 63.32 seconds: 15.79 ops/second
 - mkdir 174 (time 1786058344.73 total 10.01 last 17.38)
 - mkdir 363 (time 1786058354.73 total 20.01 last 18.90)
 - mkdir 536 (time 1786058364.80 total 30.08 last 17.19)
 - mkdir 701 (time 1786058374.88 total 40.16 last 16.36)
 - mkdir 835 (time 1786058384.88 total 50.16 last 13.40)
 - mkdir 966 (time 1786058394.88 total 60.16 last 13.10)
total: 1000 mkdir in 64.56 seconds: 15.49 ops/second
Time for file creation 74 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786058410 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786058412 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1786058412 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786058411 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786058411 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786058412 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786058413 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786058413 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786058412 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786058413 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 57 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8