== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:38:55 (1786048735)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.85 seconds: 11.75 ops/second
 - mkdir 135 (time 1786048762.47 total 10.01 last 13.49)
 - mkdir 279 (time 1786048772.48 total 20.02 last 14.39)
 - mkdir 447 (time 1786048782.53 total 30.07 last 16.72)
 - mkdir 644 (time 1786048792.53 total 40.07 last 19.70)
 - mkdir 828 (time 1786048802.56 total 50.10 last 18.35)
 - mkdir 996 (time 1786048812.60 total 60.14 last 16.73)
total: 1000 mkdir in 60.36 seconds: 16.57 ops/second
 - mkdir 133 (time 1786048764.30 total 10.03 last 13.25)
 - mkdir 298 (time 1786048774.32 total 20.05 last 16.47)
 - mkdir 463 (time 1786048784.35 total 30.08 last 16.45)
 - mkdir 661 (time 1786048794.36 total 40.09 last 19.78)
 - mkdir 856 (time 1786048804.37 total 50.10 last 19.48)
total: 1000 mkdir in 58.93 seconds: 16.97 ops/second
 - mkdir 135 (time 1786048763.79 total 10.05 last 13.43)
 - mkdir 299 (time 1786048773.80 total 20.05 last 16.39)
 - mkdir 461 (time 1786048783.83 total 30.08 last 16.15)
 - mkdir 660 (time 1786048793.89 total 40.14 last 19.78)
 - mkdir 843 (time 1786048803.91 total 50.17 last 18.25)
total: 1000 mkdir in 59.59 seconds: 16.78 ops/second
 - mkdir 136 (time 1786048762.71 total 10.08 last 13.50)
 - mkdir 288 (time 1786048772.86 total 20.23 last 14.97)
 - mkdir 446 (time 1786048782.89 total 30.26 last 15.76)
 - mkdir 637 (time 1786048792.92 total 40.29 last 19.03)
 - mkdir 822 (time 1786048802.93 total 50.30 last 18.49)
 - mkdir 993 (time 1786048813.00 total 60.36 last 16.98)
total: 1000 mkdir in 61.01 seconds: 16.39 ops/second
 - mkdir 129 (time 1786048765.13 total 10.05 last 12.83)
 - mkdir 296 (time 1786048775.16 total 20.08 last 16.65)
 - mkdir 463 (time 1786048785.17 total 30.09 last 16.68)
 - mkdir 643 (time 1786048795.17 total 40.10 last 17.99)
 - mkdir 836 (time 1786048805.19 total 50.12 last 19.26)
 - mkdir 983 (time 1786048815.21 total 60.14 last 14.67)
total: 1000 mkdir in 61.92 seconds: 16.15 ops/second
 - mkdir 128 (time 1786048763.93 total 10.02 last 12.78)
 - mkdir 287 (time 1786048773.96 total 20.05 last 15.84)
 - mkdir 443 (time 1786048783.97 total 30.06 last 15.59)
 - mkdir 633 (time 1786048793.97 total 40.06 last 18.99)
 - mkdir 814 (time 1786048804.01 total 50.10 last 18.04)
 - mkdir 968 (time 1786048814.06 total 60.16 last 15.31)
total: 1000 mkdir in 63.66 seconds: 15.71 ops/second
 - mkdir 126 (time 1786048765.24 total 10.01 last 12.59)
 - mkdir 292 (time 1786048775.28 total 20.05 last 16.53)
 - mkdir 460 (time 1786048785.29 total 30.06 last 16.78)
 - mkdir 643 (time 1786048795.33 total 40.10 last 18.24)
 - mkdir 831 (time 1786048805.35 total 50.12 last 18.76)
 - mkdir 979 (time 1786048815.40 total 60.17 last 14.73)
total: 1000 mkdir in 62.55 seconds: 15.99 ops/second
 - mkdir 122 (time 1786048764.56 total 10.08 last 12.10)
 - mkdir 279 (time 1786048774.57 total 20.09 last 15.68)
 - mkdir 441 (time 1786048784.60 total 30.12 last 16.16)
 - mkdir 624 (time 1786048794.65 total 40.17 last 18.21)
 - mkdir 808 (time 1786048804.69 total 50.20 last 18.33)
 - mkdir 951 (time 1786048814.71 total 60.23 last 14.26)
total: 1000 mkdir in 65.41 seconds: 15.29 ops/second
 - mkdir 125 (time 1786048765.24 total 10.06 last 12.42)
 - mkdir 291 (time 1786048775.31 total 20.12 last 16.50)
 - mkdir 455 (time 1786048785.34 total 30.15 last 16.35)
 - mkdir 636 (time 1786048795.37 total 40.19 last 18.04)
 - mkdir 821 (time 1786048805.40 total 50.22 last 18.45)
 - mkdir 958 (time 1786048815.46 total 60.28 last 13.61)
total: 1000 mkdir in 64.81 seconds: 15.43 ops/second
 - mkdir 119 (time 1786048763.98 total 10.02 last 11.88)
 - mkdir 272 (time 1786048774.01 total 20.05 last 15.25)
 - mkdir 423 (time 1786048784.03 total 30.07 last 15.08)
 - mkdir 606 (time 1786048794.03 total 40.07 last 18.29)
 - mkdir 784 (time 1786048804.09 total 50.13 last 17.70)
 - mkdir 933 (time 1786048814.11 total 60.15 last 14.87)
total: 1000 mkdir in 66.94 seconds: 14.94 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.64 seconds: 15.65 ops/second
 - mkdir 94 (time 1786049370.36 total 10.03 last 9.37)
 - mkdir 208 (time 1786049380.43 total 20.10 last 11.32)
 - mkdir 359 (time 1786049390.47 total 30.14 last 15.04)
 - mkdir 493 (time 1786049400.56 total 40.23 last 13.29)
 - mkdir 651 (time 1786049410.58 total 50.25 last 15.77)
 - mkdir 800 (time 1786049420.60 total 60.27 last 14.87)
 - mkdir 952 (time 1786049430.60 total 70.27 last 15.19)
total: 1000 mkdir in 73.16 seconds: 13.67 ops/second
 - mkdir 92 (time 1786049370.23 total 10.11 last 9.10)
 - mkdir 207 (time 1786049380.23 total 20.11 last 11.50)
 - mkdir 362 (time 1786049390.26 total 30.14 last 15.46)
 - mkdir 495 (time 1786049400.28 total 40.17 last 13.26)
 - mkdir 648 (time 1786049410.31 total 50.19 last 15.26)
 - mkdir 795 (time 1786049420.35 total 60.24 last 14.64)
 - mkdir 936 (time 1786049430.35 total 70.24 last 14.10)
total: 1000 mkdir in 73.87 seconds: 13.54 ops/second
 - mkdir 106 (time 1786049375.56 total 10.01 last 10.59)
 - mkdir 254 (time 1786049385.59 total 20.04 last 14.75)
 - mkdir 403 (time 1786049395.59 total 30.04 last 14.90)
 - mkdir 543 (time 1786049405.63 total 40.08 last 13.94)
 - mkdir 724 (time 1786049415.69 total 50.14 last 17.99)
 - mkdir 846 (time 1786049425.73 total 60.18 last 12.16)
 - mkdir 994 (time 1786049435.79 total 70.24 last 14.71)
total: 1000 mkdir in 70.76 seconds: 14.13 ops/second
 - mkdir 90 (time 1786049370.09 total 10.01 last 8.99)
 - mkdir 198 (time 1786049380.18 total 20.10 last 10.70)
 - mkdir 350 (time 1786049390.23 total 30.14 last 15.13)
 - mkdir 476 (time 1786049400.28 total 40.20 last 12.53)
 - mkdir 632 (time 1786049410.32 total 50.23 last 15.55)
 - mkdir 779 (time 1786049420.34 total 60.26 last 14.66)
 - mkdir 926 (time 1786049430.35 total 70.26 last 14.69)
total: 1000 mkdir in 76.24 seconds: 13.12 ops/second
 - mkdir 98 (time 1786049373.86 total 10.11 last 9.70)
 - mkdir 220 (time 1786049383.86 total 20.11 last 12.19)
 - mkdir 372 (time 1786049393.86 total 30.11 last 15.20)
 - mkdir 514 (time 1786049403.87 total 40.12 last 14.19)
 - mkdir 680 (time 1786049413.93 total 50.18 last 16.50)
 - mkdir 804 (time 1786049424.01 total 60.26 last 12.30)
 - mkdir 970 (time 1786049434.10 total 70.35 last 16.45)
total: 1000 mkdir in 74.10 seconds: 13.49 ops/second
 - mkdir 100 (time 1786049375.64 total 10.12 last 9.88)
 - mkdir 243 (time 1786049385.68 total 20.16 last 14.25)
 - mkdir 378 (time 1786049395.75 total 30.23 last 13.40)
 - mkdir 521 (time 1786049405.79 total 40.27 last 14.25)
 - mkdir 694 (time 1786049415.79 total 50.27 last 17.29)
 - mkdir 818 (time 1786049425.80 total 60.28 last 12.40)
 - mkdir 972 (time 1786049435.80 total 70.28 last 15.40)
total: 1000 mkdir in 74.13 seconds: 13.49 ops/second
 - mkdir 103 (time 1786049374.61 total 10.06 last 10.24)
 - mkdir 224 (time 1786049384.63 total 20.08 last 12.07)
 - mkdir 373 (time 1786049394.69 total 30.14 last 14.81)
 - mkdir 514 (time 1786049404.72 total 40.17 last 14.06)
 - mkdir 680 (time 1786049414.73 total 50.18 last 16.58)
 - mkdir 802 (time 1786049424.79 total 60.24 last 12.13)
 - mkdir 959 (time 1786049434.87 total 70.32 last 15.57)
total: 1000 mkdir in 75.30 seconds: 13.28 ops/second
 - mkdir 94 (time 1786049376.12 total 10.04 last 9.36)
 - mkdir 239 (time 1786049386.14 total 20.06 last 14.47)
 - mkdir 377 (time 1786049396.17 total 30.09 last 13.76)
 - mkdir 523 (time 1786049406.22 total 40.14 last 14.52)
 - mkdir 704 (time 1786049416.29 total 50.21 last 17.98)
 - mkdir 829 (time 1786049426.31 total 60.23 last 12.47)
 - mkdir 975 (time 1786049436.32 total 70.24 last 14.60)
total: 1000 mkdir in 73.79 seconds: 13.55 ops/second
 - mkdir 99 (time 1786049376.38 total 10.05 last 9.85)
 - mkdir 241 (time 1786049386.48 total 20.15 last 14.06)
 - mkdir 375 (time 1786049396.57 total 30.24 last 13.28)
 - mkdir 518 (time 1786049406.62 total 40.29 last 14.23)
 - mkdir 689 (time 1786049416.63 total 50.30 last 17.07)
 - mkdir 813 (time 1786049426.67 total 60.34 last 12.35)
 - mkdir 954 (time 1786049436.73 total 70.40 last 14.02)
total: 1000 mkdir in 75.74 seconds: 13.20 ops/second
 - mkdir 93 (time 1786049375.94 total 10.15 last 9.16)
 - mkdir 233 (time 1786049386.00 total 20.21 last 13.92)
 - mkdir 363 (time 1786049396.04 total 30.25 last 12.95)
 - mkdir 505 (time 1786049406.06 total 40.27 last 14.18)
 - mkdir 682 (time 1786049416.12 total 50.33 last 17.59)
 - mkdir 804 (time 1786049426.15 total 60.36 last 12.16)
 - mkdir 946 (time 1786049436.19 total 70.40 last 14.15)
total: 1000 mkdir in 76.52 seconds: 13.07 ops/second
Time for file creation 92 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786049451 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1786049451 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786049451 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786049452 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786049453 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1786049452 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786049452 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786049452 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786049452 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786049453 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
Time for file removal 55 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8