== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:37:06 (1786775826)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.77 ops/second
 - mkdir 157 (time 1786775847.42 total 10.07 last 15.60)
 - mkdir 284 (time 1786775857.47 total 20.11 last 12.64)
 - mkdir 419 (time 1786775867.48 total 30.13 last 13.48)
 - mkdir 537 (time 1786775877.53 total 40.17 last 11.75)
 - mkdir 696 (time 1786775887.53 total 50.18 last 15.89)
 - mkdir 858 (time 1786775897.61 total 60.26 last 16.06)
total: 1000 mkdir in 69.75 seconds: 14.34 ops/second
 - mkdir 152 (time 1786775847.55 total 10.08 last 15.08)
 - mkdir 281 (time 1786775857.55 total 20.08 last 12.90)
 - mkdir 414 (time 1786775867.63 total 30.16 last 13.19)
 - mkdir 534 (time 1786775877.68 total 40.21 last 11.95)
 - mkdir 693 (time 1786775887.68 total 50.21 last 15.89)
 - mkdir 857 (time 1786775897.75 total 60.28 last 16.29)
total: 1000 mkdir in 69.94 seconds: 14.30 ops/second
 - mkdir 155 (time 1786775848.48 total 10.04 last 15.44)
 - mkdir 282 (time 1786775858.49 total 20.04 last 12.70)
 - mkdir 417 (time 1786775868.54 total 30.09 last 13.43)
 - mkdir 542 (time 1786775878.58 total 40.13 last 12.45)
 - mkdir 708 (time 1786775888.59 total 50.14 last 16.59)
 - mkdir 867 (time 1786775898.67 total 60.22 last 15.77)
total: 1000 mkdir in 69.06 seconds: 14.48 ops/second
 - mkdir 160 (time 1786775848.75 total 10.07 last 15.89)
 - mkdir 296 (time 1786775858.76 total 20.07 last 13.59)
 - mkdir 424 (time 1786775868.84 total 30.15 last 12.70)
 - mkdir 548 (time 1786775878.85 total 40.16 last 12.38)
 - mkdir 705 (time 1786775888.88 total 50.20 last 15.64)
 - mkdir 866 (time 1786775898.97 total 60.29 last 15.96)
total: 1000 mkdir in 68.98 seconds: 14.50 ops/second
 - mkdir 155 (time 1786775848.56 total 10.03 last 15.46)
 - mkdir 280 (time 1786775858.59 total 20.06 last 12.46)
 - mkdir 408 (time 1786775868.68 total 30.14 last 12.69)
 - mkdir 536 (time 1786775878.70 total 40.16 last 12.77)
 - mkdir 699 (time 1786775888.74 total 50.20 last 16.24)
 - mkdir 859 (time 1786775898.75 total 60.21 last 15.98)
total: 1000 mkdir in 69.77 seconds: 14.33 ops/second
 - mkdir 152 (time 1786775847.47 total 10.05 last 15.12)
 - mkdir 272 (time 1786775857.54 total 20.12 last 11.92)
 - mkdir 401 (time 1786775867.56 total 30.14 last 12.87)
 - mkdir 519 (time 1786775877.59 total 40.17 last 11.77)
 - mkdir 678 (time 1786775887.60 total 50.18 last 15.88)
 - mkdir 844 (time 1786775897.62 total 60.20 last 16.57)
 - mkdir 990 (time 1786775907.69 total 70.27 last 14.50)
total: 1000 mkdir in 71.42 seconds: 14.00 ops/second
 - mkdir 155 (time 1786775848.75 total 10.12 last 15.32)
 - mkdir 281 (time 1786775858.76 total 20.12 last 12.59)
 - mkdir 406 (time 1786775868.85 total 30.21 last 12.39)
 - mkdir 536 (time 1786775878.86 total 40.22 last 12.98)
 - mkdir 696 (time 1786775888.90 total 50.26 last 15.94)
 - mkdir 857 (time 1786775898.94 total 60.30 last 16.03)
 - mkdir 997 (time 1786775909.00 total 70.37 last 13.91)
total: 1000 mkdir in 70.59 seconds: 14.17 ops/second
 - mkdir 158 (time 1786775848.39 total 10.02 last 15.77)
 - mkdir 280 (time 1786775858.40 total 20.03 last 12.19)
 - mkdir 403 (time 1786775868.43 total 30.06 last 12.26)
 - mkdir 530 (time 1786775878.51 total 40.14 last 12.60)
 - mkdir 689 (time 1786775888.57 total 50.21 last 15.80)
 - mkdir 849 (time 1786775898.58 total 60.21 last 15.99)
 - mkdir 988 (time 1786775908.59 total 70.23 last 13.88)
total: 1000 mkdir in 71.30 seconds: 14.03 ops/second
 - mkdir 147 (time 1786775847.09 total 10.03 last 14.66)
 - mkdir 266 (time 1786775857.13 total 20.06 last 11.86)
 - mkdir 388 (time 1786775867.18 total 30.11 last 12.13)
 - mkdir 509 (time 1786775877.20 total 40.13 last 12.08)
 - mkdir 670 (time 1786775887.28 total 50.22 last 15.97)
 - mkdir 833 (time 1786775897.36 total 60.29 last 16.17)
 - mkdir 978 (time 1786775907.53 total 70.46 last 14.26)
total: 1000 mkdir in 73.01 seconds: 13.70 ops/second
 - mkdir 145 (time 1786775848.64 total 10.03 last 14.45)
 - mkdir 259 (time 1786775858.68 total 20.07 last 11.35)
 - mkdir 376 (time 1786775868.75 total 30.14 last 11.63)
 - mkdir 503 (time 1786775878.76 total 40.15 last 12.68)
 - mkdir 660 (time 1786775888.80 total 50.19 last 15.64)
 - mkdir 822 (time 1786775898.86 total 60.25 last 16.10)
 - mkdir 950 (time 1786775908.90 total 70.28 last 12.75)
total: 1000 mkdir in 74.40 seconds: 13.44 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.59 seconds: 17.08 ops/second
 - mkdir 212 (time 1786776383.17 total 10.01 last 21.18)
 - mkdir 402 (time 1786776393.19 total 20.03 last 18.96)
 - mkdir 626 (time 1786776403.21 total 30.05 last 22.37)
 - mkdir 853 (time 1786776413.26 total 40.10 last 22.58)
total: 1000 mkdir in 47.70 seconds: 20.97 ops/second
 - mkdir 195 (time 1786776382.38 total 10.02 last 19.46)
 - mkdir 390 (time 1786776392.44 total 20.09 last 19.37)
 - mkdir 614 (time 1786776402.45 total 30.09 last 22.39)
 - mkdir 833 (time 1786776412.52 total 40.17 last 21.73)
total: 1000 mkdir in 48.68 seconds: 20.54 ops/second
 - mkdir 190 (time 1786776381.91 total 10.00 last 18.99)
 - mkdir 395 (time 1786776391.96 total 20.05 last 20.40)
 - mkdir 605 (time 1786776401.99 total 30.08 last 20.94)
 - mkdir 823 (time 1786776411.99 total 40.08 last 21.79)
total: 1000 mkdir in 49.43 seconds: 20.23 ops/second
 - mkdir 214 (time 1786776383.43 total 10.01 last 21.37)
 - mkdir 405 (time 1786776393.46 total 20.05 last 19.03)
 - mkdir 625 (time 1786776403.51 total 30.10 last 21.89)
 - mkdir 846 (time 1786776413.53 total 40.12 last 22.07)
total: 1000 mkdir in 48.56 seconds: 20.60 ops/second
 - mkdir 219 (time 1786776383.60 total 10.02 last 21.86)
 - mkdir 404 (time 1786776393.63 total 20.04 last 18.45)
 - mkdir 624 (time 1786776403.66 total 30.07 last 21.94)
 - mkdir 846 (time 1786776413.68 total 40.09 last 22.15)
total: 1000 mkdir in 48.68 seconds: 20.54 ops/second
 - mkdir 214 (time 1786776383.48 total 10.02 last 21.36)
 - mkdir 407 (time 1786776393.55 total 20.09 last 19.16)
 - mkdir 629 (time 1786776403.57 total 30.11 last 22.16)
 - mkdir 847 (time 1786776413.58 total 40.12 last 21.78)
total: 1000 mkdir in 48.82 seconds: 20.48 ops/second
 - mkdir 193 (time 1786776382.31 total 10.01 last 19.28)
 - mkdir 391 (time 1786776392.36 total 20.06 last 19.71)
 - mkdir 601 (time 1786776402.39 total 30.09 last 20.93)
 - mkdir 821 (time 1786776412.43 total 40.13 last 21.92)
 - mkdir 999 (time 1786776422.47 total 50.17 last 17.73)
total: 1000 mkdir in 50.17 seconds: 19.93 ops/second
 - mkdir 220 (time 1786776383.84 total 10.01 last 21.97)
 - mkdir 405 (time 1786776393.86 total 20.03 last 18.46)
 - mkdir 625 (time 1786776403.88 total 30.05 last 21.97)
 - mkdir 847 (time 1786776413.92 total 40.10 last 22.09)
total: 1000 mkdir in 48.82 seconds: 20.49 ops/second
 - mkdir 214 (time 1786776383.71 total 10.00 last 21.40)
 - mkdir 399 (time 1786776393.72 total 20.01 last 18.49)
 - mkdir 620 (time 1786776403.74 total 30.04 last 22.04)
 - mkdir 842 (time 1786776413.79 total 40.08 last 22.10)
total: 1000 mkdir in 49.40 seconds: 20.24 ops/second
 - mkdir 198 (time 1786776382.67 total 10.02 last 19.76)
 - mkdir 390 (time 1786776392.67 total 20.02 last 19.19)
 - mkdir 600 (time 1786776402.69 total 30.04 last 20.96)
 - mkdir 818 (time 1786776412.70 total 40.05 last 21.78)
 - mkdir 994 (time 1786776422.72 total 50.07 last 17.57)
total: 1000 mkdir in 50.59 seconds: 19.77 ops/second
Time for file creation 62 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786776433 ; total 1 ; last 1)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786776434 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786776433 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786776434 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786776434 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786776434 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786776435 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786776435 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786776435 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786776435 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
Time for file removal 40 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8