== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 01:18:08 (1789708688) start mds service on oleg123-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg123-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg123-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg123-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg123-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Started lustre-OST0000 oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg123-client.virtnet: -o user_xattr,flock 192.168.201.123@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 142 (time 1789708773.92 total 10.13 last 14.02) - open/close/unlink 384 (time 1789708783.94 total 20.15 last 24.15) - open/close/unlink 690 (time 1789708793.95 total 30.17 last 30.56) - open/close/unlink 908 (time 1789708803.99 total 40.20 last 21.73) - open/close/unlink 1068 (time 1789708814.01 total 50.22 last 15.97) - open/close/unlink 1249 (time 1789708824.07 total 60.28 last 18.00) - open/close/unlink 1414 (time 1789708834.16 total 70.37 last 16.35) - open/close/unlink 1597 (time 1789708844.20 total 80.41 last 18.23) - open/close/unlink 1753 (time 1789708854.21 total 90.42 last 15.57) - open/close/unlink 1954 (time 1789708864.24 total 100.45 last 20.06) - open/close/unlink 2198 (time 1789708874.31 total 110.52 last 24.23) - open/close/unlink 2317 (time 1789708884.35 total 120.56 last 11.85) - open/close/unlink 2435 (time 1789708894.35 total 130.57 last 11.79) - open/close/unlink 2653 (time 1789708904.39 total 140.61 last 21.71) - open/close/unlink 2845 (time 1789708914.43 total 150.64 last 19.13) - open/close/unlink 3097 (time 1789708924.44 total 160.65 last 25.18) - open/close/unlink 3370 (time 1789708934.46 total 170.67 last 27.25) - open/close/unlink 3636 (time 1789708944.49 total 180.70 last 26.51) - open/close/unlink 3872 (time 1789708954.51 total 190.72 last 23.55) - open/close/unlink 4121 (time 1789708964.52 total 200.73 last 24.87) - open/close/unlink 4356 (time 1789708974.58 total 210.79 last 23.37) - open/close/unlink 4577 (time 1789708984.58 total 220.79 last 22.09) - open/close/unlink 4844 (time 1789708994.61 total 230.82 last 26.64) - open/close/unlink 5088 (time 1789709004.67 total 240.88 last 24.25) - open/close/unlink 5350 (time 1789709014.69 total 250.90 last 26.13) - open/close/unlink 5590 (time 1789709024.71 total 260.92 last 23.97) - open/close/unlink 5807 (time 1789709034.71 total 270.92 last 21.70) - open/close/unlink 6045 (time 1789709044.77 total 280.98 last 23.65) - open/close/unlink 6298 (time 1789709054.78 total 290.99 last 25.29) - open/close/unlink 6587 (time 1789709064.80 total 301.01 last 28.84) - open/close/unlink 6843 (time 1789709074.84 total 311.05 last 25.49) - open/close/unlink 7096 (time 1789709084.84 total 321.05 last 25.30) - open/close/unlink 7322 (time 1789709094.90 total 331.11 last 22.47) - open/close/unlink 7615 (time 1789709104.95 total 341.16 last 29.16) - open/close/unlink 7875 (time 1789709114.95 total 351.16 last 25.99) - open/close/unlink 8153 (time 1789709124.99 total 361.20 last 27.70) - open/close/unlink 8384 (time 1789709135.01 total 371.22 last 23.05) - open/close/unlink 8671 (time 1789709145.03 total 381.24 last 28.64) - open/close/unlink 8942 (time 1789709155.08 total 391.29 last 26.97) - open/close/unlink 9214 (time 1789709165.10 total 401.31 last 27.13) - open/close/unlink 9523 (time 1789709175.14 total 411.35 last 30.79) - open/close/unlink 9859 (time 1789709185.15 total 421.36 last 33.55) - open/close/unlink 10000 (time 1789709189.07 total 425.28 last 36.00) - open/close/unlink 10370 (time 1789709199.08 total 435.29 last 36.97) - open/close/unlink 10842 (time 1789709209.09 total 445.30 last 47.13) - open/close/unlink 11560 (time 1789709219.10 total 455.31 last 71.76) - open/close/unlink 12319 (time 1789709229.10 total 465.31 last 75.89) - open/close/unlink 13295 (time 1789709239.10 total 475.31 last 97.58) - open/close/unlink 14489 (time 1789709249.10 total 485.32 last 119.34) - open/close/unlink 16045 (time 1789709259.11 total 495.32 last 155.53) - open/close/unlink 18042 (time 1789709269.11 total 505.32 last 199.68) - open/close/unlink 19921 (time 1789709279.11 total 515.32 last 187.87) - open/close/unlink 21971 (time 1789709289.11 total 525.32 last 204.96) - open/close/unlink 24007 (time 1789709299.12 total 535.33 last 203.55) - open/close/unlink 26086 (time 1789709309.12 total 545.33 last 207.84) - open/close/unlink 28381 (time 1789709319.12 total 555.33 last 229.48) - open/close/unlink 30000 (time 1789709327.32 total 563.53 last 197.45) - open/close/unlink 32267 (time 17897 - open/close/unlink 138 (time 1789708773.49 total 10.02 last 13.77) - open/close/unlink 362 (time 1789708783.51 total 20.05 last 22.35) - open/close/unlink 680 (time 1789708793.55 total 30.09 last 31.68) - open/close/unlink 905 (time 1789708803.65 total 40.19 last 22.27) - open/close/unlink 1069 (time 1789708813.68 total 50.21 last 16.36) - open/close/unlink 1260 (time 1789708823.71 total 60.25 last 19.03) - open/close/unlink 1421 (time 1789708833.71 total 70.25 last 16.10) - open/close/unlink 1598 (time 1789708843.82 total 80.35 last 17.52) - open/close/unlink 1761 (time 1789708853.98 total 90.52 last 16.03) - open/close/unlink 1959 (time 1789708864.02 total 100.56 last 19.72) - open/close/unlink 2204 (time 1789708874.06 total 110.60 last 24.40) - open/close/unlink 2321 (time 1789708884.06 total 120.60 last 11.70) - open/close/unlink 2438 (time 1789708894.09 total 130.62 last 11.67) - open/close/unlink 2654 (time 1789708904.12 total 140.65 last 21.54) - open/close/unlink 2858 (time 1789708914.12 total 150.65 last 20.40) - open/close/unlink 3112 (time 1789708924.12 total 160.66 last 25.39) - open/close/unlink 3398 (time 1789708934.14 total 170.68 last 28.55) - open/close/unlink 3669 (time 1789708944.15 total 180.69 last 27.07) - open/close/unlink 3909 (time 1789708954.16 total 190.70 last 23.98) - open/close/unlink 4155 (time 1789708964.19 total 200.72 last 24.54) - open/close/unlink 4387 (time 1789708974.22 total 210.75 last 23.13) - open/close/unlink 4600 (time 1789708984.23 total 220.77 last 21.27) - open/close/unlink 4853 (time 1789708994.28 total 230.81 last 25.18) - open/close/unlink 5108 (time 1789709004.29 total 240.82 last 25.47) - open/close/unlink 5358 (time 1789709014.30 total 250.84 last 24.96) - open/close/unlink 5596 (time 1789709024.31 total 260.84 last 23.79) - open/close/unlink 5820 (time 1789709034.36 total 270.89 last 22.29) - open/close/unlink 6063 (time 1789709044.36 total 280.90 last 24.28) - open/close/unlink 6312 (time 1789709054.37 total 290.90 last 24.89) - open/close/unlink 6599 (time 1789709064.43 total 300.97 last 28.52) - open/close/unlink 6857 (time 1789709074.44 total 310.98 last 25.77) - open/close/unlink 7101 (time 1789709084.46 total 321.00 last 24.36) - open/close/unlink 7329 (time 1789709094.48 total 331.01 last 22.77) - open/close/unlink 7610 (time 1789709104.52 total 341.06 last 27.97) - open/close/unlink 7874 (time 1789709114.53 total 351.07 last 26.37) - open/close/unlink 8148 (time 1789709124.54 total 361.07 last 27.38) - open/close/unlink 8380 (time 1789709134.54 total 371.08 last 23.19) - open/close/unlink 8658 (time 1789709144.55 total 381.09 last 27.77) - open/close/unlink 8935 (time 1789709154.58 total 391.12 last 27.62) - open/close/unlink 9210 (time 1789709164.60 total 401.14 last 27.44) - open/close/unlink 9518 (time 1789709174.62 total 411.15 last 30.76) - open/close/unlink 9848 (time 1789709184.65 total 421.18 last 32.91) - open/close/unlink 10000 (time 1789709189.05 total 425.59 last 34.50) - open/close/unlink 10366 (time 1789709199.06 total 435.60 last 36.56) - open/close/unlink 10830 (time 1789709209.07 total 445.60 last 46.37) - open/close/unlink 11546 (time 1789709219.08 total 455.61 last 71.56) - open/close/unlink 12305 (time 1789709229.08 total 465.62 last 75.83) - open/close/unlink 13283 (time 1789709239.09 total 475.62 last 97.76) - open/close/unlink 14481 (time 1789709249.10 total 485.63 last 119.70) - open/close/unlink 16031 (time 1789709259.10 total 495.63 last 154.95) - open/close/unlink 18029 (time 1789709269.10 total 505.64 last 199.78) - open/close/unlink 19924 (time 1789709279.10 total 515.64 last 189.50) - open/close/unlink 21954 (time 1789709289.10 total 525.64 last 202.94) - open/close/unlink 23997 (time 1789709299.11 total 535.64 last 204.24) - open/close/unlink 26074 (time 1789709309.11 total 545.64 last 207.68) - open/close/unlink 28362 (time 1789709319.11 total 555.65 last 228.71) - open/close/unlink 30000 (time 1789709327.38 total 563.91 last 198.11) - open/close/unlink 32272 (time 17897 - open/close/unlink 134 (time 1789708773.46 total 10.00 last 13.40) - open/close/unlink 357 (time 1789708783.50 total 20.04 last 22.21) - open/close/unlink 675 (time 1789708793.51 total 30.06 last 31.75) - open/close/unlink 899 (time 1789708803.51 total 40.06 last 22.40) - open/close/unlink 1065 (time 1789708813.64 total 50.18 last 16.39) - open/close/unlink 1246 (time 1789708823.71 total 60.25 last 17.98) - open/close/unlink 1412 (time 1789708833.71 total 70.26 last 16.59) - open/close/unlink 1593 (time 1789708843.73 total 80.27 last 18.08) - open/close/unlink 1752 (time 1789708854.02 total 90.56 last 15.45) - open/close/unlink 1943 (time 1789708864.04 total 100.59 last 19.04) - open/close/unlink 2182 (time 1789708874.12 total 110.66 last 23.72) - open/close/unlink 2302 (time 1789708884.18 total 120.73 last 11.93) - open/close/unlink 2415 (time 1789708894.26 total 130.80 last 11.21) - open/close/unlink 2638 (time 1789708904.28 total 140.82 last 22.27) - open/close/unlink 2831 (time 1789708914.28 total 150.82 last 19.29) - open/close/unlink 3090 (time 1789708924.28 total 160.82 last 25.89) - open/close/unlink 3375 (time 1789708934.29 total 170.83 last 28.48) - open/close/unlink 3651 (time 1789708944.35 total 180.89 last 27.44) - open/close/unlink 3890 (time 1789708954.42 total 190.96 last 23.73) - open/close/unlink 4136 (time 1789708964.43 total 200.97 last 24.57) - open/close/unlink 4369 (time 1789708974.45 total 211.00 last 23.25) - open/close/unlink 4584 (time 1789708984.48 total 221.02 last 21.45) - open/close/unlink 4840 (time 1789708994.50 total 231.04 last 25.56) - open/close/unlink 5086 (time 1789709004.59 total 241.13 last 24.36) - open/close/unlink 5336 (time 1789709014.63 total 251.18 last 24.90) - open/close/unlink 5572 (time 1789709024.66 total 261.20 last 23.55) - open/close/unlink 5798 (time 1789709034.72 total 271.26 last 22.47) - open/close/unlink 6036 (time 1789709044.78 total 281.32 last 23.65) - open/close/unlink 6287 (time 1789709054.80 total 291.34 last 25.05) - open/close/unlink 6569 (time 1789709064.81 total 301.36 last 28.16) - open/close/unlink 6832 (time 1789709074.86 total 311.40 last 26.18) - open/close/unlink 7078 (time 1789709084.89 total 321.43 last 24.53) - open/close/unlink 7299 (time 1789709094.90 total 331.44 last 22.08) - open/close/unlink 7579 (time 1789709104.91 total 341.45 last 27.98) - open/close/unlink 7839 (time 1789709114.93 total 351.47 last 25.95) - open/close/unlink 8111 (time 1789709124.95 total 361.49 last 27.13) - open/close/unlink 8342 (time 1789709135.00 total 371.54 last 22.98) - open/close/unlink 8625 (time 1789709145.03 total 381.57 last 28.22) - open/close/unlink 8898 (time 1789709155.05 total 391.60 last 27.23) - open/close/unlink 9168 (time 1789709165.07 total 401.61 last 26.96) - open/close/unlink 9480 (time 1789709175.09 total 411.63 last 31.14) - open/close/unlink 9809 (time 1789709185.09 total 421.63 last 32.88) - open/close/unlink 10000 (time 1789709190.87 total 427.41 last 33.06) - open/close/unlink 10410 (time 1789709200.88 total 437.42 last 40.97) - open/close/unlink 10884 (time 1789709210.88 total 447.43 last 47.36) - open/close/unlink 11606 (time 1789709220.89 total 457.44 last 72.13) - open/close/unlink 12392 (time 1789709230.91 total 467.45 last 78.46) - open/close/unlink 13401 (time 1789709240.92 total 477.46 last 100.85) - open/close/unlink 14747 (time 1789709250.92 total 487.46 last 134.55) - open/close/unlink 16250 (time 1789709260.93 total 497.47 last 150.22) - open/close/unlink 18347 (time 1789709270.93 total 507.47 last 209.67) - open/close/unlink 20000 (time 1789709279.90 total 516.44 last 184.23) - open/close/unlink 22117 (time 1789709289.90 total 526.44 last 211.65) - open/close/unlink 24152 (time 1789709299.90 total 536.45 last 203.47) - open/close/unlink 26237 (time 1789709309.91 total 546.45 last 208.42) - open/close/unlink 28506 (time 1789709319.91 total 556.45 last 226.85) - open/close/unlink 30000 (time 1789709327.48 total 564.02 last 197.45) - open/close/unlink 32314 (time 1789 - open/close/unlink 142 (time 1789708773.50 total 10.04 last 14.15) - open/close/unlink 368 (time 1789708783.51 total 20.05 last 22.57) - open/close/unlink 693 (time 1789708793.53 total 30.08 last 32.42) - open/close/unlink 921 (time 1789708803.59 total 40.13 last 22.67) - open/close/unlink 1089 (time 1789708813.69 total 50.23 last 16.64) - open/close/unlink 1269 (time 1789708823.70 total 60.24 last 17.98) - open/close/unlink 1428 (time 1789708833.71 total 70.25 last 15.87) - open/close/unlink 1615 (time 1789708843.81 total 80.35 last 18.51) - open/close/unlink 1778 (time 1789708853.95 total 90.49 last 16.08) - open/close/unlink 1974 (time 1789708863.96 total 100.50 last 19.59) - open/close/unlink 2226 (time 1789708874.02 total 110.56 last 25.05) - open/close/unlink 2349 (time 1789708884.06 total 120.61 last 12.24) - open/close/unlink 2464 (time 1789708894.07 total 130.61 last 11.49) - open/close/unlink 2678 (time 1789708904.07 total 140.61 last 21.40) - open/close/unlink 2871 (time 1789708914.10 total 150.64 last 19.24) - open/close/unlink 3127 (time 1789708924.13 total 160.67 last 25.53) - open/close/unlink 3412 (time 1789708934.13 total 170.67 last 28.50) - open/close/unlink 3684 (time 1789708944.16 total 180.70 last 27.12) - open/close/unlink 3926 (time 1789708954.17 total 190.71 last 24.17) - open/close/unlink 4173 (time 1789708964.18 total 200.72 last 24.68) - open/close/unlink 4405 (time 1789708974.18 total 210.72 last 23.20) - open/close/unlink 4616 (time 1789708984.19 total 220.73 last 21.09) - open/close/unlink 4869 (time 1789708994.20 total 230.74 last 25.26) - open/close/unlink 5126 (time 1789709004.24 total 240.78 last 25.61) - open/close/unlink 5363 (time 1789709014.25 total 250.79 last 23.66) - open/close/unlink 5594 (time 1789709024.28 total 260.82 last 23.05) - open/close/unlink 5818 (time 1789709034.30 total 270.84 last 22.35) - open/close/unlink 6050 (time 1789709044.30 total 280.84 last 23.19) - open/close/unlink 6306 (time 1789709054.34 total 290.88 last 25.50) - open/close/unlink 6586 (time 1789709064.36 total 300.90 last 27.96) - open/close/unlink 6851 (time 1789709074.37 total 310.91 last 26.48) - open/close/unlink 7090 (time 1789709084.37 total 320.91 last 23.89) - open/close/unlink 7319 (time 1789709094.40 total 330.94 last 22.84) - open/close/unlink 7605 (time 1789709104.41 total 340.95 last 28.58) - open/close/unlink 7858 (time 1789709114.42 total 350.96 last 25.27) - open/close/unlink 8135 (time 1789709124.46 total 361.00 last 27.59) - open/close/unlink 8372 (time 1789709134.50 total 371.04 last 23.60) - open/close/unlink 8655 (time 1789709144.51 total 381.05 last 28.27) - open/close/unlink 8923 (time 1789709154.54 total 391.08 last 26.71) - open/close/unlink 9196 (time 1789709164.55 total 401.09 last 27.28) - open/close/unlink 9509 (time 1789709174.57 total 411.11 last 31.23) - open/close/unlink 9839 (time 1789709184.61 total 421.15 last 32.89) - open/close/unlink 10000 (time 1789709189.24 total 425.78 last 34.79) - open/close/unlink 10373 (time 1789709199.25 total 435.79 last 37.26) - open/close/unlink 10832 (time 1789709209.25 total 445.79 last 45.89) - open/close/unlink 11558 (time 1789709219.25 total 455.79 last 72.58) - open/close/unlink 12315 (time 1789709229.26 total 465.80 last 75.63) - open/close/unlink 13305 (time 1789709239.27 total 475.81 last 98.93) - open/close/unlink 14505 (time 1789709249.27 total 485.81 last 119.99) - open/close/unlink 16081 (time 1789709259.28 total 495.82 last 157.46) - open/close/unlink 18092 (time 1789709269.28 total 505.82 last 201.01) - open/close/unlink 19986 (time 1789709279.29 total 515.83 last 189.31) - open/close/unlink 22016 (time 1789709289.29 total 525.83 last 202.98) - open/close/unlink 24050 (time 1789709299.29 total 535.83 last 203.40) - open/close/unlink 26109 (time 1789709309.29 total 545.83 last 205.90) - open/close/unlink 28393 (time 1789709319.29 total 555.83 last 228.38) - open/close/unlink 30000 (time 1789709327.56 total 564.10 last 194.26) - open/close/unlink 32290 (time 17897 - open/close/unlink 151 (time 1789708775.10 total 10.08 last 14.97) - open/close/unlink 424 (time 1789708785.13 total 20.11 last 27.22) - open/close/unlink 738 (time 1789708795.19 total 30.17 last 31.22) - open/close/unlink 930 (time 1789708805.20 total 40.18 last 19.18) - open/close/unlink 1100 (time 1789708815.20 total 50.18 last 17.00) - open/close/unlink 1284 (time 1789708825.28 total 60.26 last 18.27) - open/close/unlink 1454 (time 1789708835.31 total 70.30 last 16.93) - open/close/unlink 1633 (time 1789708845.33 total 80.32 last 17.86) - open/close/unlink 1786 (time 1789708855.37 total 90.35 last 15.24) - open/close/unlink 1999 (time 1789708865.38 total 100.36 last 21.29) - open/close/unlink 2228 (time 1789708875.38 total 110.36 last 22.90) - open/close/unlink 2349 (time 1789708885.51 total 120.49 last 11.95) - open/close/unlink 2485 (time 1789708895.54 total 130.52 last 13.55) - open/close/unlink 2707 (time 1789708905.55 total 140.53 last 22.18) - open/close/unlink 2924 (time 1789708915.56 total 150.54 last 21.68) - open/close/unlink 3160 (time 1789708925.56 total 160.54 last 23.59) - open/close/unlink 3464 (time 1789708935.57 total 170.56 last 30.36) - open/close/unlink 3710 (time 1789708945.60 total 180.58 last 24.54) - open/close/unlink 3954 (time 1789708955.66 total 190.64 last 24.25) - open/close/unlink 4205 (time 1789708965.70 total 200.68 last 24.99) - open/close/unlink 4434 (time 1789708975.71 total 210.69 last 22.89) - open/close/unlink 4667 (time 1789708985.75 total 220.73 last 23.20) - open/close/unlink 4919 (time 1789708995.77 total 230.75 last 25.17) - open/close/unlink 5164 (time 1789709005.81 total 240.79 last 24.40) - open/close/unlink 5420 (time 1789709015.84 total 250.82 last 25.52) - open/close/unlink 5657 (time 1789709025.86 total 260.85 last 23.64) - open/close/unlink 5880 (time 1789709035.88 total 270.86 last 22.26) - open/close/unlink 6119 (time 1789709045.93 total 280.91 last 23.78) - open/close/unlink 6380 (time 1789709055.96 total 290.94 last 26.04) - open/close/unlink 6653 (time 1789709065.99 total 300.97 last 27.20) - open/close/unlink 6910 (time 1789709076.04 total 311.02 last 25.58) - open/close/unlink 7156 (time 1789709086.07 total 321.05 last 24.52) - open/close/unlink 7382 (time 1789709096.08 total 331.06 last 22.58) - open/close/unlink 7663 (time 1789709106.09 total 341.07 last 28.08) - open/close/unlink 7917 (time 1789709116.12 total 351.11 last 25.31) - open/close/unlink 8195 (time 1789709126.12 total 361.11 last 27.80) - open/close/unlink 8428 (time 1789709136.18 total 371.16 last 23.17) - open/close/unlink 8711 (time 1789709146.18 total 381.17 last 28.29) - open/close/unlink 8970 (time 1789709156.21 total 391.19 last 25.83) - open/close/unlink 9245 (time 1789709166.23 total 401.21 last 27.44) - open/close/unlink 9565 (time 1789709176.25 total 411.24 last 31.93) - open/close/unlink 9895 (time 1789709186.27 total 421.25 last 32.95) - open/close/unlink 10000 (time 1789709189.37 total 424.35 last 33.87) - open/close/unlink 10379 (time 1789709199.37 total 434.35 last 37.89) - open/close/unlink 10844 (time 1789709209.39 total 444.37 last 46.43) - open/close/unlink 11569 (time 1789709219.40 total 454.38 last 72.42) - open/close/unlink 12329 (time 1789709229.40 total 464.38 last 75.96) - open/close/unlink 13316 (time 1789709239.41 total 474.40 last 98.60) - open/close/unlink 14517 (time 1789709249.42 total 484.40 last 120.07) - open/close/unlink 16081 (time 1789709259.42 total 494.40 last 156.35) - open/close/unlink 18091 (time 1789709269.42 total 504.40 last 200.93) - open/close/unlink 19964 (time 1789709279.43 total 514.41 last 187.17) - open/close/unlink 21998 (time 1789709289.43 total 524.41 last 203.39) - open/close/unlink 24023 (time 1789709299.43 total 534.42 last 202.42) - open/close/unlink 26108 (time 1789709309.43 total 544.42 last 208.49) - open/close/unlink 28404 (time 1789709319.43 total 554.42 last 229.60) - open/close/unlink 30000 (time 1789709327.61 total 562.59 last 195.24) - open/close/unlink 32299 (time 1789709337.38 total 573.91 last 227.20) - open/close/unlink 34238 (time 1789709347.38 total 583.92 last 196.54) - open/close/unlink 36194 (time 1789709357.38 total 593.92 last 195.57) - open/close/unlink 38447 (time 1789709367.38 total 603.92 last 225.29) - open/close/unlink 40000 (time 1789709375.05 total 611.59 last 202.59) - open/close/unlink 42240 (time 1789709385.05 total 621.59 last 223.93) - open/close/unlink 44230 (time 1789709395.06 total 631.59 last 198.96) - open/close/unlink 46316 (time 1789709405.06 total 641.59 last 208.58) - open/close/unlink 48305 (time 1789709415.06 total 651.59 last 198.90) - open/close/unlink 50000 (time 1789709423.59 total 660.13 last 198.57) - open/close/unlink 52072 (time 1789709433.60 total 670.13 last 207.11) - open/close/unlink 54063 (time 1789709443.60 total 680.13 last 199.09) - open/close/unlink 56063 (time 1789709453.60 total 690.13 last 199.96) - open/close/unlink 58123 (time 1789709463.60 total 700.13 last 205.99) - open/close/unlink 59905 (time 1789709473.60 total 710.14 last 178.15) - open/close/unlink 61676 (time 1789709483.60 total 720.14 last 177.08) - open/close/unlink 63525 (time 1789709493.60 total 730.14 last 184.90) total: 64768 open/close/unlink in 736.84 seconds: 87.90 ops/second 709337.48 total 574.02 last 231.38) - open/close/unlink 34313 (time 1789709347.48 total 584.02 last 199.79) - open/close/unlink 36267 (time 1789709357.48 total 594.03 last 195.39) - open/close/unlink 38527 (time 1789709367.48 total 604.03 last 225.97) - open/close/unlink 40000 (time 1789709374.61 total 611.15 last 206.64) - open/close/unlink 42224 (time 1789709384.62 total 621.16 last 222.35) - open/close/unlink 44258 (time 1789709394.62 total 631.16 last 203.40) - open/close/unlink 46295 (time 1789709404.62 total 641.16 last 203.64) - open/close/unlink 48254 (time 1789709414.62 total 651.16 last 195.84) - open/close/unlink 50000 (time 1789709423.56 total 660.10 last 195.34) - open/close/unlink 51997 (time 1789709433.56 total 670.10 last 199.66) - open/close/unlink 53999 (time 1789709443.56 total 680.11 last 200.15) - open/close/unlink 55993 (time 1789709453.57 total 690.11 last 199.36) - open/close/unlink 58029 (time 1789709463.57 total 700.11 last 203.59) - open/close/unlink 59778 (time 1789709473.57 total 710.11 last 174.90) - open/close/unlink 61551 (time 1789709483.57 total 720.11 last 177.27) - open/close/unlink 63385 (time 1789709493.57 total 730.11 last 183.39) - open/close/unlink 64762 (time 1789709503.58 total 740.12 last 137.56) total: 64768 open/close/unlink in 740.45 seconds: 87.47 ops/second 09337.32 total 573.53 last 226.67) - open/close/unlink 34288 (time 1789709347.32 total 583.53 last 202.07) - open/close/unlink 36217 (time 1789709357.32 total 593.53 last 192.89) - open/close/unlink 38469 (time 1789709367.33 total 603.54 last 225.10) - open/close/unlink 40000 (time 1789709374.91 total 611.12 last 201.93) - open/close/unlink 42225 (time 1789709384.91 total 621.12 last 222.45) - open/close/unlink 44160 (time 1789709394.91 total 631.12 last 193.45) - open/close/unlink 46226 (time 1789709404.92 total 641.13 last 206.47) - open/close/unlink 48212 (time 1789709414.92 total 651.13 last 198.58) - open/close/unlink 50000 (time 1789709424.02 total 660.24 last 196.41) - open/close/unlink 51977 (time 1789709434.03 total 670.24 last 197.61) - open/close/unlink 53991 (time 1789709444.03 total 680.24 last 201.37) - open/close/unlink 56009 (time 1789709454.03 total 690.24 last 201.75) - open/close/unlink 58067 (time 1789709464.03 total 700.25 last 205.78) - open/close/unlink 59831 (time 1789709474.04 total 710.25 last 176.36) - open/close/unlink 61600 (time 1789709484.04 total 720.25 last 176.89) - open/close/unlink 63450 (time 1789709494.04 total 730.25 last 184.94) - open/close/unlink 64767 (time 1789709504.11 total 740.32 last 130.84) total: 64768 open/close/unlink in 740.32 seconds: 87.49 ops/second 09337.56 total 574.10 last 228.93) - open/close/unlink 34236 (time 1789709347.57 total 584.11 last 194.52) - open/close/unlink 36235 (time 1789709357.57 total 594.11 last 199.90) - open/close/unlink 38473 (time 1789709367.57 total 604.11 last 223.73) - open/close/unlink 40000 (time 1789709375.06 total 611.60 last 203.87) - open/close/unlink 42232 (time 1789709385.06 total 621.60 last 223.13) - open/close/unlink 44179 (time 1789709395.07 total 631.61 last 194.66) - open/close/unlink 46287 (time 1789709405.07 total 641.61 last 210.76) - open/close/unlink 48246 (time 1789709415.07 total 651.61 last 195.85) - open/close/unlink 50000 (time 1789709424.07 total 660.61 last 194.97) - open/close/unlink 52009 (time 1789709434.15 total 670.69 last 199.16) - open/close/unlink 54034 (time 1789709444.16 total 680.70 last 202.49) - open/close/unlink 56001 (time 1789709454.16 total 690.70 last 196.57) - open/close/unlink 58056 (time 1789709464.17 total 700.71 last 205.37) - open/close/unlink 59843 (time 1789709474.17 total 710.71 last 178.66) - open/close/unlink 61620 (time 1789709484.17 total 720.71 last 177.64) - open/close/unlink 63464 (time 1789709494.18 total 730.72 last 184.35) - open/close/unlink 64746 (time 1789709504.18 total 740.72 last 128.11) total: 64768 open/close/unlink in 741.13 seconds: 87.39 ops/second 09337.61 total 572.59 last 229.88) - open/close/unlink 34238 (time 1789709347.61 total 582.59 last 193.89) - open/close/unlink 36163 (time 1789709357.62 total 592.60 last 192.38) - open/close/unlink 38420 (time 1789709367.62 total 602.60 last 225.66) - open/close/unlink 40000 (time 1789709375.45 total 610.43 last 201.74) - open/close/unlink 42238 (time 1789709385.45 total 620.43 last 223.75) - open/close/unlink 44202 (time 1789709395.45 total 630.44 last 196.38) - open/close/unlink 46271 (time 1789709405.45 total 640.44 last 206.89) - open/close/unlink 48239 (time 1789709415.45 total 650.44 last 196.79) - open/close/unlink 50000 (time 1789709424.36 total 659.34 last 197.78) - open/close/unlink 51957 (time 1789709434.36 total 669.34 last 195.67) - open/close/unlink 53984 (time 1789709444.36 total 679.34 last 202.64) - open/close/unlink 55986 (time 1789709454.36 total 689.35 last 200.19) - open/close/unlink 58006 (time 1789709464.37 total 699.35 last 201.96) - open/close/unlink 59753 (time 1789709474.37 total 709.35 last 174.63) - open/close/unlink 61499 (time 1789709484.37 total 719.35 last 174.56) - open/close/unlink 63346 (time 1789709494.37 total 729.36 last 184.65) - open/close/unlink 64574 (time 1789709504.39 total 739.37 last 122.66) total: 64768 open/close/unlink in 741.62 seconds: 87.33 ops/second Waiting for MDT destroys to complete oleg123-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg123-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg123-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg123-server stop mds service on oleg123-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg123-server stop mds service on oleg123-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg123-server unloading modules via unload_modules_local on: 'oleg123-server' oleg123-server: oleg123-server.virtnet: executing unload_modules_local oleg123-server: kmemleak disabled modules unloaded. pdsh@oleg123-client: oleg123-client: ssh exited with exit code 2 pdsh@oleg123-client: oleg123-server: ssh exited with exit code 2 pdsh@oleg123-client: oleg123-client: ssh exited with exit code 2 pdsh@oleg123-client: oleg123-server: ssh exited with exit code 2