== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 06:03:05 (1788775385) start mds service on oleg640-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg640-server: oleg640-server.virtnet: executing set_default_debug -1 all pdsh@oleg640-client: oleg640-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg640-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg640-server: oleg640-server.virtnet: executing set_default_debug -1 all pdsh@oleg640-client: oleg640-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg640-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg640-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg640-server: oleg640-server.virtnet: executing set_default_debug -1 all pdsh@oleg640-client: oleg640-server: ssh exited with exit code 1 Started lustre-OST0000 oleg640-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg640-client.virtnet: -o user_xattr,flock 192.168.206.140@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 632 (time 1788775437.75 total 10.01 last 63.16) - open/close/unlink 1219 (time 1788775447.75 total 20.01 last 58.68) - open/close/unlink 1840 (time 1788775457.76 total 30.01 last 62.07) - open/close/unlink 2469 (time 1788775467.76 total 40.02 last 62.85) - open/close/unlink 3125 (time 1788775477.77 total 50.03 last 65.54) - open/close/unlink 3759 (time 1788775487.78 total 60.04 last 63.33) - open/close/unlink 4366 (time 1788775497.79 total 70.04 last 60.69) - open/close/unlink 5076 (time 1788775507.79 total 80.05 last 70.94) - open/close/unlink 5780 (time 1788775517.80 total 90.06 last 70.34) - open/close/unlink 6553 (time 1788775527.81 total 100.07 last 77.24) - open/close/unlink 7705 (time 1788775537.82 total 110.08 last 115.13) - open/close/unlink 8863 (time 1788775547.82 total 120.08 last 115.75) - open/close/unlink 9916 (time 1788775557.83 total 130.08 last 105.26) - open/close/unlink 10801 (time 1788775567.83 total 140.09 last 88.46) - open/close/unlink 11845 (time 1788775577.84 total 150.10 last 104.28) - open/close/unlink 12818 (time 1788775587.86 total 160.12 last 97.11) - open/close/unlink 14068 (time 1788775597.86 total 170.12 last 124.96) - open/close/unlink 15429 (time 1788775607.87 total 180.12 last 136.07) - open/close/unlink 16456 (time 1788775617.89 total 190.15 last 102.46) - open/close/unlink 17249 (time 1788775627.90 total 200.16 last 79.24) - open/close/unlink 18182 (time 1788775637.91 total 210.17 last 93.14) - open/close/unlink 19190 (time 1788775647.92 total 220.18 last 100.77) - open/close/unlink 20000 (time 1788775657.47 total 229.73 last 84.78) - open/close/unlink 20904 (time 1788775667.47 total 239.73 last 90.40) - open/close/unlink 21707 (time 1788775677.48 total 249.74 last 80.25) - open/close/unlink 22597 (time 1788775687.48 total 259.74 last 88.96) - open/close/unlink 23603 (time 1788775697.49 total 269.75 last 100.53) - open/close/unlink 24518 (time 1788775707.50 total 279.76 last 91.40) - open/close/unlink 25312 (time 1788775717.50 total 289.76 last 79.36) - open/close/unlink 26381 (time 1788775727.51 total 299.77 last 106.78) - open/close/unlink 27309 (time 1788775737.52 total 309.78 last 92.76) - open/close/unlink 28219 (time 1788775747.52 total 319.78 last 90.97) - open/close/unlink 29240 (time 1788775757.54 total 329.79 last 101.97) - open/close/unlink 30000 (time 1788775766.33 total 338.58 last 86.46) - open/close/unlink 30914 (time 1788775776.33 total 348.58 last 91.40) - open/close/unlink 31774 (time 1788775786.33 total 358.59 last 85.92) - open/close/unlink 32518 (time 1788775796.35 total 368.60 last 74.32) - open/close/unlink 33208 (time 1788775806.35 total 378.61 last 68.98) - open/close/unlink 34009 (time 1788775816.35 total 388.61 last 80.07) - open/close/unlink 34929 (time 1788775826.36 total 398.62 last 91.94) - open/close/unlink 35888 (time 1788775836.37 total 408.63 last 95.77) - open/close/unlink 36516 (time 1788775846.37 total 418.63 last 62.79) - open/close/unlink 37273 (time 1788775856.38 total 428.63 last 75.68) - open/close/unlink 38211 (time 1788775866.39 total 438.64 last 93.71) - open/close/unlink 39140 (time 1788775876.40 total 448.66 last 92.77) - open/close/unlink 39955 (time 1788775886.40 total 458.66 last 81.49) - open/close/unlink 40707 (time 1788775896.41 total 468.67 last 75.12) - open/close/unlink 41690 (time 1788775906.41 total 478.67 last 98.28) - open/close/unlink 42410 (time 1788775916.43 total 488.69 last 71.89) - open/close/unlink 43092 (time 1788775926.44 total 498.69 last 68.15) - open/close/unlink 43855 (time 1788775936.45 total 508.70 last 76.22) - open/close/unlink 44726 (time 1788775946.46 total 518.72 last 86.99) - open/close/unlink 45457 (time 1788775956.46 total 528.72 last 73.07) - open/close/unlink 46114 (time 1788775966.47 total 538.72 last 65.68) - open/close/unlink 46840 (time 1788775976.48 total 548.74 last 72.52) - open/close/unlink 47978 (time 1788775986.48 total 558.74 last 113.75) - open/close/unlink 49034 (time 1788775996.49 total 568.75 last 105.50) - - open/close/unlink 626 (time 1788775437.95 total 10.00 last 62.58) - open/close/unlink 1216 (time 1788775447.96 total 20.02 last 58.93) - open/close/unlink 1838 (time 1788775457.96 total 30.02 last 62.17) - open/close/unlink 2468 (time 1788775467.97 total 40.03 last 62.94) - open/close/unlink 3121 (time 1788775477.98 total 50.04 last 65.24) - open/close/unlink 3755 (time 1788775487.99 total 60.05 last 63.35) - open/close/unlink 4369 (time 1788775498.00 total 70.06 last 61.33) - open/close/unlink 5082 (time 1788775508.01 total 80.07 last 71.24) - open/close/unlink 5771 (time 1788775518.02 total 90.07 last 68.86) - open/close/unlink 6555 (time 1788775528.02 total 100.07 last 78.40) - open/close/unlink 7713 (time 1788775538.02 total 110.07 last 115.79) - open/close/unlink 8882 (time 1788775548.02 total 120.08 last 116.86) - open/close/unlink 9916 (time 1788775558.03 total 130.08 last 103.35) - open/close/unlink 10794 (time 1788775568.04 total 140.09 last 87.72) - open/close/unlink 11850 (time 1788775578.04 total 150.09 last 105.58) - open/close/unlink 12810 (time 1788775588.04 total 160.10 last 95.94) - open/close/unlink 14064 (time 1788775598.05 total 170.10 last 125.35) - open/close/unlink 15435 (time 1788775608.06 total 180.11 last 137.01) - open/close/unlink 16453 (time 1788775618.06 total 190.12 last 101.73) - open/close/unlink 17240 (time 1788775628.07 total 200.12 last 78.67) - open/close/unlink 18184 (time 1788775638.07 total 210.13 last 94.37) - open/close/unlink 19182 (time 1788775648.08 total 220.13 last 99.73) - open/close/unlink 20000 (time 1788775657.63 total 229.68 last 85.66) - open/close/unlink 20901 (time 1788775667.63 total 239.69 last 90.07) - open/close/unlink 21702 (time 1788775677.64 total 249.70 last 80.00) - open/close/unlink 22580 (time 1788775687.65 total 259.71 last 87.71) - open/close/unlink 23588 (time 1788775697.65 total 269.71 last 100.78) - open/close/unlink 24487 (time 1788775707.66 total 279.71 last 89.88) - open/close/unlink 25300 (time 1788775717.67 total 289.72 last 81.22) - open/close/unlink 26375 (time 1788775727.67 total 299.73 last 107.43) - open/close/unlink 27309 (time 1788775737.67 total 309.73 last 93.39) - open/close/unlink 28219 (time 1788775747.68 total 319.74 last 90.93) - open/close/unlink 29245 (time 1788775757.69 total 329.74 last 102.54) - open/close/unlink 30000 (time 1788775766.36 total 338.42 last 87.01) - open/close/unlink 30915 (time 1788775776.37 total 348.42 last 91.48) - open/close/unlink 31773 (time 1788775786.37 total 358.42 last 85.79) - open/close/unlink 32518 (time 1788775796.38 total 368.44 last 74.41) - open/close/unlink 33204 (time 1788775806.39 total 378.45 last 68.53) - open/close/unlink 34002 (time 1788775816.40 total 388.46 last 79.72) - open/close/unlink 34923 (time 1788775826.40 total 398.46 last 92.10) - open/close/unlink 35883 (time 1788775836.41 total 408.46 last 95.94) - open/close/unlink 36502 (time 1788775846.43 total 418.48 last 61.78) - open/close/unlink 37269 (time 1788775856.44 total 428.49 last 76.62) - open/close/unlink 38200 (time 1788775866.44 total 438.50 last 93.07) - open/close/unlink 39126 (time 1788775876.45 total 448.50 last 92.52) - open/close/unlink 39940 (time 1788775886.46 total 458.51 last 81.33) - open/close/unlink 40690 (time 1788775896.46 total 468.52 last 74.97) - open/close/unlink 41683 (time 1788775906.47 total 478.53 last 99.18) - open/close/unlink 42397 (time 1788775916.49 total 488.54 last 71.28) - open/close/unlink 43091 (time 1788775926.50 total 498.55 last 69.35) - open/close/unlink 43843 (time 1788775936.51 total 508.57 last 75.09) - open/close/unlink 44720 (time 1788775946.51 total 518.57 last 87.69) - open/close/unlink 45456 (time 1788775956.52 total 528.58 last 73.52) - open/close/unlink 46121 (time 1788775966.53 total 538.59 last 66.45) - open/close/unlink 46847 (time 1788775976.53 total 548.59 last 72.58) - open/close/unlink 47984 (time 1788775986.54 total 558.60 last 113.61) - open/close/unlink 49035 (time 1788775996.54 total 568.60 last 105.10) - - open/close/unlink 622 (time 1788775437.94 total 10.01 last 62.14) - open/close/unlink 1209 (time 1788775447.95 total 20.01 last 58.67) - open/close/unlink 1833 (time 1788775457.95 total 30.02 last 62.36) - open/close/unlink 2467 (time 1788775467.96 total 40.03 last 63.33) - open/close/unlink 3115 (time 1788775477.97 total 50.04 last 64.77) - open/close/unlink 3749 (time 1788775487.98 total 60.04 last 63.36) - open/close/unlink 4361 (time 1788775497.99 total 70.06 last 61.11) - open/close/unlink 5081 (time 1788775507.99 total 80.06 last 71.99) - open/close/unlink 5781 (time 1788775517.99 total 90.06 last 69.99) - open/close/unlink 6554 (time 1788775528.00 total 100.07 last 77.26) - open/close/unlink 7711 (time 1788775538.00 total 110.07 last 115.67) - open/close/unlink 8878 (time 1788775548.00 total 120.07 last 116.67) - open/close/unlink 9904 (time 1788775558.01 total 130.08 last 102.53) - open/close/unlink 10795 (time 1788775568.02 total 140.09 last 89.00) - open/close/unlink 11840 (time 1788775578.03 total 150.10 last 104.44) - open/close/unlink 12808 (time 1788775588.04 total 160.11 last 96.68) - open/close/unlink 14064 (time 1788775598.05 total 170.12 last 125.48) - open/close/unlink 15411 (time 1788775608.05 total 180.12 last 134.69) - open/close/unlink 16437 (time 1788775618.06 total 190.13 last 102.45) - open/close/unlink 17232 (time 1788775628.07 total 200.14 last 79.45) - open/close/unlink 18170 (time 1788775638.07 total 210.14 last 93.78) - open/close/unlink 19167 (time 1788775648.07 total 220.14 last 99.69) - open/close/unlink 20000 (time 1788775657.79 total 229.86 last 85.68) - open/close/unlink 20893 (time 1788775667.80 total 239.86 last 89.30) - open/close/unlink 21702 (time 1788775677.81 total 249.88 last 80.80) - open/close/unlink 22578 (time 1788775687.81 total 259.88 last 87.56) - open/close/unlink 23586 (time 1788775697.81 total 269.88 last 100.80) - open/close/unlink 24484 (time 1788775707.81 total 279.88 last 89.80) - open/close/unlink 25300 (time 1788775717.82 total 289.89 last 81.55) - open/close/unlink 26362 (time 1788775727.83 total 299.90 last 106.12) - open/close/unlink 27278 (time 1788775737.83 total 309.90 last 91.53) - open/close/unlink 28197 (time 1788775747.84 total 319.91 last 91.87) - open/close/unlink 29219 (time 1788775757.84 total 329.91 last 102.15) - open/close/unlink 30000 (time 1788775766.88 total 338.95 last 86.45) - open/close/unlink 30925 (time 1788775776.88 total 348.95 last 92.47) - open/close/unlink 31783 (time 1788775786.88 total 358.95 last 85.79) - open/close/unlink 32512 (time 1788775796.88 total 368.95 last 72.89) - open/close/unlink 33201 (time 1788775806.89 total 378.96 last 68.86) - open/close/unlink 34003 (time 1788775816.90 total 388.97 last 80.14) - open/close/unlink 34923 (time 1788775826.90 total 398.97 last 91.97) - open/close/unlink 35870 (time 1788775836.90 total 408.97 last 94.70) - open/close/unlink 36495 (time 1788775846.90 total 418.97 last 62.50) - open/close/unlink 37271 (time 1788775856.90 total 428.97 last 77.58) - open/close/unlink 38190 (time 1788775866.91 total 438.98 last 91.81) - open/close/unlink 39104 (time 1788775876.91 total 448.98 last 91.40) - open/close/unlink 39910 (time 1788775886.92 total 458.99 last 80.51) - open/close/unlink 40670 (time 1788775896.94 total 469.01 last 75.87) - open/close/unlink 41672 (time 1788775906.95 total 479.02 last 100.15) - open/close/unlink 42382 (time 1788775916.97 total 489.04 last 70.83) - open/close/unlink 43066 (time 1788775926.97 total 499.04 last 68.39) - open/close/unlink 43813 (time 1788775936.98 total 509.05 last 74.62) - open/close/unlink 44693 (time 1788775947.00 total 519.07 last 87.85) - open/close/unlink 45421 (time 1788775957.00 total 529.07 last 72.79) - open/close/unlink 46071 (time 1788775967.00 total 539.07 last 64.98) - open/close/unlink 46805 (time 1788775977.01 total 549.08 last 73.34) - open/close/unlink 47961 (time 1788775987.02 total 559.09 last 115.54) - open/close/unlink 48988 (time 1788775997.02 total 569.09 last 102.67) - - open/close/unlink 626 (time 1788775437.94 total 10.01 last 62.56) - open/close/unlink 1215 (time 1788775447.96 total 20.03 last 58.79) - open/close/unlink 1838 (time 1788775457.96 total 30.03 last 62.28) - open/close/unlink 2468 (time 1788775467.96 total 40.03 last 62.98) - open/close/unlink 3118 (time 1788775477.99 total 50.06 last 64.81) - open/close/unlink 3759 (time 1788775488.00 total 60.07 last 64.05) - open/close/unlink 4357 (time 1788775498.00 total 70.07 last 59.78) - open/close/unlink 5069 (time 1788775508.00 total 80.07 last 71.20) - open/close/unlink 5766 (time 1788775518.01 total 90.08 last 69.64) - open/close/unlink 6546 (time 1788775528.01 total 100.08 last 77.98) - open/close/unlink 7706 (time 1788775538.02 total 110.09 last 115.93) - open/close/unlink 8874 (time 1788775548.03 total 120.10 last 116.73) - open/close/unlink 9895 (time 1788775558.03 total 130.10 last 102.06) - open/close/unlink 10778 (time 1788775568.04 total 140.11 last 88.24) - open/close/unlink 11822 (time 1788775578.04 total 150.11 last 104.34) - open/close/unlink 12794 (time 1788775588.05 total 160.12 last 97.15) - open/close/unlink 14049 (time 1788775598.05 total 170.12 last 125.47) - open/close/unlink 15395 (time 1788775608.05 total 180.12 last 134.52) - open/close/unlink 16412 (time 1788775618.06 total 190.12 last 101.70) - open/close/unlink 17198 (time 1788775628.07 total 200.14 last 78.48) - open/close/unlink 18136 (time 1788775638.07 total 210.14 last 93.75) - open/close/unlink 19135 (time 1788775648.08 total 220.15 last 99.88) - open/close/unlink 19989 (time 1788775658.08 total 230.15 last 85.39) - open/close/unlink 20888 (time 1788775668.09 total 240.16 last 89.75) - open/close/unlink 21689 (time 1788775678.10 total 250.17 last 80.05) - open/close/unlink 22576 (time 1788775688.10 total 260.17 last 88.67) - open/close/unlink 23598 (time 1788775698.11 total 270.18 last 102.14) - open/close/unlink 24493 (time 1788775708.12 total 280.19 last 89.40) - open/close/unlink 25326 (time 1788775718.13 total 290.20 last 83.21) - open/close/unlink 26385 (time 1788775728.14 total 300.21 last 105.83) - open/close/unlink 27305 (time 1788775738.14 total 310.21 last 91.96) - open/close/unlink 28251 (time 1788775748.15 total 320.22 last 94.56) - open/close/unlink 29259 (time 1788775758.15 total 330.22 last 100.74) - open/close/unlink 30000 (time 1788775766.91 total 338.98 last 84.58) - open/close/unlink 30923 (time 1788775776.92 total 348.99 last 92.20) - open/close/unlink 31786 (time 1788775786.95 total 359.02 last 86.11) - open/close/unlink 32515 (time 1788775796.95 total 369.02 last 72.86) - open/close/unlink 33200 (time 1788775806.96 total 379.03 last 68.43) - open/close/unlink 34016 (time 1788775816.97 total 389.04 last 81.56) - open/close/unlink 34939 (time 1788775826.99 total 399.06 last 92.13) - open/close/unlink 35885 (time 1788775836.99 total 409.06 last 94.54) - open/close/unlink 36505 (time 1788775847.01 total 419.08 last 61.90) - open/close/unlink 37293 (time 1788775857.02 total 429.09 last 78.74) - open/close/unlink 38215 (time 1788775867.02 total 439.09 last 92.19) - open/close/unlink 39132 (time 1788775877.02 total 449.09 last 91.67) - open/close/unlink 39942 (time 1788775887.03 total 459.09 last 80.97) - open/close/unlink 40701 (time 1788775897.04 total 469.11 last 75.80) - open/close/unlink 41698 (time 1788775907.05 total 479.12 last 99.61) - open/close/unlink 42405 (time 1788775917.05 total 489.12 last 70.70) - open/close/unlink 43094 (time 1788775927.06 total 499.13 last 68.80) - open/close/unlink 43849 (time 1788775937.07 total 509.14 last 75.44) - open/close/unlink 44721 (time 1788775947.07 total 519.14 last 87.17) - open/close/unlink 45455 (time 1788775957.07 total 529.14 last 73.39) - open/close/unlink 46110 (time 1788775967.08 total 539.15 last 65.47) - open/close/unlink 46845 (time 1788775977.09 total 549.16 last 73.40) - open/close/unlink 48001 (time 1788775987.10 total 559.17 last 115.51) - open/close/unlink 49029 (time 1788775997.11 total 569.18 last 102.73) - - open/close/unlink 621 (time 1788775438.02 total 10.00 last 62.08) - open/close/unlink 1204 (time 1788775448.02 total 20.01 last 58.28) - open/close/unlink 1831 (time 1788775458.03 total 30.02 last 62.62) - open/close/unlink 2457 (time 1788775468.03 total 40.02 last 62.60) - open/close/unlink 3107 (time 1788775478.06 total 50.05 last 64.81) - open/close/unlink 3740 (time 1788775488.09 total 60.07 last 63.15) - open/close/unlink 4351 (time 1788775498.10 total 70.09 last 61.03) - open/close/unlink 5075 (time 1788775508.10 total 80.09 last 72.37) - open/close/unlink 5761 (time 1788775518.12 total 90.11 last 68.50) - open/close/unlink 6546 (time 1788775528.13 total 100.11 last 78.44) - open/close/unlink 7702 (time 1788775538.15 total 110.14 last 115.34) - open/close/unlink 8875 (time 1788775548.16 total 120.15 last 117.12) - open/close/unlink 9903 (time 1788775558.17 total 130.16 last 102.74) - open/close/unlink 10774 (time 1788775568.18 total 140.17 last 86.99) - open/close/unlink 11823 (time 1788775578.19 total 150.17 last 104.87) - open/close/unlink 12803 (time 1788775588.19 total 160.17 last 97.98) - open/close/unlink 14054 (time 1788775598.19 total 170.18 last 125.04) - open/close/unlink 15409 (time 1788775608.20 total 180.18 last 135.44) - open/close/unlink 16427 (time 1788775618.21 total 190.19 last 101.72) - open/close/unlink 17212 (time 1788775628.21 total 200.19 last 78.49) - open/close/unlink 18156 (time 1788775638.21 total 210.20 last 94.37) - open/close/unlink 19141 (time 1788775648.22 total 220.20 last 98.44) - open/close/unlink 20000 (time 1788775658.21 total 230.20 last 85.94) - open/close/unlink 20885 (time 1788775668.22 total 240.20 last 88.45) - open/close/unlink 21684 (time 1788775678.23 total 250.21 last 79.81) - open/close/unlink 22579 (time 1788775688.24 total 260.22 last 89.43) - open/close/unlink 23595 (time 1788775698.24 total 270.22 last 101.57) - open/close/unlink 24475 (time 1788775708.25 total 280.23 last 87.91) - open/close/unlink 25318 (time 1788775718.26 total 290.25 last 84.21) - open/close/unlink 26370 (time 1788775728.27 total 300.26 last 105.06) - open/close/unlink 27284 (time 1788775738.28 total 310.26 last 91.35) - open/close/unlink 28234 (time 1788775748.28 total 320.26 last 94.99) - open/close/unlink 29236 (time 1788775758.29 total 330.27 last 100.12) - open/close/unlink 30000 (time 1788775767.23 total 339.22 last 85.43) - open/close/unlink 30919 (time 1788775777.23 total 349.22 last 91.89) - open/close/unlink 31769 (time 1788775787.24 total 359.23 last 84.91) - open/close/unlink 32500 (time 1788775797.25 total 369.23 last 73.07) - open/close/unlink 33193 (time 1788775807.25 total 379.23 last 69.29) - open/close/unlink 34018 (time 1788775817.26 total 389.24 last 82.42) - open/close/unlink 34933 (time 1788775827.27 total 399.25 last 91.42) - open/close/unlink 35870 (time 1788775837.27 total 409.26 last 93.67) - open/close/unlink 36483 (time 1788775847.28 total 419.27 last 61.21) - open/close/unlink 37291 (time 1788775857.29 total 429.27 last 80.76) - open/close/unlink 38215 (time 1788775867.30 total 439.28 last 92.33) - open/close/unlink 39127 (time 1788775877.31 total 449.29 last 91.12) - open/close/unlink 39939 (time 1788775887.32 total 459.30 last 81.12) - open/close/unlink 40706 (time 1788775897.32 total 469.31 last 76.65) - open/close/unlink 41700 (time 1788775907.33 total 479.32 last 99.30) - open/close/unlink 42402 (time 1788775917.34 total 489.33 last 70.12) - open/close/unlink 43089 (time 1788775927.35 total 499.34 last 68.67) - open/close/unlink 43848 (time 1788775937.36 total 509.34 last 75.84) - open/close/unlink 44720 (time 1788775947.36 total 519.35 last 87.15) - open/close/unlink 45447 (time 1788775957.38 total 529.36 last 72.58) - open/close/unlink 46107 (time 1788775967.39 total 539.38 last 65.92) - open/close/unlink 46854 (time 1788775977.39 total 549.38 last 74.69) - open/close/unlink 48020 (time 1788775987.39 total 559.38 last 116.58) - open/close/unlink 49040 (time 1788775997.40 total 569.38 last 101.95) - open/close/unlink 49826 (time 1788776006.50 total 578.75 last 79.17) - open/close/unlink 50000 (time 1788776008.55 total 580.81 last 84.78) - open/close/unlink 50931 (time 1788776018.56 total 590.81 last 93.04) - open/close/unlink 51856 (time 1788776028.56 total 600.82 last 92.43) - open/close/unlink 52588 (time 1788776038.57 total 610.82 last 73.18) - open/close/unlink 53289 (time 1788776048.57 total 620.83 last 70.08) - open/close/unlink 54007 (time 1788776058.57 total 630.83 last 71.76) - open/close/unlink 54752 (time 1788776068.58 total 640.84 last 74.43) - open/close/unlink 55760 (time 1788776078.59 total 650.85 last 100.72) - open/close/unlink 56587 (time 1788776088.60 total 660.86 last 82.62) - open/close/unlink 57256 (time 1788776098.61 total 670.87 last 66.84) - open/close/unlink 57879 (time 1788776108.62 total 680.88 last 62.24) - open/close/unlink 58823 (time 1788776118.62 total 690.88 last 94.35) - open/close/unlink 59840 (time 1788776128.62 total 700.88 last 101.69) - open/close/unlink 60797 (time 1788776138.63 total 710.89 last 95.67) - open/close/unlink 61715 (time 1788776148.64 total 720.89 last 91.72) - open/close/unlink 62562 (time 1788776158.64 total 730.90 last 84.65) - open/close/unlink 63395 (time 1788776168.64 total 740.90 last 83.29) - open/close/unlink 64262 (time 1788776178.65 total 750.90 last 86.68) total: 64768 open/close/unlink in 756.66 seconds: 85.60 ops/second open/close/unlink 49827 (time 1788776006.54 total 578.60 last 79.19) - open/close/unlink 50000 (time 1788776008.60 total 580.66 last 83.92) - open/close/unlink 50930 (time 1788776018.61 total 590.66 last 92.98) - open/close/unlink 51851 (time 1788776028.62 total 600.68 last 91.94) - open/close/unlink 52593 (time 1788776038.63 total 610.69 last 74.14) - open/close/unlink 53293 (time 1788776048.63 total 620.69 last 70.00) - open/close/unlink 54010 (time 1788776058.64 total 630.70 last 71.65) - open/close/unlink 54750 (time 1788776068.65 total 640.70 last 73.93) - open/close/unlink 55764 (time 1788776078.65 total 650.71 last 101.39) - open/close/unlink 56593 (time 1788776088.66 total 660.72 last 82.82) - open/close/unlink 57262 (time 1788776098.67 total 670.73 last 66.83) - open/close/unlink 57877 (time 1788776108.68 total 680.74 last 61.42) - open/close/unlink 58825 (time 1788776118.69 total 690.74 last 94.75) - open/close/unlink 59844 (time 1788776128.69 total 700.75 last 101.84) - open/close/unlink 60800 (time 1788776138.70 total 710.75 last 95.59) - open/close/unlink 61710 (time 1788776148.70 total 720.75 last 91.00) - open/close/unlink 62565 (time 1788776158.70 total 730.75 last 85.49) - open/close/unlink 63398 (time 1788776168.70 total 740.75 last 83.29) - open/close/unlink 64263 (time 1788776178.71 total 750.76 last 86.42) total: 64768 open/close/unlink in 756.56 seconds: 85.61 ops/second open/close/unlink 49834 (time 1788776007.40 total 579.39 last 79.36) - open/close/unlink 50743 (time 1788776017.41 total 589.40 last 90.80) - open/close/unlink 51698 (time 1788776027.42 total 599.40 last 95.47) - open/close/unlink 52443 (time 1788776037.43 total 609.41 last 74.44) - open/close/unlink 53153 (time 1788776047.44 total 619.42 last 70.93) - open/close/unlink 53881 (time 1788776057.45 total 629.44 last 72.70) - open/close/unlink 54596 (time 1788776067.45 total 639.44 last 71.49) - open/close/unlink 55588 (time 1788776077.46 total 649.44 last 99.17) - open/close/unlink 56454 (time 1788776087.46 total 659.45 last 86.52) - open/close/unlink 57138 (time 1788776097.49 total 669.47 last 68.24) - open/close/unlink 57734 (time 1788776107.49 total 679.48 last 59.59) - open/close/unlink 58652 (time 1788776117.49 total 689.48 last 91.80) - open/close/unlink 59681 (time 1788776127.50 total 699.48 last 102.84) - open/close/unlink 60000 (time 1788776130.41 total 702.40 last 109.51) - open/close/unlink 60918 (time 1788776140.41 total 712.40 last 91.74) - open/close/unlink 61820 (time 1788776150.42 total 722.40 last 90.19) - open/close/unlink 62672 (time 1788776160.42 total 732.41 last 85.16) - open/close/unlink 63496 (time 1788776170.42 total 742.41 last 82.39) - open/close/unlink 64364 (time 1788776180.43 total 752.41 last 86.76) total: 64768 open/close/unlink in 758.02 seconds: 85.44 ops/second open/close/unlink 49825 (time 1788776007.11 total 579.18 last 79.59) - open/close/unlink 50000 (time 1788776009.23 total 581.30 last 82.28) - open/close/unlink 50950 (time 1788776019.24 total 591.31 last 94.92) - open/close/unlink 51851 (time 1788776029.26 total 601.33 last 89.96) - open/close/unlink 52597 (time 1788776039.27 total 611.34 last 74.50) - open/close/unlink 53290 (time 1788776049.31 total 621.37 last 69.06) - open/close/unlink 54021 (time 1788776059.31 total 631.38 last 73.08) - open/close/unlink 54779 (time 1788776069.32 total 641.39 last 75.71) - open/close/unlink 55802 (time 1788776079.33 total 651.40 last 102.19) - open/close/unlink 56592 (time 1788776089.33 total 661.40 last 78.99) - open/close/unlink 57269 (time 1788776099.34 total 671.41 last 67.63) - open/close/unlink 57911 (time 1788776109.34 total 681.41 last 64.20) - open/close/unlink 58865 (time 1788776119.34 total 691.41 last 95.37) - open/close/unlink 59894 (time 1788776129.36 total 701.42 last 102.79) - open/close/unlink 60820 (time 1788776139.37 total 711.44 last 92.50) - open/close/unlink 61741 (time 1788776149.37 total 721.44 last 92.09) - open/close/unlink 62582 (time 1788776159.37 total 731.44 last 84.05) - open/close/unlink 63403 (time 1788776169.37 total 741.44 last 82.09) - open/close/unlink 64271 (time 1788776179.38 total 751.45 last 86.71) total: 64768 open/close/unlink in 758.28 seconds: 85.41 ops/second open/close/unlink 49778 (time 1788776007.02 total 579.09 last 78.98) - open/close/unlink 50000 (time 1788776009.67 total 581.74 last 83.85) - open/close/unlink 50961 (time 1788776019.67 total 591.74 last 96.09) - open/close/unlink 51837 (time 1788776029.68 total 601.75 last 87.54) - open/close/unlink 52580 (time 1788776039.68 total 611.75 last 74.25) - open/close/unlink 53266 (time 1788776049.70 total 621.76 last 68.53) - open/close/unlink 54001 (time 1788776059.70 total 631.77 last 73.47) - open/close/unlink 54766 (time 1788776069.70 total 641.77 last 76.46) - open/close/unlink 55777 (time 1788776079.71 total 651.78 last 101.01) - open/close/unlink 56555 (time 1788776089.72 total 661.78 last 77.79) - open/close/unlink 57223 (time 1788776099.73 total 671.80 last 66.69) - open/close/unlink 57879 (time 1788776109.74 total 681.81 last 65.57) - open/close/unlink 58836 (time 1788776119.75 total 691.82 last 95.59) - open/close/unlink 59872 (time 1788776129.75 total 701.82 last 103.56) - open/close/unlink 60789 (time 1788776139.75 total 711.82 last 91.67) - open/close/unlink 61698 (time 1788776149.76 total 721.83 last 90.86) - open/close/unlink 62544 (time 1788776159.77 total 731.83 last 84.55) - open/close/unlink 63370 (time 1788776169.77 total 741.84 last 82.57) - open/close/unlink 64239 (time 1788776179.78 total 751.85 last 86.81) total: 64768 open/close/unlink in 759.61 seconds: 85.26 ops/second Waiting for MDT destroys to complete oleg640-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg640-client: oleg640-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg640-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg640-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg640-server stop mds service on oleg640-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg640-server stop mds service on oleg640-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg640-server unloading modules via unload_modules_local on: 'oleg640-server' oleg640-server: oleg640-server.virtnet: executing unload_modules_local oleg640-server: kmemleak disabled modules unloaded. pdsh@oleg640-client: oleg640-client: ssh exited with exit code 2 pdsh@oleg640-client: oleg640-server: ssh exited with exit code 2 pdsh@oleg640-client: oleg640-client: ssh exited with exit code 2 pdsh@oleg640-client: oleg640-server: ssh exited with exit code 2