== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 00:20:02 (1782361202) start mds service on oleg240-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg240-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg240-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg240-server: oleg240-server.virtnet: executing set_default_debug -1 all pdsh@oleg240-client: oleg240-server: ssh exited with exit code 1 Started lustre-OST0000 oleg240-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg240-client.virtnet: -o user_xattr,flock 192.168.202.140@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12329 425 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 837 (time 1782361230.89 total 10.00 last 83.66) - open/close/unlink 1779 (time 1782361240.90 total 20.01 last 94.13) - open/close/unlink 2836 (time 1782361250.91 total 30.02 last 105.60) - open/close/unlink 3989 (time 1782361260.91 total 40.02 last 115.28) - open/close/unlink 4728 (time 1782361270.92 total 50.03 last 73.83) - open/close/unlink 5495 (time 1782361280.93 total 60.04 last 76.63) - open/close/unlink 6111 (time 1782361290.95 total 70.06 last 61.50) - open/close/unlink 6733 (time 1782361300.97 total 80.09 last 62.02) - open/close/unlink 7477 (time 1782361310.98 total 90.09 last 74.35) - open/close/unlink 8130 (time 1782361320.99 total 100.10 last 65.27) - open/close/unlink 8816 (time 1782361330.99 total 110.11 last 68.55) - open/close/unlink 9508 (time 1782361341.00 total 120.11 last 69.17) - open/close/unlink 10000 (time 1782361347.50 total 126.62 last 75.63) - open/close/unlink 10793 (time 1782361357.51 total 136.62 last 79.23) - open/close/unlink 11541 (time 1782361367.53 total 146.64 last 74.65) - open/close/unlink 12343 (time 1782361377.54 total 156.65 last 80.15) - open/close/unlink 13272 (time 1782361387.56 total 166.67 last 92.74) - open/close/unlink 14032 (time 1782361397.56 total 176.68 last 75.93) - open/close/unlink 15025 (time 1782361407.56 total 186.68 last 99.30) - open/close/unlink 16013 (time 1782361417.57 total 196.68 last 98.79) - open/close/unlink 17174 (time 1782361427.58 total 206.69 last 115.98) - open/close/unlink 18336 (time 1782361437.58 total 216.69 last 116.15) - open/close/unlink 19509 (time 1782361447.58 total 226.69 last 117.27) - open/close/unlink 20000 (time 1782361452.34 total 231.45 last 103.33) - open/close/unlink 21114 (time 1782361462.34 total 241.45 last 111.35) - open/close/unlink 22269 (time 1782361472.35 total 251.46 last 115.38) - open/close/unlink 23286 (time 1782361482.36 total 261.47 last 101.63) - open/close/unlink 24301 (time 1782361492.36 total 271.48 last 101.42) - open/close/unlink 25260 (time 1782361502.37 total 281.48 last 95.87) - open/close/unlink 26273 (time 1782361512.37 total 291.48 last 101.27) - open/close/unlink 27453 (time 1782361522.38 total 301.49 last 117.94) - open/close/unlink 28383 (time 1782361532.39 total 311.50 last 92.88) - open/close/unlink 29391 (time 1782361542.39 total 321.50 last 100.78) - open/close/unlink 30000 (time 1782361548.27 total 327.38 last 103.61) - open/close/unlink 30942 (time 1782361558.27 total 337.38 last 94.17) - open/close/unlink 31740 (time 1782361568.28 total 347.39 last 79.77) - open/close/unlink 32496 (time 1782361578.28 total 357.39 last 75.60) - open/close/unlink 33347 (time 1782361588.29 total 367.40 last 85.01) - open/close/unlink 34083 (time 1782361598.29 total 377.40 last 73.56) - open/close/unlink 34834 (time 1782361608.30 total 387.41 last 75.07) - open/close/unlink 35728 (time 1782361618.30 total 397.41 last 89.35) - open/close/unlink 36642 (time 1782361628.31 total 407.42 last 91.32) - open/close/unlink 37613 (time 1782361638.31 total 417.43 last 97.07) - open/close/unlink 38611 (time 1782361648.32 total 427.43 last 99.77) - open/close/unlink 39690 (time 1782361658.32 total 437.43 last 107.90) - open/close/unlink 40000 (time 1782361661.95 total 441.06 last 85.28) - open/close/unlink 41013 (time 1782361671.96 total 451.07 last 101.22) - open/close/unlink 41995 (time 1782361681.97 total 461.08 last 98.14) - open/close/unlink 42925 (time 1782361691.98 total 471.09 last 92.91) - open/close/unlink 43893 (time 1782361701.99 total 481.10 last 96.70) - open/close/unlink 44804 (time 1782361711.99 total 491.10 last 91.09) - open/close/unlink 45690 (time 1782361721.99 total 501.10 last 88.60) - open/close/unlink 46604 (time 1782361731.99 total 511.10 last 91.36) - open/close/unlink 47722 (time 1782361742.00 total 521.11 last 111.77) - open/close/unlink 48675 (time 1782361752.00 total 531.11 last 95.25) - open/close/unlink 49691 (time 1782361762.01 total 541.12 last 101.54) - open/close/unlink 50000 (time 1782361765.10 total 544.21 last 99. - open/close/unlink 837 (time 1782361230.93 total 10.00 last 83.68) - open/close/unlink 1785 (time 1782361240.94 total 20.01 last 94.75) - open/close/unlink 2836 (time 1782361250.95 total 30.02 last 104.98) - open/close/unlink 3989 (time 1782361260.96 total 40.03 last 115.21) - open/close/unlink 4726 (time 1782361270.96 total 50.04 last 73.63) - open/close/unlink 5484 (time 1782361280.99 total 60.06 last 75.64) - open/close/unlink 6108 (time 1782361291.00 total 70.07 last 62.30) - open/close/unlink 6739 (time 1782361301.02 total 80.09 last 63.00) - open/close/unlink 7489 (time 1782361311.03 total 90.10 last 74.88) - open/close/unlink 8140 (time 1782361321.04 total 100.11 last 65.05) - open/close/unlink 8831 (time 1782361331.04 total 110.11 last 69.08) - open/close/unlink 9528 (time 1782361341.05 total 120.12 last 69.65) - open/close/unlink 10000 (time 1782361347.32 total 126.39 last 75.26) - open/close/unlink 10773 (time 1782361357.33 total 136.40 last 77.25) - open/close/unlink 11516 (time 1782361367.33 total 146.40 last 74.29) - open/close/unlink 12307 (time 1782361377.34 total 156.41 last 79.04) - open/close/unlink 13254 (time 1782361387.34 total 166.41 last 94.66) - open/close/unlink 13996 (time 1782361397.35 total 176.42 last 74.16) - open/close/unlink 14986 (time 1782361407.35 total 186.42 last 98.95) - open/close/unlink 15962 (time 1782361417.36 total 196.43 last 97.56) - open/close/unlink 17129 (time 1782361427.36 total 206.43 last 116.68) - open/close/unlink 18293 (time 1782361437.39 total 216.46 last 116.00) - open/close/unlink 19478 (time 1782361447.40 total 226.47 last 118.38) - open/close/unlink 20000 (time 1782361452.60 total 231.67 last 100.45) - open/close/unlink 21118 (time 1782361462.60 total 241.68 last 111.74) - open/close/unlink 22250 (time 1782361472.61 total 251.68 last 113.11) - open/close/unlink 23251 (time 1782361482.62 total 261.69 last 100.01) - open/close/unlink 24274 (time 1782361492.63 total 271.70 last 102.22) - open/close/unlink 25224 (time 1782361502.63 total 281.70 last 94.95) - open/close/unlink 26212 (time 1782361512.64 total 291.71 last 98.72) - open/close/unlink 27405 (time 1782361522.65 total 301.72 last 119.25) - open/close/unlink 28327 (time 1782361532.65 total 311.72 last 92.13) - open/close/unlink 29334 (time 1782361542.66 total 321.73 last 100.65) - open/close/unlink 30000 (time 1782361549.18 total 328.25 last 102.14) - open/close/unlink 30959 (time 1782361559.18 total 338.25 last 95.87) - open/close/unlink 31746 (time 1782361569.18 total 348.25 last 78.69) - open/close/unlink 32502 (time 1782361579.19 total 358.26 last 75.53) - open/close/unlink 33366 (time 1782361589.20 total 368.28 last 86.30) - open/close/unlink 34096 (time 1782361599.21 total 378.28 last 72.99) - open/close/unlink 34848 (time 1782361609.21 total 388.28 last 75.15) - open/close/unlink 35770 (time 1782361619.22 total 398.29 last 92.18) - open/close/unlink 36685 (time 1782361629.22 total 408.29 last 91.47) - open/close/unlink 37694 (time 1782361639.23 total 418.30 last 100.82) - open/close/unlink 38675 (time 1782361649.24 total 428.31 last 98.00) - open/close/unlink 39739 (time 1782361659.24 total 438.32 last 106.31) - open/close/unlink 40000 (time 1782361662.17 total 441.24 last 89.17) - open/close/unlink 41007 (time 1782361672.17 total 451.25 last 100.67) - open/close/unlink 41991 (time 1782361682.18 total 461.25 last 98.39) - open/close/unlink 42917 (time 1782361692.18 total 471.25 last 92.58) - open/close/unlink 43878 (time 1782361702.19 total 481.26 last 96.03) - open/close/unlink 44795 (time 1782361712.19 total 491.26 last 91.63) - open/close/unlink 45684 (time 1782361722.20 total 501.27 last 88.83) - open/close/unlink 46599 (time 1782361732.21 total 511.28 last 91.45) - open/close/unlink 47715 (time 1782361742.21 total 521.28 last 111.52) - open/close/unlink 48669 (time 1782361752.22 total 531.29 last 95.33) - open/close/unlink 49695 (time 1782361762.23 total 541.30 last 102.54) - open/close/unlink 50000 (time 1782361765.31 total 544.38 last 98. - open/close/unlink 839 (time 1782361230.79 total 10.01 last 83.86) - open/close/unlink 1778 (time 1782361240.80 total 20.02 last 93.80) - open/close/unlink 2829 (time 1782361250.80 total 30.02 last 105.08) - open/close/unlink 3981 (time 1782361260.80 total 40.02 last 115.19) - open/close/unlink 4717 (time 1782361270.81 total 50.03 last 73.55) - open/close/unlink 5489 (time 1782361280.81 total 60.03 last 77.16) - open/close/unlink 6115 (time 1782361290.82 total 70.04 last 62.54) - open/close/unlink 6747 (time 1782361300.84 total 80.06 last 63.08) - open/close/unlink 7478 (time 1782361310.85 total 90.06 last 73.07) - open/close/unlink 8129 (time 1782361320.85 total 100.07 last 65.07) - open/close/unlink 8826 (time 1782361330.85 total 110.07 last 69.70) - open/close/unlink 9520 (time 1782361340.86 total 120.08 last 69.35) - open/close/unlink 10000 (time 1782361347.24 total 126.45 last 75.25) - open/close/unlink 10779 (time 1782361357.24 total 136.46 last 77.86) - open/close/unlink 11535 (time 1782361367.25 total 146.47 last 75.51) - open/close/unlink 12324 (time 1782361377.26 total 156.48 last 78.84) - open/close/unlink 13276 (time 1782361387.26 total 166.48 last 95.16) - open/close/unlink 14012 (time 1782361397.27 total 176.49 last 73.58) - open/close/unlink 15020 (time 1782361407.27 total 186.49 last 100.73) - open/close/unlink 16014 (time 1782361417.28 total 196.49 last 99.38) - open/close/unlink 17184 (time 1782361427.28 total 206.50 last 116.93) - open/close/unlink 18349 (time 1782361437.28 total 216.50 last 116.46) - open/close/unlink 19515 (time 1782361447.29 total 226.51 last 116.52) - open/close/unlink 20000 (time 1782361452.18 total 231.40 last 99.24) - open/close/unlink 21105 (time 1782361462.19 total 241.40 last 110.42) - open/close/unlink 22254 (time 1782361472.19 total 251.41 last 114.87) - open/close/unlink 23270 (time 1782361482.20 total 261.42 last 101.48) - open/close/unlink 24264 (time 1782361492.21 total 271.42 last 99.35) - open/close/unlink 25223 (time 1782361502.21 total 281.43 last 95.85) - open/close/unlink 26227 (time 1782361512.22 total 291.44 last 100.30) - open/close/unlink 27399 (time 1782361522.23 total 301.45 last 117.08) - open/close/unlink 28332 (time 1782361532.23 total 311.45 last 93.28) - open/close/unlink 29329 (time 1782361542.24 total 321.46 last 99.63) - open/close/unlink 30000 (time 1782361548.73 total 327.94 last 103.47) - open/close/unlink 30947 (time 1782361558.73 total 337.95 last 94.63) - open/close/unlink 31747 (time 1782361568.74 total 347.96 last 79.95) - open/close/unlink 32504 (time 1782361578.74 total 357.96 last 75.68) - open/close/unlink 33374 (time 1782361588.75 total 367.97 last 86.93) - open/close/unlink 34100 (time 1782361598.75 total 377.97 last 72.57) - open/close/unlink 34851 (time 1782361608.76 total 387.98 last 75.08) - open/close/unlink 35743 (time 1782361618.77 total 397.99 last 89.10) - open/close/unlink 36659 (time 1782361628.77 total 407.99 last 91.60) - open/close/unlink 37654 (time 1782361638.77 total 417.99 last 99.45) - open/close/unlink 38634 (time 1782361648.78 total 428.00 last 97.96) - open/close/unlink 39709 (time 1782361658.78 total 438.00 last 107.45) - open/close/unlink 40000 (time 1782361662.17 total 441.38 last 85.98) - open/close/unlink 41007 (time 1782361672.17 total 451.39 last 100.69) - open/close/unlink 41996 (time 1782361682.17 total 461.39 last 98.85) - open/close/unlink 42915 (time 1782361692.17 total 471.39 last 91.89) - open/close/unlink 43884 (time 1782361702.18 total 481.39 last 96.89) - open/close/unlink 44809 (time 1782361712.18 total 491.40 last 92.46) - open/close/unlink 45705 (time 1782361722.18 total 501.40 last 89.55) - open/close/unlink 46617 (time 1782361732.19 total 511.41 last 91.14) - open/close/unlink 47731 (time 1782361742.19 total 521.41 last 111.38) - open/close/unlink 48684 (time 1782361752.19 total 531.41 last 95.29) - open/close/unlink 49692 (time 1782361762.20 total 541.42 last 100.74) - open/close/unlink 50000 (time 1782361765.36 total 544.58 last 97.36 - open/close/unlink 835 (time 1782361230.92 total 10.01 last 83.44) - open/close/unlink 1785 (time 1782361240.93 total 20.01 last 94.95) - open/close/unlink 2835 (time 1782361250.94 total 30.02 last 104.93) - open/close/unlink 3985 (time 1782361260.94 total 40.03 last 114.90) - open/close/unlink 4718 (time 1782361270.95 total 50.03 last 73.29) - open/close/unlink 5484 (time 1782361280.96 total 60.04 last 76.49) - open/close/unlink 6102 (time 1782361290.96 total 70.05 last 61.77) - open/close/unlink 6734 (time 1782361300.98 total 80.07 last 63.07) - open/close/unlink 7478 (time 1782361310.99 total 90.07 last 74.37) - open/close/unlink 8123 (time 1782361321.00 total 100.08 last 64.44) - open/close/unlink 8813 (time 1782361331.01 total 110.10 last 68.89) - open/close/unlink 9508 (time 1782361341.02 total 120.10 last 69.50) - open/close/unlink 10000 (time 1782361347.47 total 126.55 last 76.24) - open/close/unlink 10788 (time 1782361357.47 total 136.55 last 78.79) - open/close/unlink 11538 (time 1782361367.48 total 146.56 last 74.96) - open/close/unlink 12329 (time 1782361377.49 total 156.57 last 78.98) - open/close/unlink 13266 (time 1782361387.50 total 166.58 last 93.62) - open/close/unlink 14009 (time 1782361397.50 total 176.58 last 74.29) - open/close/unlink 15002 (time 1782361407.50 total 186.59 last 99.25) - open/close/unlink 15986 (time 1782361417.51 total 196.59 last 98.34) - open/close/unlink 17158 (time 1782361427.51 total 206.60 last 117.17) - open/close/unlink 18327 (time 1782361437.52 total 216.60 last 116.82) - open/close/unlink 19493 (time 1782361447.52 total 226.61 last 116.55) - open/close/unlink 20000 (time 1782361452.50 total 231.59 last 101.84) - open/close/unlink 21110 (time 1782361462.50 total 241.59 last 110.99) - open/close/unlink 22242 (time 1782361472.51 total 251.59 last 113.16) - open/close/unlink 23246 (time 1782361482.52 total 261.60 last 100.30) - open/close/unlink 24255 (time 1782361492.53 total 271.61 last 100.80) - open/close/unlink 25207 (time 1782361502.53 total 281.62 last 95.15) - open/close/unlink 26200 (time 1782361512.54 total 291.62 last 99.26) - open/close/unlink 27379 (time 1782361522.54 total 301.62 last 117.87) - open/close/unlink 28291 (time 1782361532.54 total 311.63 last 91.17) - open/close/unlink 29289 (time 1782361542.54 total 321.63 last 99.77) - open/close/unlink 30000 (time 1782361549.49 total 328.57 last 102.38) - open/close/unlink 30949 (time 1782361559.50 total 338.58 last 94.81) - open/close/unlink 31728 (time 1782361569.50 total 348.59 last 77.85) - open/close/unlink 32488 (time 1782361579.52 total 358.60 last 75.88) - open/close/unlink 33359 (time 1782361589.53 total 368.61 last 87.05) - open/close/unlink 34084 (time 1782361599.53 total 378.61 last 72.48) - open/close/unlink 34829 (time 1782361609.54 total 388.62 last 74.41) - open/close/unlink 35747 (time 1782361619.55 total 398.63 last 91.76) - open/close/unlink 36650 (time 1782361629.55 total 408.63 last 90.28) - open/close/unlink 37670 (time 1782361639.55 total 418.63 last 101.99) - open/close/unlink 38651 (time 1782361649.55 total 428.64 last 98.04) - open/close/unlink 39688 (time 1782361659.57 total 438.65 last 103.55) - open/close/unlink 40000 (time 1782361663.34 total 442.42 last 82.78) - open/close/unlink 41017 (time 1782361673.35 total 452.43 last 101.62) - open/close/unlink 42014 (time 1782361683.35 total 462.44 last 99.63) - open/close/unlink 42929 (time 1782361693.36 total 472.44 last 91.44) - open/close/unlink 43881 (time 1782361703.37 total 482.45 last 95.10) - open/close/unlink 44794 (time 1782361713.37 total 492.45 last 91.30) - open/close/unlink 45714 (time 1782361723.37 total 502.46 last 91.98) - open/close/unlink 46657 (time 1782361733.38 total 512.46 last 94.26) - open/close/unlink 47752 (time 1782361743.38 total 522.46 last 109.46) - open/close/unlink 48682 (time 1782361753.39 total 532.47 last 92.96) - open/close/unlink 49708 (time 1782361763.39 total 542.47 last 102.58) - open/close/unlink 50000 (time 1782361766.56 total 545.65 last 91.8 - open/close/unlink 829 (time 1782361230.79 total 10.00 last 82.87) - open/close/unlink 1770 (time 1782361240.79 total 20.00 last 94.09) - open/close/unlink 2816 (time 1782361250.79 total 30.01 last 104.53) - open/close/unlink 3968 (time 1782361260.79 total 40.01 last 115.18) - open/close/unlink 4716 (time 1782361270.80 total 50.02 last 74.78) - open/close/unlink 5470 (time 1782361280.81 total 60.02 last 75.35) - open/close/unlink 6094 (time 1782361290.81 total 70.03 last 62.36) - open/close/unlink 6715 (time 1782361300.82 total 80.04 last 62.04) - open/close/unlink 7437 (time 1782361310.83 total 90.04 last 72.17) - open/close/unlink 8091 (time 1782361320.83 total 100.05 last 65.36) - open/close/unlink 8780 (time 1782361330.85 total 110.06 last 68.80) - open/close/unlink 9469 (time 1782361340.85 total 120.07 last 68.88) - open/close/unlink 10000 (time 1782361347.80 total 127.02 last 76.34) - open/close/unlink 10787 (time 1782361357.81 total 137.03 last 78.64) - open/close/unlink 11516 (time 1782361367.83 total 147.04 last 72.79) - open/close/unlink 12327 (time 1782361377.84 total 157.06 last 81.01) - open/close/unlink 13258 (time 1782361387.84 total 167.06 last 93.05) - open/close/unlink 14034 (time 1782361397.85 total 177.07 last 77.53) - open/close/unlink 15003 (time 1782361407.87 total 187.08 last 96.78) - open/close/unlink 15997 (time 1782361417.87 total 197.09 last 99.30) - open/close/unlink 17158 (time 1782361427.88 total 207.09 last 116.08) - open/close/unlink 18305 (time 1782361437.88 total 217.10 last 114.66) - open/close/unlink 19471 (time 1782361447.88 total 227.10 last 116.55) - open/close/unlink 20000 (time 1782361453.10 total 232.31 last 101.52) - open/close/unlink 21127 (time 1782361463.10 total 242.32 last 112.68) - open/close/unlink 22256 (time 1782361473.10 total 252.32 last 112.89) - open/close/unlink 23261 (time 1782361483.10 total 262.32 last 100.44) - open/close/unlink 24286 (time 1782361493.11 total 272.33 last 102.42) - open/close/unlink 25217 (time 1782361503.12 total 282.33 last 93.06) - open/close/unlink 26213 (time 1782361513.12 total 292.34 last 99.60) - open/close/unlink 27414 (time 1782361523.12 total 302.34 last 120.06) - open/close/unlink 28322 (time 1782361533.12 total 312.34 last 90.78) - open/close/unlink 29337 (time 1782361543.13 total 322.35 last 101.41) - open/close/unlink 30000 (time 1782361549.67 total 328.89 last 101.39) - open/close/unlink 30949 (time 1782361559.69 total 338.91 last 94.75) - open/close/unlink 31733 (time 1782361569.69 total 348.91 last 78.39) - open/close/unlink 32472 (time 1782361579.70 total 358.92 last 73.83) - open/close/unlink 33354 (time 1782361589.70 total 368.92 last 88.17) - open/close/unlink 34068 (time 1782361599.71 total 378.93 last 71.33) - open/close/unlink 34821 (time 1782361609.72 total 388.94 last 75.25) - open/close/unlink 35733 (time 1782361619.72 total 398.94 last 91.20) - open/close/unlink 36636 (time 1782361629.72 total 408.94 last 90.24) - open/close/unlink 37651 (time 1782361639.73 total 418.95 last 101.43) - open/close/unlink 38631 (time 1782361649.73 total 428.95 last 97.98) - open/close/unlink 39673 (time 1782361659.73 total 438.95 last 104.19) - open/close/unlink 40000 (time 1782361663.72 total 442.94 last 82.03) - open/close/unlink 41030 (time 1782361673.72 total 452.94 last 102.98) - open/close/unlink 42038 (time 1782361683.73 total 462.94 last 100.76) - open/close/unlink 42955 (time 1782361693.73 total 472.95 last 91.62) - open/close/unlink 43900 (time 1782361703.74 total 482.96 last 94.45) - open/close/unlink 44801 (time 1782361713.76 total 492.98 last 89.88) - open/close/unlink 45741 (time 1782361723.77 total 502.98 last 93.98) - open/close/unlink 46695 (time 1782361733.77 total 512.99 last 95.37) - open/close/unlink 47789 (time 1782361743.77 total 522.99 last 109.39) - open/close/unlink 48707 (time 1782361753.77 total 532.99 last 91.76) - open/close/unlink 49737 (time 1782361763.78 total 543.00 last 102.97) - open/close/unlink 50000 (time 1782361766.75 total 545.97 last 88) - open/close/unlink 51084 (time 1782361775.38 total 554.59 last 108.28) - open/close/unlink 51994 (time 1782361785.38 total 564.60 last 90.95) - open/close/unlink 52953 (time 1782361795.39 total 574.61 last 95.84) - open/close/unlink 53858 (time 1782361805.39 total 584.61 last 90.50) - open/close/unlink 54778 (time 1782361815.39 total 594.61 last 91.97) - open/close/unlink 55773 (time 1782361825.40 total 604.62 last 99.44) - open/close/unlink 56805 (time 1782361835.40 total 614.62 last 103.18) - open/close/unlink 57744 (time 1782361845.40 total 624.62 last 93.86) - open/close/unlink 58742 (time 1782361855.41 total 634.62 last 99.77) - open/close/unlink 59847 (time 1782361865.41 total 644.63 last 110.41) - open/close/unlink 60926 (time 1782361875.41 total 654.63 last 107.89) - open/close/unlink 62037 (time 1782361885.43 total 664.64 last 110.97) - open/close/unlink 63076 (time 1782361895.43 total 674.65 last 103.85) - open/close/unlink 64212 (time 1782361905.43 total 684.65 last 113.58) total: 64768 open/close/unlink in 688.92 seconds: 94.01 ops/second 97) - open/close/unlink 51096 (time 1782361775.10 total 554.21 last 109.58) - open/close/unlink 51999 (time 1782361785.11 total 564.22 last 90.26) - open/close/unlink 52953 (time 1782361795.11 total 574.22 last 95.35) - open/close/unlink 53849 (time 1782361805.11 total 584.22 last 89.58) - open/close/unlink 54761 (time 1782361815.12 total 594.23 last 91.17) - open/close/unlink 55766 (time 1782361825.12 total 604.23 last 100.47) - open/close/unlink 56807 (time 1782361835.13 total 614.24 last 104.03) - open/close/unlink 57741 (time 1782361845.13 total 624.24 last 93.33) - open/close/unlink 58730 (time 1782361855.13 total 634.24 last 98.89) - open/close/unlink 59816 (time 1782361865.14 total 644.25 last 108.57) - open/close/unlink 60899 (time 1782361875.14 total 654.25 last 108.30) - open/close/unlink 62004 (time 1782361885.14 total 664.26 last 110.42) - open/close/unlink 63029 (time 1782361895.15 total 674.26 last 102.44) - open/close/unlink 64163 (time 1782361905.15 total 684.26 last 113.38) total: 64768 open/close/unlink in 689.24 seconds: 93.97 ops/second 99) - open/close/unlink 51071 (time 1782361775.32 total 554.39 last 107.01) - open/close/unlink 51978 (time 1782361785.33 total 564.40 last 90.58) - open/close/unlink 52943 (time 1782361795.34 total 574.41 last 96.39) - open/close/unlink 53847 (time 1782361805.35 total 584.42 last 90.34) - open/close/unlink 54753 (time 1782361815.35 total 594.42 last 90.56) - open/close/unlink 55741 (time 1782361825.36 total 604.43 last 98.73) - open/close/unlink 56792 (time 1782361835.37 total 614.44 last 105.00) - open/close/unlink 57723 (time 1782361845.37 total 624.45 last 93.04) - open/close/unlink 58707 (time 1782361855.38 total 634.45 last 98.33) - open/close/unlink 59806 (time 1782361865.38 total 644.45 last 109.89) - open/close/unlink 60885 (time 1782361875.39 total 654.46 last 107.83) - open/close/unlink 61984 (time 1782361885.39 total 664.46 last 109.88) - open/close/unlink 63023 (time 1782361895.39 total 674.46 last 103.88) - open/close/unlink 64159 (time 1782361905.40 total 684.47 last 113.55) total: 64768 open/close/unlink in 689.78 seconds: 93.90 ops/second .40) - open/close/unlink 51081 (time 1782361776.76 total 555.98 last 108.02) - open/close/unlink 51987 (time 1782361786.77 total 565.98 last 90.56) - open/close/unlink 52944 (time 1782361796.77 total 575.99 last 95.65) - open/close/unlink 53839 (time 1782361806.77 total 585.99 last 89.46) - open/close/unlink 54763 (time 1782361816.78 total 596.00 last 92.36) - open/close/unlink 55784 (time 1782361826.79 total 606.01 last 101.97) - open/close/unlink 56793 (time 1782361836.80 total 616.02 last 100.77) - open/close/unlink 57736 (time 1782361846.84 total 626.06 last 93.92) - open/close/unlink 58775 (time 1782361856.85 total 636.07 last 103.84) - open/close/unlink 59911 (time 1782361866.85 total 646.07 last 113.59) - open/close/unlink 60964 (time 1782361876.85 total 656.07 last 105.28) - open/close/unlink 62056 (time 1782361886.85 total 666.07 last 109.19) - open/close/unlink 63102 (time 1782361896.86 total 676.08 last 104.50) - open/close/unlink 64280 (time 1782361906.87 total 686.09 last 117.75) total: 64768 open/close/unlink in 691.90 seconds: 93.61 ops/second 9) - open/close/unlink 51070 (time 1782361776.57 total 555.65 last 106.97) - open/close/unlink 51978 (time 1782361786.57 total 565.65 last 90.77) - open/close/unlink 52937 (time 1782361796.58 total 575.66 last 95.86) - open/close/unlink 53835 (time 1782361806.58 total 585.67 last 89.73) - open/close/unlink 54769 (time 1782361816.59 total 595.67 last 93.36) - open/close/unlink 55785 (time 1782361826.60 total 605.68 last 101.46) - open/close/unlink 56798 (time 1782361836.68 total 615.76 last 100.52) - open/close/unlink 57746 (time 1782361846.68 total 625.77 last 94.75) - open/close/unlink 58777 (time 1782361856.69 total 635.78 last 103.01) - open/close/unlink 59910 (time 1782361866.69 total 645.78 last 113.29) - open/close/unlink 60964 (time 1782361876.70 total 655.78 last 105.33) - open/close/unlink 62054 (time 1782361886.70 total 665.79 last 108.96) - open/close/unlink 63086 (time 1782361896.71 total 675.79 last 103.16) - open/close/unlink 64253 (time 1782361906.71 total 685.80 last 116.63) total: 64768 open/close/unlink in 691.84 seconds: 93.62 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg240-server: cannot open 'lustre-ost2': no such pool pdsh@oleg240-client: oleg240-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg240-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg240-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg240-server stop mds service on oleg240-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg240-server unloading modules via unload_modules_local on: 'oleg240-server' oleg240-server: oleg240-server.virtnet: executing unload_modules_local oleg240-server: modules unloaded. pdsh@oleg240-client: oleg240-client: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-server: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-client: ssh exited with exit code 2 pdsh@oleg240-client: oleg240-server: ssh exited with exit code 2