== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 22:05:18 (1781229918) start mds service on oleg612-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg612-server: oleg612-server.virtnet: executing set_default_debug -1 all pdsh@oleg612-client: oleg612-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg612-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg612-server: oleg612-server.virtnet: executing set_default_debug -1 all pdsh@oleg612-client: oleg612-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg612-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg612-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg612-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg612-server: oleg612-server.virtnet: executing set_default_debug -1 all pdsh@oleg612-client: oleg612-server: ssh exited with exit code 1 Started lustre-OST0000 oleg612-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg612-client.virtnet: -o user_xattr,flock 192.168.206.112@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 994 (time 1781229966.13 total 10.01 last 99.32) - open/close/unlink 1893 (time 1781229976.14 total 20.02 last 89.82) - open/close/unlink 2992 (time 1781229986.14 total 30.02 last 109.87) - open/close/unlink 4134 (time 1781229996.15 total 40.03 last 114.12) - open/close/unlink 5241 (time 1781230006.15 total 50.03 last 110.65) - open/close/unlink 6202 (time 1781230016.16 total 60.04 last 96.01) - open/close/unlink 6966 (time 1781230026.17 total 70.06 last 76.28) - open/close/unlink 7767 (time 1781230036.18 total 80.06 last 80.10) - open/close/unlink 8772 (time 1781230046.18 total 90.06 last 100.44) - open/close/unlink 9978 (time 1781230056.19 total 100.07 last 120.49) - open/close/unlink 11128 (time 1781230066.19 total 110.07 last 114.98) - open/close/unlink 12278 (time 1781230076.19 total 120.08 last 114.98) - open/close/unlink 13366 (time 1781230086.20 total 130.08 last 108.79) - open/close/unlink 14463 (time 1781230096.20 total 140.08 last 109.66) - open/close/unlink 15637 (time 1781230106.20 total 150.08 last 117.39) - open/close/unlink 16999 (time 1781230116.20 total 160.08 last 136.20) - open/close/unlink 18195 (time 1781230126.21 total 170.09 last 119.44) - open/close/unlink 18979 (time 1781230136.22 total 180.10 last 78.36) - open/close/unlink 19850 (time 1781230146.23 total 190.11 last 87.01) - open/close/unlink 20691 (time 1781230156.24 total 200.12 last 84.00) - open/close/unlink 21701 (time 1781230166.24 total 210.12 last 100.99) - open/close/unlink 22626 (time 1781230176.26 total 220.14 last 92.32) - open/close/unlink 23492 (time 1781230186.27 total 230.15 last 86.56) - open/close/unlink 24449 (time 1781230196.28 total 240.16 last 95.61) - open/close/unlink 25196 (time 1781230206.28 total 250.17 last 74.64) - open/close/unlink 25947 (time 1781230216.29 total 260.17 last 75.07) - open/close/unlink 26730 (time 1781230226.30 total 270.18 last 78.21) - open/close/unlink 27510 (time 1781230236.31 total 280.19 last 77.95) - open/close/unlink 28322 (time 1781230246.31 total 290.19 last 81.19) - open/close/unlink 29051 (time 1781230256.32 total 300.20 last 72.84) - open/close/unlink 29741 (time 1781230266.33 total 310.21 last 68.93) - open/close/unlink 30000 (time 1781230269.43 total 313.31 last 83.45) - open/close/unlink 30715 (time 1781230279.44 total 323.32 last 71.45) - open/close/unlink 31514 (time 1781230289.47 total 333.35 last 79.67) - open/close/unlink 32439 (time 1781230299.47 total 343.35 last 92.47) - open/close/unlink 33538 (time 1781230309.47 total 353.35 last 109.87) - open/close/unlink 34601 (time 1781230319.49 total 363.37 last 106.14) - open/close/unlink 35507 (time 1781230329.50 total 373.38 last 90.51) - open/close/unlink 36392 (time 1781230339.50 total 383.38 last 88.45) - open/close/unlink 37205 (time 1781230349.50 total 393.38 last 81.29) - open/close/unlink 38025 (time 1781230359.50 total 403.38 last 82.00) - open/close/unlink 38928 (time 1781230369.50 total 413.39 last 90.28) - open/close/unlink 39653 (time 1781230379.51 total 423.39 last 72.44) - open/close/unlink 40000 (time 1781230383.88 total 427.76 last 79.45) - open/close/unlink 40823 (time 1781230393.89 total 437.77 last 82.25) - open/close/unlink 41653 (time 1781230403.89 total 447.77 last 82.94) - open/close/unlink 42303 (time 1781230413.91 total 457.79 last 64.89) - open/close/unlink 42871 (time 1781230423.91 total 467.80 last 56.77) - open/close/unlink 43432 (time 1781230433.93 total 477.81 last 56.01) - open/close/unlink 44062 (time 1781230443.94 total 487.83 last 62.91) - open/close/unlink 44770 (time 1781230453.95 total 497.83 last 70.78) - open/close/unlink 45453 (time 1781230463.95 total 507.84 last 68.25) - open/close/unlink 46131 (time 1781230473.96 total 517.85 last 67.73) - open/close/unlink 46778 (time 1781230483.97 total 527.85 last 64.66) - open/close/unlink 47456 (time 1781230493.98 total 537.86 last 67.72) - open/close/unlink 48176 (time 1781230504.00 total 547.88 last 71.91) - open/close/unlink 48901 (time 1781230514.01 total 557.89 last 72.4 - open/close/unlink 1003 (time 1781229966.08 total 10.01 last 100.22) - open/close/unlink 1892 (time 1781229976.08 total 20.01 last 88.87) - open/close/unlink 2994 (time 1781229986.09 total 30.02 last 110.08) - open/close/unlink 4154 (time 1781229996.10 total 40.02 last 115.97) - open/close/unlink 5268 (time 1781230006.11 total 50.04 last 111.27) - open/close/unlink 6239 (time 1781230016.12 total 60.05 last 96.97) - open/close/unlink 7009 (time 1781230026.14 total 70.07 last 76.87) - open/close/unlink 7797 (time 1781230036.14 total 80.07 last 78.76) - open/close/unlink 8798 (time 1781230046.15 total 90.08 last 100.04) - open/close/unlink 10000 (time 1781230056.05 total 99.98 last 121.41) - open/close/unlink 11132 (time 1781230066.06 total 109.98 last 113.14) - open/close/unlink 12294 (time 1781230076.07 total 119.99 last 116.07) - open/close/unlink 13373 (time 1781230086.07 total 130.00 last 107.86) - open/close/unlink 14475 (time 1781230096.08 total 140.00 last 110.14) - open/close/unlink 15649 (time 1781230106.08 total 150.01 last 117.31) - open/close/unlink 17007 (time 1781230116.08 total 160.01 last 135.80) - open/close/unlink 18221 (time 1781230126.09 total 170.02 last 121.32) - open/close/unlink 19000 (time 1781230136.10 total 180.03 last 77.81) - open/close/unlink 19874 (time 1781230146.12 total 190.04 last 87.29) - open/close/unlink 20699 (time 1781230156.12 total 200.05 last 82.45) - open/close/unlink 21707 (time 1781230166.12 total 210.05 last 100.78) - open/close/unlink 22628 (time 1781230176.13 total 220.06 last 92.03) - open/close/unlink 23502 (time 1781230186.14 total 230.07 last 87.33) - open/close/unlink 24458 (time 1781230196.15 total 240.07 last 95.53) - open/close/unlink 25200 (time 1781230206.15 total 250.08 last 74.14) - open/close/unlink 25943 (time 1781230216.16 total 260.08 last 74.28) - open/close/unlink 26718 (time 1781230226.17 total 270.10 last 77.42) - open/close/unlink 27496 (time 1781230236.18 total 280.10 last 77.73) - open/close/unlink 28303 (time 1781230246.18 total 290.11 last 80.64) - open/close/unlink 29033 (time 1781230256.19 total 300.12 last 72.96) - open/close/unlink 29719 (time 1781230266.20 total 310.13 last 68.52) - open/close/unlink 30000 (time 1781230269.62 total 313.54 last 82.25) - open/close/unlink 30708 (time 1781230279.62 total 323.55 last 70.79) - open/close/unlink 31510 (time 1781230289.63 total 333.56 last 80.08) - open/close/unlink 32446 (time 1781230299.65 total 343.57 last 93.48) - open/close/unlink 33548 (time 1781230309.65 total 353.58 last 110.17) - open/close/unlink 34614 (time 1781230319.66 total 363.58 last 106.55) - open/close/unlink 35514 (time 1781230329.66 total 373.59 last 89.94) - open/close/unlink 36400 (time 1781230339.67 total 383.59 last 88.57) - open/close/unlink 37209 (time 1781230349.68 total 393.60 last 80.82) - open/close/unlink 38047 (time 1781230359.68 total 403.61 last 83.74) - open/close/unlink 38949 (time 1781230369.69 total 413.61 last 90.16) - open/close/unlink 39665 (time 1781230379.70 total 423.62 last 71.53) - open/close/unlink 40000 (time 1781230383.95 total 427.88 last 78.78) - open/close/unlink 40831 (time 1781230393.95 total 437.88 last 83.08) - open/close/unlink 41665 (time 1781230403.95 total 447.88 last 83.39) - open/close/unlink 42310 (time 1781230413.97 total 457.89 last 64.40) - open/close/unlink 42874 (time 1781230423.99 total 467.92 last 56.25) - open/close/unlink 43444 (time 1781230434.01 total 477.93 last 56.93) - open/close/unlink 44063 (time 1781230444.01 total 487.94 last 61.86) - open/close/unlink 44779 (time 1781230454.02 total 497.94 last 71.57) - open/close/unlink 45467 (time 1781230464.02 total 507.95 last 68.79) - open/close/unlink 46138 (time 1781230474.02 total 517.95 last 67.08) - open/close/unlink 46774 (time 1781230484.04 total 527.97 last 63.46) - open/close/unlink 47459 (time 1781230494.05 total 537.98 last 68.43) - open/close/unlink 48184 (time 1781230504.06 total 547.98 last 72.47) - open/close/unlink 48899 (time 1781230514.06 total 557.99 last 71 - open/close/unlink 998 (time 1781229966.11 total 10.01 last 99.72) - open/close/unlink 1886 (time 1781229976.11 total 20.01 last 88.79) - open/close/unlink 2982 (time 1781229986.11 total 30.01 last 109.55) - open/close/unlink 4152 (time 1781229996.11 total 40.02 last 116.97) - open/close/unlink 5276 (time 1781230006.12 total 50.02 last 112.31) - open/close/unlink 6243 (time 1781230016.13 total 60.03 last 96.60) - open/close/unlink 7011 (time 1781230026.18 total 70.08 last 76.42) - open/close/unlink 7812 (time 1781230036.18 total 80.08 last 80.09) - open/close/unlink 8814 (time 1781230046.19 total 90.09 last 100.12) - open/close/unlink 10000 (time 1781230056.04 total 99.94 last 120.46) - open/close/unlink 11143 (time 1781230066.04 total 109.95 last 114.23) - open/close/unlink 12295 (time 1781230076.05 total 119.95 last 115.12) - open/close/unlink 13381 (time 1781230086.06 total 129.96 last 108.52) - open/close/unlink 14477 (time 1781230096.06 total 139.96 last 109.59) - open/close/unlink 15649 (time 1781230106.06 total 149.96 last 117.18) - open/close/unlink 17010 (time 1781230116.06 total 159.97 last 136.05) - open/close/unlink 18222 (time 1781230126.07 total 169.97 last 121.17) - open/close/unlink 19013 (time 1781230136.07 total 179.97 last 79.06) - open/close/unlink 19892 (time 1781230146.08 total 189.98 last 87.82) - open/close/unlink 20725 (time 1781230156.09 total 199.99 last 83.26) - open/close/unlink 21723 (time 1781230166.09 total 209.99 last 99.76) - open/close/unlink 22642 (time 1781230176.09 total 219.99 last 91.88) - open/close/unlink 23505 (time 1781230186.10 total 230.00 last 86.25) - open/close/unlink 24454 (time 1781230196.10 total 240.00 last 94.90) - open/close/unlink 25197 (time 1781230206.11 total 250.01 last 74.23) - open/close/unlink 25943 (time 1781230216.11 total 260.01 last 74.57) - open/close/unlink 26723 (time 1781230226.12 total 270.02 last 77.98) - open/close/unlink 27502 (time 1781230236.12 total 280.02 last 77.86) - open/close/unlink 28310 (time 1781230246.13 total 290.03 last 80.73) - open/close/unlink 29037 (time 1781230256.13 total 300.03 last 72.68) - open/close/unlink 29723 (time 1781230266.14 total 310.04 last 68.56) - open/close/unlink 30000 (time 1781230269.43 total 313.33 last 84.12) - open/close/unlink 30703 (time 1781230279.44 total 323.34 last 70.27) - open/close/unlink 31493 (time 1781230289.45 total 333.35 last 78.92) - open/close/unlink 32420 (time 1781230299.45 total 343.35 last 92.65) - open/close/unlink 33530 (time 1781230309.46 total 353.36 last 110.95) - open/close/unlink 34598 (time 1781230319.46 total 363.36 last 106.75) - open/close/unlink 35496 (time 1781230329.47 total 373.37 last 89.75) - open/close/unlink 36390 (time 1781230339.47 total 383.37 last 89.35) - open/close/unlink 37204 (time 1781230349.48 total 393.38 last 81.36) - open/close/unlink 38023 (time 1781230359.48 total 403.39 last 81.85) - open/close/unlink 38923 (time 1781230369.49 total 413.39 last 89.99) - open/close/unlink 39648 (time 1781230379.49 total 423.39 last 72.47) - open/close/unlink 40000 (time 1781230384.04 total 427.94 last 77.39) - open/close/unlink 40829 (time 1781230394.04 total 437.94 last 82.85) - open/close/unlink 41658 (time 1781230404.05 total 447.95 last 82.87) - open/close/unlink 42294 (time 1781230414.05 total 457.96 last 63.56) - open/close/unlink 42864 (time 1781230424.07 total 467.97 last 56.93) - open/close/unlink 43429 (time 1781230434.07 total 477.97 last 56.46) - open/close/unlink 44048 (time 1781230444.08 total 487.98 last 61.84) - open/close/unlink 44761 (time 1781230454.09 total 497.99 last 71.28) - open/close/unlink 45447 (time 1781230464.09 total 508.00 last 68.55) - open/close/unlink 46117 (time 1781230474.10 total 518.01 last 66.93) - open/close/unlink 46755 (time 1781230484.11 total 528.01 last 63.76) - open/close/unlink 47439 (time 1781230494.11 total 538.01 last 68.39) - open/close/unlink 48157 (time 1781230504.12 total 548.02 last 71.74) - open/close/unlink 48883 (time 1781230514.13 total 558.03 last 72.55 - open/close/unlink 991 (time 1781229966.09 total 10.01 last 98.99) - open/close/unlink 1887 (time 1781229976.10 total 20.02 last 89.54) - open/close/unlink 2986 (time 1781229986.10 total 30.02 last 109.86) - open/close/unlink 4140 (time 1781229996.11 total 40.03 last 115.34) - open/close/unlink 5263 (time 1781230006.11 total 50.03 last 112.25) - open/close/unlink 6232 (time 1781230016.12 total 60.04 last 96.84) - open/close/unlink 7002 (time 1781230026.12 total 70.04 last 76.97) - open/close/unlink 7777 (time 1781230036.13 total 80.05 last 77.43) - open/close/unlink 8784 (time 1781230046.14 total 90.06 last 100.61) - open/close/unlink 9994 (time 1781230056.14 total 100.06 last 120.99) - open/close/unlink 11134 (time 1781230066.14 total 110.06 last 113.98) - open/close/unlink 12289 (time 1781230076.14 total 120.06 last 115.49) - open/close/unlink 13351 (time 1781230086.15 total 130.07 last 106.15) - open/close/unlink 14449 (time 1781230096.15 total 140.07 last 109.77) - open/close/unlink 15632 (time 1781230106.15 total 150.07 last 118.27) - open/close/unlink 16982 (time 1781230116.15 total 160.07 last 134.99) - open/close/unlink 18172 (time 1781230126.15 total 170.07 last 118.98) - open/close/unlink 18954 (time 1781230136.16 total 180.08 last 78.17) - open/close/unlink 19825 (time 1781230146.16 total 190.08 last 87.05) - open/close/unlink 20000 (time 1781230148.17 total 192.09 last 87.22) - open/close/unlink 20869 (time 1781230158.18 total 202.10 last 86.85) - open/close/unlink 21914 (time 1781230168.18 total 212.10 last 104.48) - open/close/unlink 22720 (time 1781230178.18 total 222.10 last 80.59) - open/close/unlink 23616 (time 1781230188.19 total 232.11 last 89.53) - open/close/unlink 24587 (time 1781230198.19 total 242.11 last 97.07) - open/close/unlink 25292 (time 1781230208.20 total 252.12 last 70.42) - open/close/unlink 26050 (time 1781230218.20 total 262.12 last 75.79) - open/close/unlink 26864 (time 1781230228.20 total 272.13 last 81.38) - open/close/unlink 27653 (time 1781230238.22 total 282.14 last 78.81) - open/close/unlink 28468 (time 1781230248.22 total 292.14 last 81.44) - open/close/unlink 29146 (time 1781230258.23 total 302.15 last 67.78) - open/close/unlink 29885 (time 1781230268.23 total 312.15 last 73.88) - open/close/unlink 30592 (time 1781230278.23 total 322.15 last 70.66) - open/close/unlink 31391 (time 1781230288.23 total 332.16 last 79.89) - open/close/unlink 32277 (time 1781230298.24 total 342.16 last 88.56) - open/close/unlink 33341 (time 1781230308.24 total 352.16 last 106.39) - open/close/unlink 34477 (time 1781230318.25 total 362.17 last 113.52) - open/close/unlink 35369 (time 1781230328.25 total 372.18 last 89.14) - open/close/unlink 36242 (time 1781230338.26 total 382.18 last 87.26) - open/close/unlink 37097 (time 1781230348.28 total 392.20 last 85.34) - open/close/unlink 37888 (time 1781230358.28 total 402.20 last 79.09) - open/close/unlink 38819 (time 1781230368.29 total 412.21 last 93.03) - open/close/unlink 39558 (time 1781230378.30 total 422.23 last 73.77) - open/close/unlink 40000 (time 1781230384.15 total 428.07 last 75.61) - open/close/unlink 40825 (time 1781230394.16 total 438.08 last 82.44) - open/close/unlink 41662 (time 1781230404.17 total 448.09 last 83.62) - open/close/unlink 42293 (time 1781230414.19 total 458.12 last 62.93) - open/close/unlink 42866 (time 1781230424.21 total 468.13 last 57.20) - open/close/unlink 43437 (time 1781230434.22 total 478.14 last 57.06) - open/close/unlink 44070 (time 1781230444.22 total 488.14 last 63.27) - open/close/unlink 44782 (time 1781230454.22 total 498.14 last 71.20) - open/close/unlink 45466 (time 1781230464.23 total 508.15 last 68.34) - open/close/unlink 46135 (time 1781230474.23 total 518.15 last 66.90) - open/close/unlink 46782 (time 1781230484.24 total 528.16 last 64.66) - open/close/unlink 47471 (time 1781230494.24 total 538.16 last 68.87) - open/close/unlink 48198 (time 1781230504.25 total 548.18 last 72.62) - open/close/unlink 48914 (time 1781230514.26 total 558.18 last 71.5 - open/close/unlink 992 (time 1781229966.09 total 10.01 last 99.09) - open/close/unlink 1884 (time 1781229976.09 total 20.01 last 89.18) - open/close/unlink 2975 (time 1781229986.09 total 30.01 last 109.08) - open/close/unlink 4120 (time 1781229996.10 total 40.02 last 114.46) - open/close/unlink 5242 (time 1781230006.11 total 50.03 last 112.07) - open/close/unlink 6215 (time 1781230016.12 total 60.04 last 97.22) - open/close/unlink 6985 (time 1781230026.12 total 70.05 last 76.95) - open/close/unlink 7767 (time 1781230036.12 total 80.05 last 78.20) - open/close/unlink 8779 (time 1781230046.13 total 90.05 last 101.16) - open/close/unlink 9990 (time 1781230056.13 total 100.06 last 121.01) - open/close/unlink 11119 (time 1781230066.14 total 110.06 last 112.87) - open/close/unlink 12275 (time 1781230076.15 total 120.07 last 115.50) - open/close/unlink 13346 (time 1781230086.15 total 130.07 last 107.07) - open/close/unlink 14449 (time 1781230096.15 total 140.07 last 110.30) - open/close/unlink 15626 (time 1781230106.15 total 150.07 last 117.65) - open/close/unlink 16995 (time 1781230116.15 total 160.07 last 136.90) - open/close/unlink 18198 (time 1781230126.16 total 170.08 last 120.28) - open/close/unlink 18983 (time 1781230136.16 total 180.08 last 78.48) - open/close/unlink 19853 (time 1781230146.16 total 190.08 last 87.00) - open/close/unlink 20682 (time 1781230156.17 total 200.09 last 82.82) - open/close/unlink 21699 (time 1781230166.17 total 210.09 last 101.64) - open/close/unlink 22625 (time 1781230176.18 total 220.10 last 92.58) - open/close/unlink 23486 (time 1781230186.18 total 230.10 last 86.04) - open/close/unlink 24437 (time 1781230196.19 total 240.11 last 95.01) - open/close/unlink 25171 (time 1781230206.20 total 250.12 last 73.37) - open/close/unlink 25923 (time 1781230216.20 total 260.12 last 75.16) - open/close/unlink 26704 (time 1781230226.22 total 270.14 last 77.99) - open/close/unlink 27490 (time 1781230236.22 total 280.14 last 78.54) - open/close/unlink 28300 (time 1781230246.23 total 290.15 last 80.96) - open/close/unlink 29032 (time 1781230256.24 total 300.16 last 73.10) - open/close/unlink 29720 (time 1781230266.24 total 310.16 last 68.79) - open/close/unlink 30000 (time 1781230269.59 total 313.51 last 83.75) - open/close/unlink 30705 (time 1781230279.59 total 323.51 last 70.47) - open/close/unlink 31498 (time 1781230289.59 total 333.52 last 79.27) - open/close/unlink 32434 (time 1781230299.60 total 343.52 last 93.59) - open/close/unlink 33536 (time 1781230309.60 total 353.53 last 110.11) - open/close/unlink 34596 (time 1781230319.61 total 363.53 last 105.92) - open/close/unlink 35493 (time 1781230329.62 total 373.54 last 89.63) - open/close/unlink 36383 (time 1781230339.62 total 383.54 last 88.98) - open/close/unlink 37202 (time 1781230349.63 total 393.55 last 81.82) - open/close/unlink 38039 (time 1781230359.64 total 403.56 last 83.62) - open/close/unlink 38936 (time 1781230369.65 total 413.57 last 89.65) - open/close/unlink 39645 (time 1781230379.66 total 423.58 last 70.83) - open/close/unlink 40000 (time 1781230384.19 total 428.11 last 78.37) - open/close/unlink 40826 (time 1781230394.19 total 438.11 last 82.57) - open/close/unlink 41659 (time 1781230404.20 total 448.12 last 83.21) - open/close/unlink 42294 (time 1781230414.23 total 458.15 last 63.35) - open/close/unlink 42864 (time 1781230424.24 total 468.16 last 56.92) - open/close/unlink 43429 (time 1781230434.24 total 478.16 last 56.50) - open/close/unlink 44056 (time 1781230444.25 total 488.17 last 62.67) - open/close/unlink 44772 (time 1781230454.25 total 498.17 last 71.57) - open/close/unlink 45464 (time 1781230464.26 total 508.18 last 69.11) - open/close/unlink 46132 (time 1781230474.28 total 518.20 last 66.71) - open/close/unlink 46774 (time 1781230484.29 total 528.21 last 64.14) - open/close/unlink 47464 (time 1781230494.29 total 538.22 last 68.94) - open/close/unlink 48186 (time 1781230504.31 total 548.23 last 72.10) - open/close/unlink 48908 (time 1781230514.31 total 558.23 last 72.16) - open/close/unlink 49786 (time 1781230524.26 total 568.18 last 87.18) - open/close/unlink 50000 (time 1781230527.26 total 571.18 last 71.46) - open/close/unlink 50804 (time 1781230537.26 total 581.18 last 80.36) - open/close/unlink 51518 (time 1781230547.27 total 591.20 last 71.32) - open/close/unlink 52074 (time 1781230557.28 total 601.20 last 55.58) - open/close/unlink 52708 (time 1781230567.29 total 611.21 last 63.31) - open/close/unlink 53503 (time 1781230577.31 total 621.23 last 79.38) - open/close/unlink 54359 (time 1781230587.32 total 631.24 last 85.51) - open/close/unlink 55206 (time 1781230597.33 total 641.25 last 84.63) - open/close/unlink 56294 (time 1781230607.33 total 651.25 last 108.77) - open/close/unlink 57280 (time 1781230617.33 total 661.25 last 98.59) - open/close/unlink 58234 (time 1781230627.34 total 671.26 last 95.30) - open/close/unlink 59053 (time 1781230637.35 total 681.27 last 81.84) - open/close/unlink 59807 (time 1781230647.35 total 691.27 last 75.37) - open/close/unlink 60000 (time 1781230650.25 total 694.17 last 66.66) - open/close/unlink 60649 (time 1781230660.26 total 704.18 last 64.84) - open/close/unlink 61224 (time 1781230670.26 total 714.18 last 57.47) - open/close/unlink 61806 (time 1781230680.26 total 724.19 last 58.19) - open/close/unlink 62421 (time 1781230690.26 total 734.19 last 61.49) - open/close/unlink 63201 (time 1781230700.27 total 744.19 last 77.97) - open/close/unlink 63961 (time 1781230710.27 total 754.19 last 75.97) total: 64768 open/close/unlink in 763.55 seconds: 84.83 ops/second ) - open/close/unlink 49741 (time 1781230524.15 total 568.05 last 85.64) - open/close/unlink 50000 (time 1781230527.83 total 571.73 last 70.28) - open/close/unlink 50809 (time 1781230537.83 total 581.73 last 80.90) - open/close/unlink 51512 (time 1781230547.83 total 591.74 last 70.28) - open/close/unlink 52062 (time 1781230557.84 total 601.74 last 54.97) - open/close/unlink 52700 (time 1781230567.85 total 611.75 last 63.73) - open/close/unlink 53506 (time 1781230577.86 total 621.77 last 80.50) - open/close/unlink 54363 (time 1781230587.87 total 631.77 last 85.68) - open/close/unlink 55216 (time 1781230597.87 total 641.77 last 85.25) - open/close/unlink 56309 (time 1781230607.87 total 651.78 last 109.28) - open/close/unlink 57290 (time 1781230617.88 total 661.79 last 98.01) - open/close/unlink 58233 (time 1781230627.89 total 671.79 last 94.25) - open/close/unlink 59055 (time 1781230637.89 total 681.80 last 82.15) - open/close/unlink 59810 (time 1781230647.90 total 691.81 last 75.43) - open/close/unlink 60000 (time 1781230650.79 total 694.69 last 65.78) - open/close/unlink 60664 (time 1781230660.79 total 704.70 last 66.39) - open/close/unlink 61234 (time 1781230670.80 total 714.70 last 56.96) - open/close/unlink 61827 (time 1781230680.80 total 724.70 last 59.29) - open/close/unlink 62444 (time 1781230690.80 total 734.70 last 61.69) - open/close/unlink 63233 (time 1781230700.82 total 744.72 last 78.78) - open/close/unlink 63983 (time 1781230710.83 total 754.73 last 74.90) total: 64768 open/close/unlink in 763.99 seconds: 84.78 ops/second 8) - open/close/unlink 49771 (time 1781230524.31 total 568.23 last 86.27) - open/close/unlink 50000 (time 1781230527.50 total 571.42 last 71.78) - open/close/unlink 50803 (time 1781230537.51 total 581.43 last 80.25) - open/close/unlink 51505 (time 1781230547.52 total 591.44 last 70.11) - open/close/unlink 52055 (time 1781230557.52 total 601.44 last 55.00) - open/close/unlink 52695 (time 1781230567.53 total 611.46 last 63.93) - open/close/unlink 53489 (time 1781230577.54 total 621.46 last 79.37) - open/close/unlink 54341 (time 1781230587.54 total 631.46 last 85.18) - open/close/unlink 55196 (time 1781230597.54 total 641.46 last 85.50) - open/close/unlink 56307 (time 1781230607.54 total 651.46 last 111.08) - open/close/unlink 57286 (time 1781230617.55 total 661.47 last 97.88) - open/close/unlink 58236 (time 1781230627.55 total 671.47 last 94.94) - open/close/unlink 59049 (time 1781230637.55 total 681.47 last 81.29) - open/close/unlink 59801 (time 1781230647.56 total 691.48 last 75.16) - open/close/unlink 60000 (time 1781230650.65 total 694.57 last 64.38) - open/close/unlink 60663 (time 1781230660.66 total 704.58 last 66.21) - open/close/unlink 61226 (time 1781230670.67 total 714.59 last 56.25) - open/close/unlink 61809 (time 1781230680.68 total 724.60 last 58.26) - open/close/unlink 62430 (time 1781230690.68 total 734.60 last 62.08) - open/close/unlink 63218 (time 1781230700.69 total 744.61 last 78.73) - open/close/unlink 63971 (time 1781230710.69 total 754.61 last 75.28) total: 64768 open/close/unlink in 764.03 seconds: 84.77 ops/second .46) - open/close/unlink 49757 (time 1781230524.07 total 567.99 last 85.76) - open/close/unlink 50000 (time 1781230527.46 total 571.39 last 71.52) - open/close/unlink 50807 (time 1781230537.47 total 581.39 last 80.67) - open/close/unlink 51517 (time 1781230547.48 total 591.41 last 70.90) - open/close/unlink 52068 (time 1781230557.49 total 601.41 last 55.07) - open/close/unlink 52705 (time 1781230567.50 total 611.42 last 63.63) - open/close/unlink 53501 (time 1781230577.51 total 621.43 last 79.53) - open/close/unlink 54349 (time 1781230587.51 total 631.44 last 84.73) - open/close/unlink 55199 (time 1781230597.52 total 641.44 last 84.97) - open/close/unlink 56310 (time 1781230607.52 total 651.45 last 111.07) - open/close/unlink 57292 (time 1781230617.52 total 661.45 last 98.16) - open/close/unlink 58237 (time 1781230627.53 total 671.45 last 94.46) - open/close/unlink 59061 (time 1781230637.54 total 681.47 last 82.30) - open/close/unlink 59811 (time 1781230647.55 total 691.48 last 74.88) - open/close/unlink 60000 (time 1781230650.46 total 694.38 last 65.13) - open/close/unlink 60654 (time 1781230660.47 total 704.40 last 65.31) - open/close/unlink 61223 (time 1781230670.49 total 714.42 last 56.79) - open/close/unlink 61813 (time 1781230680.50 total 724.42 last 58.95) - open/close/unlink 62428 (time 1781230690.51 total 734.44 last 61.40) - open/close/unlink 63210 (time 1781230700.52 total 744.45 last 78.14) - open/close/unlink 63961 (time 1781230710.54 total 754.46 last 75.00) total: 64768 open/close/unlink in 764.08 seconds: 84.77 ops/second 2) - open/close/unlink 49757 (time 1781230524.01 total 567.89 last 85.57) - open/close/unlink 50000 (time 1781230527.42 total 571.30 last 71.20) - open/close/unlink 50805 (time 1781230537.43 total 581.31 last 80.46) - open/close/unlink 51514 (time 1781230547.44 total 591.33 last 70.78) - open/close/unlink 52068 (time 1781230557.45 total 601.33 last 55.39) - open/close/unlink 52702 (time 1781230567.45 total 611.33 last 63.37) - open/close/unlink 53492 (time 1781230577.46 total 621.34 last 78.95) - open/close/unlink 54344 (time 1781230587.47 total 631.35 last 85.12) - open/close/unlink 55192 (time 1781230597.47 total 641.35 last 84.76) - open/close/unlink 56297 (time 1781230607.48 total 651.36 last 110.44) - open/close/unlink 57272 (time 1781230617.48 total 661.36 last 97.44) - open/close/unlink 58222 (time 1781230627.49 total 671.37 last 94.93) - open/close/unlink 59039 (time 1781230637.49 total 681.37 last 81.69) - open/close/unlink 59787 (time 1781230647.51 total 691.39 last 74.69) - open/close/unlink 60000 (time 1781230650.79 total 694.67 last 64.93) - open/close/unlink 60662 (time 1781230660.79 total 704.68 last 66.15) - open/close/unlink 61230 (time 1781230670.81 total 714.69 last 56.70) - open/close/unlink 61814 (time 1781230680.81 total 724.70 last 58.38) - open/close/unlink 62435 (time 1781230690.82 total 734.70 last 62.05) - open/close/unlink 63225 (time 1781230700.82 total 744.70 last 78.99) - open/close/unlink 63971 (time 1781230710.84 total 754.72 last 74.45) total: 64768 open/close/unlink in 764.25 seconds: 84.75 ops/second Waiting for MDT destroys to complete oleg612-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg612-client: oleg612-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg612-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg612-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg612-server stop mds service on oleg612-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg612-server stop mds service on oleg612-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg612-server unloading modules via unload_modules_local on: 'oleg612-server' oleg612-server: oleg612-server.virtnet: executing unload_modules_local oleg612-server: modules unloaded. pdsh@oleg612-client: oleg612-server: ssh exited with exit code 2 pdsh@oleg612-client: oleg612-client: ssh exited with exit code 2 pdsh@oleg612-client: oleg612-client: ssh exited with exit code 2 pdsh@oleg612-client: oleg612-server: ssh exited with exit code 2