== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 21:43:46 (1789263826) start mds service on oleg126-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg126-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg126-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg126-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg126-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg126-server: oleg126-server.virtnet: executing set_default_debug -1 all pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 Started lustre-OST0000 oleg126-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg126-client.virtnet: -o user_xattr,flock 192.168.201.126@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 2205 (time 1789263871.22 total 10.00 last 220.45) - open/close/unlink 4417 (time 1789263881.22 total 20.00 last 221.19) - open/close/unlink 6519 (time 1789263891.22 total 30.00 last 210.18) - open/close/unlink 8598 (time 1789263901.23 total 40.01 last 207.82) - open/close/unlink 10000 (time 1789263907.41 total 46.19 last 226.65) - open/close/unlink 11667 (time 1789263917.43 total 56.21 last 166.44) - open/close/unlink 12344 (time 1789263927.45 total 66.24 last 67.52) - open/close/unlink 12810 (time 1789263937.48 total 76.26 last 46.50) - open/close/unlink 13191 (time 1789263947.48 total 86.26 last 38.09) - open/close/unlink 13603 (time 1789263957.48 total 96.27 last 41.17) - open/close/unlink 14324 (time 1789263967.49 total 106.27 last 72.04) - open/close/unlink 14987 (time 1789263977.50 total 116.28 last 66.28) - open/close/unlink 15645 (time 1789263987.50 total 126.28 last 65.79) - open/close/unlink 16150 (time 1789263997.51 total 136.29 last 50.45) - open/close/unlink 16645 (time 1789264007.51 total 146.29 last 49.49) - open/close/unlink 17268 (time 1789264017.51 total 156.30 last 62.27) - open/close/unlink 18039 (time 1789264027.52 total 166.30 last 77.05) - open/close/unlink 18872 (time 1789264037.53 total 176.31 last 83.23) - open/close/unlink 19708 (time 1789264047.54 total 186.32 last 83.51) - open/close/unlink 20000 (time 1789264050.95 total 189.73 last 85.74) - open/close/unlink 20772 (time 1789264060.95 total 199.73 last 77.19) - open/close/unlink 21635 (time 1789264070.96 total 209.74 last 86.24) - open/close/unlink 22308 (time 1789264080.96 total 219.74 last 67.29) - open/close/unlink 23111 (time 1789264090.97 total 229.75 last 80.23) - open/close/unlink 24035 (time 1789264100.98 total 239.76 last 92.26) - open/close/unlink 25180 (time 1789264110.98 total 249.76 last 114.48) - open/close/unlink 26094 (time 1789264120.99 total 259.77 last 91.33) - open/close/unlink 26812 (time 1789264130.99 total 269.77 last 71.78) - open/close/unlink 27567 (time 1789264140.99 total 279.78 last 75.49) - open/close/unlink 28199 (time 1789264151.00 total 289.78 last 63.14) - open/close/unlink 28914 (time 1789264161.01 total 299.79 last 71.43) - open/close/unlink 29714 (time 1789264171.02 total 309.80 last 79.96) - open/close/unlink 30000 (time 1789264174.92 total 313.70 last 73.23) - open/close/unlink 30748 (time 1789264184.93 total 323.71 last 74.74) - open/close/unlink 31457 (time 1789264194.94 total 333.72 last 70.83) - open/close/unlink 32142 (time 1789264204.95 total 343.73 last 68.45) - open/close/unlink 32983 (time 1789264214.96 total 353.74 last 84.01) - open/close/unlink 34003 (time 1789264224.97 total 363.75 last 101.94) - open/close/unlink 34847 (time 1789264234.98 total 373.76 last 84.31) - open/close/unlink 35603 (time 1789264244.98 total 383.76 last 75.58) - open/close/unlink 36349 (time 1789264254.99 total 393.77 last 74.54) - open/close/unlink 37052 (time 1789264265.00 total 403.78 last 70.22) - open/close/unlink 37947 (time 1789264275.00 total 413.78 last 89.50) - open/close/unlink 38694 (time 1789264285.00 total 423.78 last 74.67) - open/close/unlink 39249 (time 1789264295.02 total 433.80 last 55.38) - open/close/unlink 39746 (time 1789264305.03 total 443.81 last 49.66) - open/close/unlink 40000 (time 1789264309.98 total 448.76 last 51.33) - open/close/unlink 40616 (time 1789264319.98 total 458.76 last 61.58) - open/close/unlink 41175 (time 1789264329.98 total 468.76 last 55.90) - open/close/unlink 41716 (time 1789264339.98 total 478.76 last 54.10) - open/close/unlink 42299 (time 1789264350.00 total 488.78 last 58.20) - open/close/unlink 42973 (time 1789264360.02 total 498.80 last 67.28) - open/close/unlink 43591 (time 1789264370.04 total 508.82 last 61.67) - open/close/unlink 44314 (time 1789264380.05 total 518.83 last 72.23) - open/close/unlink 45095 (time 1789264390.05 total 528.83 last 78.10) - open/close/unlink 45817 (time 1789264400.06 total 538.84 last 72.14) - open/close/unlink 46615 (time 1789264410.08 total 548.86 last 79.63 - open/close/unlink 2211 (time 1789263871.47 total 10.00 last 221.10) - open/close/unlink 4444 (time 1789263881.47 total 20.00 last 223.26) - open/close/unlink 6480 (time 1789263891.47 total 30.01 last 203.50) - open/close/unlink 8588 (time 1789263901.48 total 40.01 last 210.74) - open/close/unlink 10000 (time 1789263907.69 total 46.23 last 227.16) - open/close/unlink 11639 (time 1789263917.69 total 56.23 last 163.85) - open/close/unlink 12313 (time 1789263927.70 total 66.23 last 67.36) - open/close/unlink 12776 (time 1789263937.70 total 76.23 last 46.30) - open/close/unlink 13155 (time 1789263947.71 total 86.24 last 37.88) - open/close/unlink 13568 (time 1789263957.73 total 96.27 last 41.20) - open/close/unlink 14296 (time 1789263967.74 total 106.27 last 72.76) - open/close/unlink 14948 (time 1789263977.74 total 116.27 last 65.19) - open/close/unlink 15617 (time 1789263987.74 total 126.27 last 66.89) - open/close/unlink 16127 (time 1789263997.74 total 136.28 last 50.97) - open/close/unlink 16624 (time 1789264007.77 total 146.31 last 49.57) - open/close/unlink 17235 (time 1789264017.77 total 156.31 last 61.09) - open/close/unlink 18006 (time 1789264027.78 total 166.31 last 77.06) - open/close/unlink 18839 (time 1789264037.78 total 176.32 last 83.24) - open/close/unlink 19663 (time 1789264047.79 total 186.33 last 82.35) - open/close/unlink 20000 (time 1789264051.66 total 190.20 last 87.00) - open/close/unlink 20754 (time 1789264061.67 total 200.20 last 75.37) - open/close/unlink 21614 (time 1789264071.67 total 210.20 last 86.00) - open/close/unlink 22295 (time 1789264081.68 total 220.21 last 68.05) - open/close/unlink 23099 (time 1789264091.68 total 230.22 last 80.35) - open/close/unlink 24039 (time 1789264101.69 total 240.22 last 93.96) - open/close/unlink 25190 (time 1789264111.69 total 250.22 last 115.07) - open/close/unlink 26074 (time 1789264121.71 total 260.24 last 88.23) - open/close/unlink 26793 (time 1789264131.71 total 270.25 last 71.89) - open/close/unlink 27532 (time 1789264141.71 total 280.25 last 73.88) - open/close/unlink 28163 (time 1789264151.72 total 290.26 last 63.05) - open/close/unlink 28878 (time 1789264161.73 total 300.27 last 71.41) - open/close/unlink 29694 (time 1789264171.74 total 310.28 last 81.55) - open/close/unlink 30000 (time 1789264175.77 total 314.30 last 75.96) - open/close/unlink 30741 (time 1789264185.78 total 324.31 last 74.05) - open/close/unlink 31438 (time 1789264195.78 total 334.31 last 69.69) - open/close/unlink 32149 (time 1789264205.79 total 344.32 last 71.02) - open/close/unlink 32984 (time 1789264215.80 total 354.33 last 83.43) - open/close/unlink 33983 (time 1789264225.81 total 364.35 last 99.75) - open/close/unlink 34828 (time 1789264235.82 total 374.36 last 84.41) - open/close/unlink 35599 (time 1789264245.83 total 384.37 last 77.02) - open/close/unlink 36347 (time 1789264255.84 total 394.38 last 74.75) - open/close/unlink 37056 (time 1789264265.85 total 404.38 last 70.86) - open/close/unlink 37978 (time 1789264275.85 total 414.39 last 92.15) - open/close/unlink 38691 (time 1789264285.87 total 424.40 last 71.17) - open/close/unlink 39245 (time 1789264295.87 total 434.41 last 55.37) - open/close/unlink 39735 (time 1789264305.89 total 444.42 last 48.94) - open/close/unlink 40000 (time 1789264310.97 total 449.51 last 52.12) - open/close/unlink 40616 (time 1789264320.98 total 459.51 last 61.55) - open/close/unlink 41198 (time 1789264330.99 total 469.53 last 58.12) - open/close/unlink 41738 (time 1789264341.02 total 479.55 last 53.86) - open/close/unlink 42336 (time 1789264351.03 total 489.57 last 59.73) - open/close/unlink 43003 (time 1789264361.04 total 499.57 last 66.65) - open/close/unlink 43616 (time 1789264371.04 total 509.58 last 61.27) - open/close/unlink 44357 (time 1789264381.06 total 519.59 last 73.99) - open/close/unlink 45148 (time 1789264391.06 total 529.60 last 79.06) - open/close/unlink 45867 (time 1789264401.06 total 539.60 last 71.89) - open/close/unlink 46641 (time 1789264411.08 total 549.61 last 77.31) - open/close/unlink 2207 (time 1789263871.46 total 10.00 last 220.64) - open/close/unlink 4426 (time 1789263881.47 total 20.01 last 221.84) - open/close/unlink 6477 (time 1789263891.47 total 30.01 last 205.08) - open/close/unlink 8602 (time 1789263901.47 total 40.01 last 212.40) - open/close/unlink 10000 (time 1789263907.64 total 46.18 last 226.73) - open/close/unlink 11620 (time 1789263917.64 total 56.18 last 161.98) - open/close/unlink 12291 (time 1789263927.64 total 66.18 last 67.08) - open/close/unlink 12757 (time 1789263937.65 total 76.19 last 46.54) - open/close/unlink 13135 (time 1789263947.66 total 86.20 last 37.78) - open/close/unlink 13545 (time 1789263957.66 total 96.20 last 40.99) - open/close/unlink 14269 (time 1789263967.66 total 106.20 last 72.37) - open/close/unlink 14926 (time 1789263977.67 total 116.21 last 65.65) - open/close/unlink 15599 (time 1789263987.68 total 126.22 last 67.22) - open/close/unlink 16111 (time 1789263997.68 total 136.23 last 51.19) - open/close/unlink 16601 (time 1789264007.71 total 146.25 last 48.88) - open/close/unlink 17224 (time 1789264017.73 total 156.27 last 62.18) - open/close/unlink 17989 (time 1789264027.74 total 166.28 last 76.44) - open/close/unlink 18820 (time 1789264037.74 total 176.28 last 83.05) - open/close/unlink 19648 (time 1789264047.75 total 186.29 last 82.73) - open/close/unlink 20000 (time 1789264051.75 total 190.29 last 87.99) - open/close/unlink 20752 (time 1789264061.76 total 200.30 last 75.16) - open/close/unlink 21614 (time 1789264071.77 total 210.31 last 86.11) - open/close/unlink 22284 (time 1789264081.79 total 220.33 last 66.87) - open/close/unlink 23088 (time 1789264091.79 total 230.34 last 80.34) - open/close/unlink 24036 (time 1789264101.80 total 240.35 last 94.71) - open/close/unlink 25190 (time 1789264111.81 total 250.35 last 115.35) - open/close/unlink 26076 (time 1789264121.81 total 260.35 last 88.57) - open/close/unlink 26794 (time 1789264131.83 total 270.37 last 71.71) - open/close/unlink 27537 (time 1789264141.83 total 280.37 last 74.24) - open/close/unlink 28162 (time 1789264151.84 total 290.38 last 62.49) - open/close/unlink 28874 (time 1789264161.85 total 300.39 last 71.07) - open/close/unlink 29693 (time 1789264171.87 total 310.41 last 81.81) - open/close/unlink 30000 (time 1789264176.00 total 314.54 last 74.31) - open/close/unlink 30742 (time 1789264186.01 total 324.55 last 74.12) - open/close/unlink 31450 (time 1789264196.01 total 334.55 last 70.77) - open/close/unlink 32161 (time 1789264206.02 total 344.56 last 71.06) - open/close/unlink 33005 (time 1789264216.02 total 354.57 last 84.33) - open/close/unlink 33984 (time 1789264226.03 total 364.57 last 97.85) - open/close/unlink 34817 (time 1789264236.04 total 374.58 last 83.18) - open/close/unlink 35589 (time 1789264246.06 total 384.60 last 77.08) - open/close/unlink 36331 (time 1789264256.06 total 394.60 last 74.16) - open/close/unlink 37045 (time 1789264266.07 total 404.61 last 71.33) - open/close/unlink 37981 (time 1789264276.09 total 414.63 last 93.49) - open/close/unlink 38664 (time 1789264286.09 total 424.63 last 68.29) - open/close/unlink 39214 (time 1789264296.11 total 434.65 last 54.90) - open/close/unlink 39710 (time 1789264306.12 total 444.66 last 49.54) - open/close/unlink 40000 (time 1789264311.41 total 449.95 last 54.74) - open/close/unlink 40608 (time 1789264321.42 total 459.96 last 60.76) - open/close/unlink 41186 (time 1789264331.43 total 469.97 last 57.76) - open/close/unlink 41709 (time 1789264341.44 total 479.98 last 52.24) - open/close/unlink 42312 (time 1789264351.46 total 490.00 last 60.21) - open/close/unlink 42973 (time 1789264361.46 total 500.00 last 66.07) - open/close/unlink 43600 (time 1789264371.46 total 510.01 last 62.66) - open/close/unlink 44347 (time 1789264381.47 total 520.01 last 74.65) - open/close/unlink 45148 (time 1789264391.49 total 530.03 last 79.97) - open/close/unlink 45875 (time 1789264401.49 total 540.03 last 72.68) - open/close/unlink 46636 (time 1789264411.50 total 550.04 last 76.03) - open/close/unlink 2192 (time 1789263871.46 total 10.00 last 219.15) - open/close/unlink 4407 (time 1789263881.46 total 20.01 last 221.43) - open/close/unlink 6445 (time 1789263891.47 total 30.01 last 203.71) - open/close/unlink 8574 (time 1789263901.48 total 40.02 last 212.76) - open/close/unlink 10000 (time 1789263907.77 total 46.31 last 226.55) - open/close/unlink 11621 (time 1789263917.77 total 56.31 last 162.10) - open/close/unlink 12288 (time 1789263927.78 total 66.32 last 66.65) - open/close/unlink 12746 (time 1789263937.78 total 76.32 last 45.77) - open/close/unlink 13120 (time 1789263947.79 total 86.34 last 37.36) - open/close/unlink 13536 (time 1789263957.80 total 96.34 last 41.56) - open/close/unlink 14266 (time 1789263967.81 total 106.35 last 72.95) - open/close/unlink 14923 (time 1789263977.81 total 116.35 last 65.69) - open/close/unlink 15586 (time 1789263987.82 total 126.36 last 66.26) - open/close/unlink 16094 (time 1789263997.82 total 136.36 last 50.79) - open/close/unlink 16594 (time 1789264007.83 total 146.37 last 49.95) - open/close/unlink 17221 (time 1789264017.85 total 156.40 last 62.53) - open/close/unlink 18007 (time 1789264027.86 total 166.41 last 78.53) - open/close/unlink 18829 (time 1789264037.87 total 176.41 last 82.17) - open/close/unlink 19661 (time 1789264047.88 total 186.42 last 83.11) - open/close/unlink 20000 (time 1789264051.69 total 190.23 last 88.86) - open/close/unlink 20761 (time 1789264061.70 total 200.24 last 76.05) - open/close/unlink 21624 (time 1789264071.72 total 210.26 last 86.15) - open/close/unlink 22297 (time 1789264081.73 total 220.27 last 67.24) - open/close/unlink 23102 (time 1789264091.73 total 230.27 last 80.46) - open/close/unlink 24041 (time 1789264101.73 total 240.27 last 93.88) - open/close/unlink 25193 (time 1789264111.74 total 250.28 last 115.17) - open/close/unlink 26082 (time 1789264121.74 total 260.28 last 88.84) - open/close/unlink 26799 (time 1789264131.76 total 270.30 last 71.58) - open/close/unlink 27531 (time 1789264141.76 total 280.31 last 73.16) - open/close/unlink 28162 (time 1789264151.77 total 290.31 last 63.04) - open/close/unlink 28867 (time 1789264161.79 total 300.34 last 70.35) - open/close/unlink 29684 (time 1789264171.82 total 310.36 last 81.52) - open/close/unlink 30000 (time 1789264175.97 total 314.51 last 76.05) - open/close/unlink 30740 (time 1789264185.98 total 324.52 last 73.96) - open/close/unlink 31447 (time 1789264195.98 total 334.52 last 70.70) - open/close/unlink 32163 (time 1789264205.98 total 344.52 last 71.59) - open/close/unlink 33011 (time 1789264215.98 total 354.52 last 84.77) - open/close/unlink 33990 (time 1789264225.99 total 364.54 last 97.79) - open/close/unlink 34820 (time 1789264236.01 total 374.55 last 82.85) - open/close/unlink 35588 (time 1789264246.01 total 384.56 last 76.79) - open/close/unlink 36333 (time 1789264256.02 total 394.56 last 74.44) - open/close/unlink 37041 (time 1789264266.03 total 404.57 last 70.76) - open/close/unlink 37977 (time 1789264276.03 total 414.57 last 93.55) - open/close/unlink 38669 (time 1789264286.05 total 424.59 last 69.10) - open/close/unlink 39219 (time 1789264296.05 total 434.60 last 54.96) - open/close/unlink 39713 (time 1789264306.06 total 444.60 last 49.36) - open/close/unlink 40000 (time 1789264311.45 total 449.99 last 53.27) - open/close/unlink 40611 (time 1789264321.47 total 460.01 last 60.98) - open/close/unlink 41187 (time 1789264331.48 total 470.02 last 57.55) - open/close/unlink 41720 (time 1789264341.49 total 480.03 last 53.25) - open/close/unlink 42309 (time 1789264351.49 total 490.03 last 58.87) - open/close/unlink 42965 (time 1789264361.51 total 500.05 last 65.51) - open/close/unlink 43589 (time 1789264371.51 total 510.05 last 62.37) - open/close/unlink 44341 (time 1789264381.53 total 520.07 last 75.04) - open/close/unlink 45134 (time 1789264391.53 total 530.08 last 79.28) - open/close/unlink 45853 (time 1789264401.53 total 540.08 last 71.90) - open/close/unlink 46617 (time 1789264411.54 total 550.08 last 76.36) - open/close/unlink 2197 (time 1789263871.46 total 10.00 last 219.65) - open/close/unlink 4424 (time 1789263881.47 total 20.00 last 222.67) - open/close/unlink 6477 (time 1789263891.47 total 30.01 last 205.16) - open/close/unlink 8598 (time 1789263901.48 total 40.01 last 212.03) - open/close/unlink 10000 (time 1789263907.69 total 46.23 last 225.45) - open/close/unlink 11609 (time 1789263917.70 total 56.23 last 160.88) - open/close/unlink 12280 (time 1789263927.70 total 66.24 last 67.07) - open/close/unlink 12741 (time 1789263937.70 total 76.24 last 46.08) - open/close/unlink 13124 (time 1789263947.72 total 86.26 last 38.23) - open/close/unlink 13532 (time 1789263957.75 total 96.28 last 40.70) - open/close/unlink 14256 (time 1789263967.77 total 106.31 last 72.21) - open/close/unlink 14910 (time 1789263977.78 total 116.32 last 65.36) - open/close/unlink 15590 (time 1789263987.78 total 126.32 last 67.98) - open/close/unlink 16093 (time 1789263997.80 total 136.33 last 50.23) - open/close/unlink 16590 (time 1789264007.80 total 146.34 last 49.66) - open/close/unlink 17214 (time 1789264017.82 total 156.36 last 62.30) - open/close/unlink 17995 (time 1789264027.83 total 166.37 last 78.03) - open/close/unlink 18826 (time 1789264037.84 total 176.38 last 83.00) - open/close/unlink 19658 (time 1789264047.85 total 186.38 last 83.17) - open/close/unlink 20000 (time 1789264051.79 total 190.33 last 86.72) - open/close/unlink 20746 (time 1789264061.79 total 200.33 last 74.57) - open/close/unlink 21602 (time 1789264071.80 total 210.34 last 85.56) - open/close/unlink 22270 (time 1789264081.81 total 220.34 last 66.75) - open/close/unlink 23078 (time 1789264091.81 total 230.34 last 80.80) - open/close/unlink 24006 (time 1789264101.81 total 240.35 last 92.78) - open/close/unlink 25159 (time 1789264111.82 total 250.35 last 115.21) - open/close/unlink 26043 (time 1789264121.82 total 260.36 last 88.33) - open/close/unlink 26762 (time 1789264131.83 total 270.37 last 71.83) - open/close/unlink 27495 (time 1789264141.84 total 280.38 last 73.24) - open/close/unlink 28121 (time 1789264151.86 total 290.40 last 62.50) - open/close/unlink 28834 (time 1789264161.87 total 300.41 last 71.23) - open/close/unlink 29655 (time 1789264171.87 total 310.41 last 82.07) - open/close/unlink 30000 (time 1789264176.61 total 315.15 last 72.84) - open/close/unlink 30737 (time 1789264186.61 total 325.15 last 73.67) - open/close/unlink 31453 (time 1789264196.62 total 335.16 last 71.53) - open/close/unlink 32165 (time 1789264206.64 total 345.18 last 71.07) - open/close/unlink 33029 (time 1789264216.64 total 355.18 last 86.38) - open/close/unlink 33988 (time 1789264226.65 total 365.19 last 95.85) - open/close/unlink 34812 (time 1789264236.65 total 375.19 last 82.34) - open/close/unlink 35595 (time 1789264246.67 total 385.20 last 78.20) - open/close/unlink 36347 (time 1789264256.67 total 395.21 last 75.19) - open/close/unlink 37041 (time 1789264266.67 total 405.21 last 69.38) - open/close/unlink 37986 (time 1789264276.67 total 415.21 last 94.46) - open/close/unlink 38658 (time 1789264286.69 total 425.23 last 67.10) - open/close/unlink 39213 (time 1789264296.71 total 435.24 last 55.41) - open/close/unlink 39695 (time 1789264306.71 total 445.24 last 48.20) - open/close/unlink 40000 (time 1789264312.34 total 450.88 last 54.16) - open/close/unlink 40610 (time 1789264322.34 total 460.88 last 60.98) - open/close/unlink 41208 (time 1789264332.34 total 470.88 last 59.78) - open/close/unlink 41723 (time 1789264342.37 total 480.90 last 51.39) - open/close/unlink 42349 (time 1789264352.38 total 490.92 last 62.53) - open/close/unlink 42994 (time 1789264362.38 total 500.92 last 64.49) - open/close/unlink 43614 (time 1789264372.38 total 510.92 last 61.98) - open/close/unlink 44361 (time 1789264382.38 total 520.92 last 74.70) - open/close/unlink 45157 (time 1789264392.38 total 530.92 last 79.58) - open/close/unlink 45887 (time 1789264402.40 total 540.93 last 72.92) - open/close/unlink 46640 (time 1789264412.40 total 550.93 last 75.29)) - open/close/unlink 47394 (time 1789264420.08 total 558.86 last 77.89) - open/close/unlink 48273 (time 1789264430.08 total 568.86 last 87.89) - open/close/unlink 49092 (time 1789264440.08 total 578.86 last 81.89) - open/close/unlink 49848 (time 1789264450.08 total 588.86 last 75.59) - open/close/unlink 50000 (time 1789264452.15 total 590.93 last 73.56) - open/close/unlink 50831 (time 1789264462.16 total 600.94 last 83.00) - open/close/unlink 51610 (time 1789264472.16 total 610.94 last 77.90) - open/close/unlink 52463 (time 1789264482.17 total 620.95 last 85.26) - open/close/unlink 53196 (time 1789264492.17 total 630.95 last 73.26) - open/close/unlink 53839 (time 1789264502.17 total 640.95 last 64.29) - open/close/unlink 54570 (time 1789264512.18 total 650.96 last 73.05) - open/close/unlink 55481 (time 1789264522.19 total 660.97 last 91.06) - open/close/unlink 56409 (time 1789264532.19 total 670.97 last 92.78) - open/close/unlink 57396 (time 1789264542.20 total 680.98 last 98.63) - open/close/unlink 58149 (time 1789264552.20 total 690.98 last 75.27) - open/close/unlink 58932 (time 1789264562.20 total 700.98 last 78.25) - open/close/unlink 59610 (time 1789264572.21 total 710.99 last 67.75) - open/close/unlink 60000 (time 1789264577.22 total 716.00 last 77.87) - open/close/unlink 60757 (time 1789264587.23 total 726.01 last 75.63) - open/close/unlink 61409 (time 1789264597.25 total 736.03 last 65.08) - open/close/unlink 61977 (time 1789264607.25 total 746.03 last 56.77) - open/close/unlink 62634 (time 1789264617.26 total 756.04 last 65.66) - open/close/unlink 63339 (time 1789264627.26 total 766.04 last 70.47) - open/close/unlink 64049 (time 1789264637.27 total 776.06 last 70.92) - open/close/unlink 64706 (time 1789264647.28 total 786.06 last 65.69) total: 64768 open/close/unlink in 787.05 seconds: 82.29 ops/second - open/close/unlink 47481 (time 1789264421.52 total 560.06 last 84.38) - open/close/unlink 48355 (time 1789264431.52 total 570.06 last 87.32) - open/close/unlink 49147 (time 1789264441.54 total 580.08 last 79.10) - open/close/unlink 49907 (time 1789264451.55 total 590.09 last 75.91) - open/close/unlink 50741 (time 1789264461.56 total 600.10 last 83.34) - open/close/unlink 51494 (time 1789264471.56 total 610.10 last 75.25) - open/close/unlink 52353 (time 1789264481.57 total 620.11 last 85.82) - open/close/unlink 53087 (time 1789264491.58 total 630.12 last 73.33) - open/close/unlink 53738 (time 1789264501.59 total 640.13 last 65.02) - open/close/unlink 54468 (time 1789264511.60 total 650.14 last 72.96) - open/close/unlink 55358 (time 1789264521.60 total 660.14 last 88.98) - open/close/unlink 56316 (time 1789264531.61 total 670.15 last 95.75) - open/close/unlink 57301 (time 1789264541.61 total 680.15 last 98.47) - open/close/unlink 58062 (time 1789264551.61 total 690.15 last 76.09) - open/close/unlink 58839 (time 1789264561.62 total 700.16 last 77.67) - open/close/unlink 59521 (time 1789264571.63 total 710.17 last 68.09) - open/close/unlink 60000 (time 1789264577.78 total 716.32 last 77.91) - open/close/unlink 60745 (time 1789264587.79 total 726.33 last 74.43) - open/close/unlink 61375 (time 1789264597.80 total 736.34 last 62.95) - open/close/unlink 61951 (time 1789264607.80 total 746.34 last 57.58) - open/close/unlink 62620 (time 1789264617.82 total 756.36 last 66.77) - open/close/unlink 63333 (time 1789264627.82 total 766.36 last 71.27) - open/close/unlink 64047 (time 1789264637.83 total 776.37 last 71.35) - open/close/unlink 64696 (time 1789264647.84 total 786.39 last 64.81) total: 64768 open/close/unlink in 787.97 seconds: 82.20 ops/second - open/close/unlink 47474 (time 1789264421.09 total 559.62 last 83.22) - open/close/unlink 48352 (time 1789264431.09 total 569.63 last 87.76) - open/close/unlink 49152 (time 1789264441.12 total 579.65 last 79.80) - open/close/unlink 49904 (time 1789264451.16 total 589.70 last 74.86) - open/close/unlink 50735 (time 1789264461.16 total 599.70 last 83.10) - open/close/unlink 51496 (time 1789264471.17 total 609.70 last 76.07) - open/close/unlink 52345 (time 1789264481.17 total 619.71 last 84.83) - open/close/unlink 53095 (time 1789264491.18 total 629.72 last 74.94) - open/close/unlink 53739 (time 1789264501.19 total 639.72 last 64.37) - open/close/unlink 54459 (time 1789264511.20 total 649.74 last 71.88) - open/close/unlink 55337 (time 1789264521.21 total 659.74 last 87.79) - open/close/unlink 56283 (time 1789264531.21 total 669.75 last 94.53) - open/close/unlink 57281 (time 1789264541.22 total 679.75 last 99.74) - open/close/unlink 58050 (time 1789264551.22 total 689.76 last 76.87) - open/close/unlink 58825 (time 1789264561.23 total 699.76 last 77.46) - open/close/unlink 59511 (time 1789264571.23 total 709.76 last 68.60) - open/close/unlink 60000 (time 1789264577.55 total 716.08 last 77.43) - open/close/unlink 60746 (time 1789264587.56 total 726.10 last 74.47) - open/close/unlink 61385 (time 1789264597.58 total 736.12 last 63.78) - open/close/unlink 61952 (time 1789264607.61 total 746.14 last 56.54) - open/close/unlink 62613 (time 1789264617.61 total 756.15 last 66.09) - open/close/unlink 63308 (time 1789264627.61 total 766.15 last 69.49) - open/close/unlink 64013 (time 1789264637.62 total 776.15 last 70.45) - open/close/unlink 64663 (time 1789264647.63 total 786.16 last 64.95) total: 64768 open/close/unlink in 788.82 seconds: 82.11 ops/second - open/close/unlink 47457 (time 1789264421.54 total 560.08 last 83.97) - open/close/unlink 48326 (time 1789264431.55 total 570.09 last 86.83) - open/close/unlink 49122 (time 1789264441.55 total 580.09 last 79.58) - open/close/unlink 49875 (time 1789264451.56 total 590.10 last 75.23) - open/close/unlink 50711 (time 1789264461.57 total 600.11 last 83.55) - open/close/unlink 51476 (time 1789264471.57 total 610.11 last 76.47) - open/close/unlink 52331 (time 1789264481.57 total 620.11 last 85.50) - open/close/unlink 53064 (time 1789264491.58 total 630.12 last 73.26) - open/close/unlink 53701 (time 1789264501.59 total 640.13 last 63.64) - open/close/unlink 54421 (time 1789264511.59 total 650.13 last 71.98) - open/close/unlink 55308 (time 1789264521.60 total 660.14 last 88.63) - open/close/unlink 56257 (time 1789264531.61 total 670.15 last 94.79) - open/close/unlink 57245 (time 1789264541.62 total 680.16 last 98.75) - open/close/unlink 58011 (time 1789264551.62 total 690.16 last 76.55) - open/close/unlink 58795 (time 1789264561.64 total 700.18 last 78.23) - open/close/unlink 59476 (time 1789264571.65 total 710.19 last 68.04) - open/close/unlink 60000 (time 1789264578.40 total 716.94 last 77.68) - open/close/unlink 60744 (time 1789264588.41 total 726.95 last 74.32) - open/close/unlink 61373 (time 1789264598.41 total 736.96 last 62.87) - open/close/unlink 61963 (time 1789264608.42 total 746.96 last 58.99) - open/close/unlink 62602 (time 1789264618.43 total 756.98 last 63.79) - open/close/unlink 63327 (time 1789264628.44 total 766.99 last 72.43) - open/close/unlink 64039 (time 1789264638.45 total 776.99 last 71.14) - open/close/unlink 64679 (time 1789264648.46 total 787.00 last 63.98) total: 64768 open/close/unlink in 789.90 seconds: 81.99 ops/second - open/close/unlink 47503 (time 1789264422.40 total 560.94 last 86.28) - open/close/unlink 48369 (time 1789264432.40 total 570.94 last 86.55) - open/close/unlink 49144 (time 1789264442.41 total 580.95 last 77.42) - open/close/unlink 49892 (time 1789264452.42 total 590.96 last 74.73) - open/close/unlink 50712 (time 1789264462.43 total 600.96 last 81.97) - open/close/unlink 51483 (time 1789264472.43 total 610.97 last 77.07) - open/close/unlink 52342 (time 1789264482.44 total 620.98 last 85.84) - open/close/unlink 53064 (time 1789264492.45 total 630.98 last 72.15) - open/close/unlink 53703 (time 1789264502.46 total 641.00 last 63.78) - open/close/unlink 54431 (time 1789264512.47 total 651.01 last 72.77) - open/close/unlink 55342 (time 1789264522.47 total 661.01 last 91.10) - open/close/unlink 56271 (time 1789264532.47 total 671.01 last 92.87) - open/close/unlink 57254 (time 1789264542.49 total 681.03 last 98.13) - open/close/unlink 58016 (time 1789264552.51 total 691.05 last 76.03) - open/close/unlink 58801 (time 1789264562.52 total 701.05 last 78.46) - open/close/unlink 59489 (time 1789264572.52 total 711.05 last 68.80) - open/close/unlink 60000 (time 1789264579.15 total 717.69 last 77.06) - open/close/unlink 60742 (time 1789264589.15 total 727.69 last 74.17) - open/close/unlink 61358 (time 1789264599.16 total 737.70 last 61.52) - open/close/unlink 61946 (time 1789264609.17 total 747.71 last 58.78) - open/close/unlink 62608 (time 1789264619.17 total 757.71 last 66.15) - open/close/unlink 63328 (time 1789264629.18 total 767.72 last 71.95) - open/close/unlink 64032 (time 1789264639.19 total 777.73 last 70.35) - open/close/unlink 64647 (time 1789264649.21 total 787.75 last 61.36) total: 64768 open/close/unlink in 791.57 seconds: 81.82 ops/second Waiting for MDT destroys to complete oleg126-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg126-client: oleg126-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg126-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg126-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg126-server stop mds service on oleg126-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg126-server stop mds service on oleg126-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg126-server unloading modules via unload_modules_local on: 'oleg126-server' oleg126-server: oleg126-server.virtnet: executing unload_modules_local oleg126-server: kmemleak disabled modules unloaded. pdsh@oleg126-client: oleg126-client: ssh exited with exit code 2 pdsh@oleg126-client: oleg126-server: ssh exited with exit code 2 pdsh@oleg126-client: oleg126-client: ssh exited with exit code 2 pdsh@oleg126-client: oleg126-server: ssh exited with exit code 2