maven-failsafe-plugin Errors and BUILD SUCCESS?

Question

我的问题非常类似于这个:maven-failsafe-plugin失败和构建成功?

和我设法设置failsafe插件在测试失败时失败。

但是如果测试进入错误状态，failsafe插件仍然不会破坏构建。

.................
-------------------------------------------------------
   T E S T S
-------------------------------------------------------
Running xxxxx.IntegrationTierFunctionalTestCase
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.054 sec <<< FAILURE!
Results :
Tests in error:
  testException(xxxxx.IntegrationTierFunctionalTestCas
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
[WARNING] File encoding has not been set, using platform encoding Cp1252, i.e. build is
[INFO] [failsafe:verify {execution: functional-test-1024}]
[INFO] Failsafe report directory: C:projectsoec-integration-servertrunkoec-integrati
[WARNING] File encoding has not been set, using platform encoding Cp1252, i.e. build is
[INFO] [failsafe:integration-test {execution: functional-test-24}]
[INFO] Failsafe report directory: C:projectsoec-integration-servertrunkoec-integrati
.............
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESSFUL
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 58 seconds
[INFO] Finished at: Tue May 28 17:48:13 BST 2013
[INFO] Final Memory: 114M/781M
[INFO] ------------------------------------------------------------------------

for simplicy IntegrationTierFunctionalTestCase只包含以下代码

import org.junit.Test;
import static org.junit.Assert.fail;
public class IntegrationTierFunctionalTestCase 
{
    @Test
    public void testException(){
        //fail();
        throw new RuntimeException("super error");
    }
}

如果我取消注释fail()，整个构建正确失败，构建失败。但是如果我只是抛出一个异常，它就会失败，如上所示。

我们的插件配置是这样的

<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-failsafe-plugin</artifactId>
    <version>2.7</version>
    <configuration>
        <redirectTestOutputToFile>true</redirectTestOutputToFile>
        <systemPropertyVariables>
            <oec.env>TEST</oec.env>
            <mule.test.timeoutSecs>2400</mule.test.timeoutSecs>
        </systemPropertyVariables>
        <additionalClasspathElements>
            <additionalClasspathElement>${basedir}/src/main/resources/config</additionalClasspathElement>
            </additionalClasspathElement>
        </additionalClasspathElements>
    </configuration>
    <executions>
        <execution>
            <id>functional-test-1024</id>
            <phase>test</phase>
            <goals>
                <goal>integration-test</goal>
                <goal>verify</goal>
            </goals>
            <configuration>
                <includes>
                    <include>**/IntegrationTierFunctionalTestCase.java</include>
                </includes>
                <forkMode>once</forkMode>
                <argLine>-XX:MaxPermSize=256M -Xmx1024M</argLine>
            </configuration>
        </execution>
    </executions>
</plugin>

我错过了什么?不，我不想将它封装在try-catch块中并手动失败测试。

Answer 1

您需要两个执行块，因为maven-failsafe-plugin的验证目标旨在检查集成测试的结果。

  <executions>
    <execution>
        <id>functional-test-1024</id>
        <phase>test</phase>
        <goals>
            <goal>integration-test</goal>
        </goals>
        <configuration>
            <includes>
                <include>**/IntegrationTierFunctionalTestCase.java</include>
            </includes>
            <forkMode>once</forkMode>
            <argLine>-XX:MaxPermSize=256M -Xmx1024M</argLine>
        </configuration>
    </execution>
    <execution>
        <id>verify</id>
        <phase>verify</phase>
        <goals>
            <goal>verify</goal>
        </goals>
    </execution>
  </executions>

此外，您应该将maven-failsafe-plugin的版本更新为2.14.1，而不是2.7。更新:同时更新到2.17.

Answer 2

如果您像这样运行集成测试:

mvn test-compile failsafe:integration-test

那么你应该知道，根据关于failsafe的maven文档:

Failsafe Plugin将不会在集成测试阶段使构建失败，从而使后集成测试阶段得以执行。

我可以让构建失败，像这样:

mvn test-compile failsafe:integration-test failsafe:verify

下面是我的failsafe配置供参考:

        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-failsafe-plugin</artifactId>
            <version>2.19</version>
            <configuration>
                <includes>
                    <include>**/*IT.java</include>
                </includes>
            </configuration>
            <executions>
                <execution>
                    <goals>
                        <goal>integration-test</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>

Answer 3

请确认maven属性"maven.test.failure. "ignore"在任何maven pom.xml文件中都没有设置为"true"，因为它可能是在测试失败后而不是停止构建的唯一原因。

Answer 4

还有一个可能的原因。Failsafe验证正在寻找测试类，并期望它们位于${project.build中。/test-classes——如果你有不同的设置，它只会打印"No tests to run."，如果构建成功，不管集成测试阶段的结果是什么，它都会结束。

你必须设置testClassesDirectory插件配置:

<plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-failsafe-plugin</artifactId>
            <version>2.18.1</version>
            <configuration>
                <systemPropertyVariables>
                    <environmentType>${environmentType}</environmentType>
                </systemPropertyVariables>
                <summaryFile>${project.build.directory}/failsafe-reports/failsafe-summary.xml</summaryFile>
                <testClassesDirectory>${project.build.directory}/classes</testClassesDirectory>
                <suiteXmlFiles>
                    <suiteXmlFile>${suiteXml}</suiteXmlFile>
                </suiteXmlFiles>
            </configuration>