什么在控制 TestNG 中的组测试顺序?

What is controlling the order of group tests in TestNG?

当我不使用 dependsonGroup=X 或 priority=X 等功能时,TestNG 如何确定 运行ning 组测试的顺序?

长话短说,我正在看这个测试站点:

http://www.tutorialspoint.com/testng/testng_group_test.htm

我剪切并粘贴了 3 个示例文件的行以尝试并尝试理解 TestNG 和组测试。当我 运行 它时,输出与网站所说的相符。

好成绩:

Inside testPrintMessage()
.com
Inside testExitMessage()
www..com

===============================================
Suite1
Total tests run: 2, Failures: 1, Skips: 0
===============================================

接下来我 认为 我正在整理代码并修复错字,这给了我一个奇怪的结果。从 GroupTestExample.java,我将方法从 testingExitMessage 更改为 testExitMessage。我不知道 3 个字母如何改变测试顺序 运行.

错误结果 - 查看测试函数的顺序如何交换,这会影响失败次数

Inside testExitMessage()
www..com
Inside testPrintMessage()
www..com

===============================================
Suite1
Total tests run: 2, Failures: 2, Skips: 0
===============================================

谁能给我解释一下可能发生了什么,为什么更改方法名称会导致测试顺序发生变化?

MessageUtil.java

/*
* This class prints the given message on console.
*/
public class MessageUtil {
    private String message;

    // Constructor
    // @param message to be printed
    public MessageUtil(String message) {
        this.message = message;
    }

    // prints the message
    public String printMessage() {
        System.out.println(message);
    return message;
    }

    // add "tutorialspoint" to the message
    public String salutationMessage() {
        message = "tutorialspoint" + message;
    System.out.println(message);
    return message;
    }

    // add "www." to the message
    public String exitMessage() {
    message = "www." + message;
    System.out.println(message);
    return message;
    }
}

GroupTestExample.java

public class GroupTestExample {
    String message = ".com";
    MessageUtil messageUtil = new MessageUtil(message);

    @Test(groups = { "functest", "checkintest" })
    public void testPrintMessage() {
        System.out.println("Inside testPrintMessage()");
    message = ".com";
    Assert.assertEquals(message, messageUtil.printMessage());
    }

    @Test(groups = { "checkintest" })
    public void testSalutationMessage() {
    // Removed code since this method wasn't the problem method
    }

    @Test(groups = { "functest" })
    public void testingExitMessage() {
        System.out.println("Inside testExitMessage()");
        message = "www." + "tutorialspoint"+".com";
    Assert.assertEquals(message, messageUtil.exitMessage());
    }
}

testng.xml

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
<suite name="Suite1">
    <test name="test1">
        <groups>
        <run>
        <include name="functest" />
        </run>
    </groups>
    <classes>
        <class name="GroupTestExample" />
    </classes>
    </test>
</suite>

"Bad" GroupTestExample.java

    // same code as above except I changed this method from testingExitMessage to
    // testExitMessage b/c that's what the println msg shows and I thought I was 
    // fixing a typo.

    public void testExitMessage() {
        System.out.println("Inside testExitMessage()");
        message = "www." + "tutorialspoint"+".com";
    Assert.assertEquals(message, messageUtil.exitMessage());
    }

TestNG 运行 按照他们在 XML 文件中找到的顺序进行测试,在您的情况下,您没有在 XML 文件中指定方法并以无法预测的顺序测试 运行 (我相信这取决于编译器)。

您可以在测试中设置优先级。

例如。 @Test (priority=1)

然后,在您的 testNG.xml 文件中,您可以设置 preserve-order="true"