GoalDiscussions
Accordig to discussions Test failures and MakeTeamcityGreenAgainGoal
To and MakeTeamcityGreenAgain To allow community to grow more quickly and from the CI perspective, failing tests should be the main concern
...
- Test suite timeout - it hides real test failures from us and wastes agent time
- Stable failing test - 50-100% of failures - issue is to be created as blocker to the next release, test may be muted after research.
- Flaky tests 1%-50% of failures, which are considered by teamcity as flaky may be not muted for now because TC interface helps us to identify these tests.
Scope
Unassigned issues
Jira |
---|
server | ASF JIRA |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
maximumIssues | 20 |
---|
jqlQuery | project = IGNITE AND labels = MakeTeamcityGreenAgain and labels != Muted_Test AND assignee is EMPTY AND resolution is EMPTY |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
|
Currently failing tests
Jira |
---|
server | ASF JIRA |
---|
jqlQuery | project = IGNITE and labels = MakeTeamcityGreenAgain and labels != Muted_test and resolution is EMPTY |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
|
Muted failures
Jira |
---|
server | ASF JIRA |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
maximumIssues | 20 |
---|
jqlQuery | project = IGNITE and labels = MakeTeamcityGreenAgain and labels = Muted_test and resolution is EMPTY |
---|
serverId | 5aa69414-a9e9-3523-82ec-879b028fb15b |
---|
|