Arquillian Blog

The Arquillian team is proud to announce the 0.0.10 release of the Smart Testing component!

Excluded categories specification

Smart Testing is now supporting the exclusion of test categories.

In this release we introduced the excludedCategories parameter for the categorized strategy.
When using this parameter, you specify the test categories you want to skip from execution,
as you would in the excludedGroups parameter of the maven-surefire-plugin.

The excludedCategories works well with both JUnit 4 and JUnit 5 categories system (e.g the @Category and @Tag annotations)

This release also removes the matchAll and reversed parameters from the categorized strategy, as the behaviour is replaced with the excludedCategories parameters.

What is Smart Testing?

Smart Testing is a tool that speeds up the test running phase by reordering test execution plan to increase a probability of fail-fast execution and thus give you faster feedback about your project’s health.

Release details

Component	Smart Testing
Version	0.0.10 view tag
Release date	2018-02-23
Released by	Matous Jobanek
Compiled against	Arquillian Spacelift – 1.0.2 ShrinkWrap Resolver – 3.1.3

Published artifacts org.arquillian.smart.testing

• org.arquillian.smart.testing » core jar javadoc pom
• org.arquillian.smart.testing » api jar javadoc pom
• org.arquillian.smart.testing » surefire-provider jar javadoc pom
• org.arquillian.smart.testing » junit-test-result-parser jar javadoc pom
• org.arquillian.smart.testing » strategy-affected jar javadoc pom
• org.arquillian.smart.testing » strategy-changed jar javadoc pom
• org.arquillian.smart.testing » strategy-failed jar javadoc pom
• org.arquillian.smart.testing » strategy-categorized jar javadoc pom
• org.arquillian.smart.testing » maven-lifecycle-extension jar javadoc pom
• org.arquillian.smart.testing » git-rules jar javadoc pom
• org.arquillian.smart.testing » smart-testing-test-bed jar javadoc pom
• org.arquillian.smart.testing » known-surefire-providers jar javadoc pom

Release notes and resolved issues 3

Component: Core

• #326 Release test jars

Other

• #323 Fix concurrency problems when running build in parallel

Component: Selection

• #310 Add support to exclude tests in Categorized strategy

Thanks to the following list of contributors: Matous Jobanek, Simon Priadka, Alex Soto

Since we wrote this post we didn't laze around. Check our latest announcement.

The Arquillian team is proud to announce the 0.0.9 release of the Smart Testing component!

What is Smart Testing?

Smart Testing is a tool that speeds up the test running phase by reordering test execution plan to increase a probability of fail-fast execution and thus give you faster feedback about your project’s health.

Release details

Component	Smart Testing
Version	0.0.9 view tag
Release date	2018-02-21
Released by	Alex Soto
Compiled against	Arquillian Spacelift – 1.0.2 ShrinkWrap Resolver – 3.1.2

Published artifacts org.arquillian.smart.testing

• org.arquillian.smart.testing » core jar javadoc pom
• org.arquillian.smart.testing » api jar javadoc pom
• org.arquillian.smart.testing » surefire-provider jar javadoc pom
• org.arquillian.smart.testing » junit-test-result-parser jar javadoc pom
• org.arquillian.smart.testing » strategy-affected jar javadoc pom
• org.arquillian.smart.testing » strategy-changed jar javadoc pom
• org.arquillian.smart.testing » strategy-failed jar javadoc pom
• org.arquillian.smart.testing » strategy-categorized jar javadoc pom
• org.arquillian.smart.testing » maven-lifecycle-extension jar javadoc pom
• org.arquillian.smart.testing » git-rules jar javadoc pom
• org.arquillian.smart.testing » smart-testing-test-bed jar javadoc pom
• org.arquillian.smart.testing » known-surefire-providers jar javadoc pom

Release notes and resolved issues 3

Component: Selection

• #320 In affected strategy classes as in annotation attribute is not resolved

Component: Core

• #318 Categorized strategy properties are not being recognized when using a configuration file

Component: Maven

• #316 Remove unnecessary runtime dependencies from mvn-extension

Thanks to the following list of contributors: Alex Soto, Matous Jobanek

Since we wrote this post we didn't laze around. Check our latest announcement.

The Arquillian team is proud to announce the 0.0.8 release of the Smart Testing component!

Test method selection

In all previous versions of the Smart Testing tool, by using the selecting mode, it was possible to select the whole test classes only.

In this release, we have introduced a possibility of selecting on the test method level. This new feature can be applied with two strategies: failed and categorized.
In case of the failed strategy – if you have a class with 10 test methods and only one of them fails, then in the next build Smart Testing selects and executes only the one test method that failed instead of running the whole test class. This should minimize the test suite execution and make the feedback loop much faster.
In case of the categorized strategy, it means that Smart Testing now resolves the annotations specified on the test methods and is able to select only test methods that belong to required categories.
By default, it is enabled for both strategies, but you can disable it either in the configuration file or using system properties -Dsmart.testing.failed.methods=false or -Dsmart.testing.categorized.methods=false respectively.

Test method selection can be used only with the selecting mode.

What’s next

In the next release, we are going to provide you a support for excluding categories in the categorized strategy. Stay tuned!

What is Smart Testing?

Smart Testing is a tool that speeds up the test running phase by reordering test execution plan to increase a probability of fail-fast execution and thus give you faster feedback about your project’s health.

Release details

Component	Smart Testing
Version	0.0.8 view tag
Release date	2018-02-13
Released by	Matous Jobanek
Compiled against	Arquillian Spacelift – 1.0.2 ShrinkWrap Resolver – 3.1.2

Published artifacts org.arquillian.smart.testing

• org.arquillian.smart.testing » core jar javadoc pom
• org.arquillian.smart.testing » api jar javadoc pom
• org.arquillian.smart.testing » surefire-provider jar javadoc pom
• org.arquillian.smart.testing » junit-test-result-parser jar javadoc pom
• org.arquillian.smart.testing » strategy-affected jar javadoc pom
• org.arquillian.smart.testing » strategy-changed jar javadoc pom
• org.arquillian.smart.testing » strategy-failed jar javadoc pom
• org.arquillian.smart.testing » strategy-categorized jar javadoc pom
• org.arquillian.smart.testing » maven-lifecycle-extension jar javadoc pom
• org.arquillian.smart.testing » git-rules jar javadoc pom
• org.arquillian.smart.testing » smart-testing-test-bed jar javadoc pom
• org.arquillian.smart.testing » known-surefire-providers jar javadoc pom

Release notes and resolved issues 7

Component: Core

• #314 Test method selection make sense only when selecting mode is used
• #299 Investigate the possibility of using the tool on test method level basis

Component: Selection

• #306 Failed - support execution of the specific test methods that failed
• #305 Support selection of test methods
• #304 Categorized - support categorization for test methods

Component: Test Bed

• #294 Change test-bed core to use latest Embedded Maven features
• #293 Occasional IllegalStateException when running test-bed functional tests

Thanks to the following list of contributors: Matous Jobanek, Dipak Pawar

Since we wrote this post we didn't laze around. Check our latest announcement.

The Arquillian team is proud to announce the 0.0.7 release of the Smart Testing component!

Highlights of this release

In this release we ship more support to JUnit 5. Concretely we have added support for @org.junit.jupiter.api.Tag and @org.junit.jupiter.api.Tags annotations.

JUnit 5 tag support

In this realease we have added support for @org.junit.jupiter.api.Tag and @org.junit.jupiter.api.Tags annotations in categorized strategy.
Tags is the way to categorize tests in JUnit 5 and a categorized test looks like:

@Tag("first")
@Tag("second")
public class FirstAndSecondTaggedClass {
}

Then you need to configure the strategy by setting categories property with tag value.

What’s next

We continue improving the tool so watch out for more!

What is Smart Testing?

Smart Testing is a tool that speeds up the test running phase by reordering test execution plan to increase a probability of fail-fast execution and thus give you faster feedback about your project’s health.

Release details

Component	Smart Testing
Version	0.0.7 view tag
Release date	2018-01-17
Released by	Matous Jobanek
Compiled against	Arquillian Spacelift – 1.0.2 ShrinkWrap Resolver – 3.0.1

Published artifacts org.arquillian.smart.testing

• org.arquillian.smart.testing » core jar javadoc pom
• org.arquillian.smart.testing » api jar javadoc pom
• org.arquillian.smart.testing » surefire-provider jar javadoc pom
• org.arquillian.smart.testing » junit-test-result-parser jar javadoc pom
• org.arquillian.smart.testing » strategy-affected jar javadoc pom
• org.arquillian.smart.testing » strategy-changed jar javadoc pom
• org.arquillian.smart.testing » strategy-failed jar javadoc pom
• org.arquillian.smart.testing » strategy-categorized jar javadoc pom
• org.arquillian.smart.testing » maven-lifecycle-extension jar javadoc pom
• org.arquillian.smart.testing » git-rules jar javadoc pom
• org.arquillian.smart.testing » smart-testing-test-bed jar javadoc pom
• org.arquillian.smart.testing » known-surefire-providers jar javadoc pom

Release notes and resolved issues 5

Component: Selection

• #301 Support @Tag annotation from JUnit5 in category strategy

Component: Test Bed

• #290 Cleanup the tests and create custom assertions across the whole project

Component: Maven

• #285 Add missing test scope to all test dependencies

Component: Core

• #284 Refactor both ConfigurationTest and ConfigurationUsingPropertyTest classes
• #267 Remove ConfigurationLoader.load() method

Thanks to the following list of contributors: Dipak Pawar, Alex Soto, Matous Jobanek, Hemani, Bartosz Majsak

Since we wrote this post we didn't laze around. Check our latest announcement.

The Arquillian team is proud to announce the 0.0.6 release of the Smart Testing component!

What is Smart Testing?

Smart Testing is a tool that speeds up the test running phase by reordering test execution plan to increase a probability of fail-fast execution and thus give you faster feedback about your project’s health.

Release details

Component	Smart Testing
Version	0.0.6 view tag
Release date	2017-12-14
Released by	Bartosz Majsak
Compiled against	Arquillian Spacelift – 1.0.2 ShrinkWrap Resolver – 3.0.1

Published artifacts org.arquillian.smart.testing

• org.arquillian.smart.testing » core jar javadoc pom
• org.arquillian.smart.testing » api jar javadoc pom
• org.arquillian.smart.testing » surefire-provider jar javadoc pom
• org.arquillian.smart.testing » junit-test-result-parser jar javadoc pom
• org.arquillian.smart.testing » strategy-affected jar javadoc pom
• org.arquillian.smart.testing » strategy-changed jar javadoc pom
• org.arquillian.smart.testing » strategy-failed jar javadoc pom
• org.arquillian.smart.testing » strategy-categorized jar javadoc pom
• org.arquillian.smart.testing » maven-lifecycle-extension jar javadoc pom
• org.arquillian.smart.testing » git-rules jar javadoc pom
• org.arquillian.smart.testing » smart-testing-test-bed jar javadoc pom
• org.arquillian.smart.testing » known-surefire-providers jar javadoc pom

Release notes and resolved issues 7

Component: Core

• #287 Provide set of tests-to-run to TestExecutionPlanner implementations
• #114 Introduce per-module configuration file

Priority: High

• #283 Categorized strategy

Component: Maven

• #279 Be as less intrusive as possible with the dependencies
• #278 When some surefire provider is specified, then the logic should be delegated to this provider
• #277 Dependency conflict when same library with different version is in pom already

Component: Selection

• #263 Add @Resource-like annotation in affected tests.

Thanks to the following list of contributors: Bartosz Majsak, Matous Jobanek, Dipak Pawar, Alex Soto