Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Next challenges

Recent achievements

  • Global
  • Personal

Recognition

  • Give kudos
  • Received
  • Given

Leaderboard

  • Global

Trophy case

Kudos (beta program)

Kudos logo

You've been invited into the Kudos (beta program) private group. Chat with others in the program, or give feedback to Atlassian.

View group

It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage

Help needed with test optimization in clover-ant-3.1.0

Hi,

I can't seem to get test optimization to work with ant. In particular, I would like to run only the tests that are impacted by a change. Am I missing something?

I am using ant 1.8.2 with an eval license for the "Clover Ant - 3.1.0" product.

Using the build_optimized.xml file in the tutorial, I tried the following from a clean install:

$ ant with.clover clean test.run clover.snapshot -f build_optimized.xml

I had expected that 0 tests should run if I now do another run with no changes, but actually all (2) tests run:

$ ant with.clover clean test.run -f build_optimized.xml
Buildfile: C:\tools\clover-ant-3.1.0\tutorial\build_optimized.xml
[clover-env] Loading clover.xml: jar:file:/C:/tools/clover-ant-3.1.0/lib/clover.jar!/clover.xml

with.clover:
[clover-setup] Clover Version 3.1.0, built on May 31 2011 (build-821)
[clover-setup] Loaded from: C:\tools\clover-ant-3.1.0\lib\clover.jar
[clover-setup] Clover: Evaluation License registered to Mentor Graphics.
[clover-setup] You have 28 day(s) before your license expires.
[clover-setup] Clover is enabled with initstring 'C:\tools\clover-ant-3.1.0\tutorial\.clover\clover3_1_0.db'

clean:
[delete] Deleting directory C:\tools\clover-ant-3.1.0\tutorial\build

code.compile:
[mkdir] Created dir: C:\tools\clover-ant-3.1.0\tutorial\build\app
[javac] C:\tools\clover-ant-3.1.0\tutorial\build_optimized.xml:38: warning: 'includeantruntime' was not set, defaulting to build.sysclas
spath=last; set to false for repeatable builds
[javac] Compiling 3 source files to C:\tools\clover-ant-3.1.0\tutorial\build\app
[clover] Clover Version 3.1.0, built on May 31 2011 (build-821)
[clover] Loaded from: C:\tools\clover-ant-3.1.0\lib\clover.jar
[clover] Clover: Evaluation License registered to Mentor Graphics.
[clover] You have 28 day(s) before your license expires.
[clover] Updating existing database at 'C:\tools\clover-ant-3.1.0\tutorial\.clover\clover3_1_0.db'.
[clover] Processing files at 1.4 source level.
[clover] Clover all over. Instrumented 3 files (1 package).
[clover] Elapsed time = 0.141 secs. (21.277 files/sec, 2,028.369 srclines/sec)

test.compile:
[mkdir] Created dir: C:\tools\clover-ant-3.1.0\tutorial\build\test
[javac] C:\tools\clover-ant-3.1.0\tutorial\build_optimized.xml:46: warning: 'includeantruntime' was not set, defaulting to build.sysclas
spath=last; set to false for repeatable builds
[javac] Compiling 2 source files to C:\tools\clover-ant-3.1.0\tutorial\build\test
[clover] Clover Version 3.1.0, built on May 31 2011 (build-821)
[clover] Loaded from: C:\tools\clover-ant-3.1.0\lib\clover.jar
[clover] Clover: Evaluation License registered to Mentor Graphics.
[clover] You have 28 day(s) before your license expires.
[clover] Updating existing database at 'C:\tools\clover-ant-3.1.0\tutorial\.clover\clover3_1_0.db'.
[clover] Processing files at 1.4 source level.
[clover] Clover all over. Instrumented 2 files (1 package).
[clover] 23 test methods detected.
[clover] Elapsed time = 0.047 secs. (42.553 files/sec, 4,106.383 srclines/sec)

test.run:
[mkdir] Created dir: C:\tools\clover-ant-3.1.0\tutorial\build\testresult
[junit] Clover was unable to save any time on this optimized test run.
[junit] Clover included 2 test classes in this run (total # test classes : 2)
[junit] Running com.cenqua.samples.money.MoneyBagTest
[junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 0.281 sec
[junit] Running com.cenqua.samples.money.MoneyTest
[junit] Tests taking too long? Try Clover's test optimization.
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.151 sec

BUILD SUCCESSFUL
Total time: 10 seconds

1 answer

0 votes

Using the build_optimized.xml file in the tutorial, I tried the following from a clean install:

ant with.clover clean test.run clover.snapshot -f build_optimized.xml

I had expected that 0 tests should run if I now do another run with no changes, but actually all (2) tests run.

I assume that you did another run using exactly the same command. This didn't work, because you have called 'ant clean', which has removed all compiled classes. As a consequence, Clover instrumented all files again, thus Clover "saw" all these files as modified. As a result, Clover chose all tests for execution.

In order to use test optimization you have to perform an incremental compilation, i.e.:

ant with.clover test.run clover.snapshot -f build_optimized.xml


Suggest an answer

Log in or Sign up to answer
TAGS
Community showcase
Published in Opsgenie

Investigate deployment-related incidents with Bamboo and Opsgenie together

Back in April of last year one of the major product announcements from Opsgenie was the launch of the Incident investigation view which created a deep connection between Bitbucket and Opsgenie, empow...

150 views 1 4
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you