STAMP-project/pitmp-maven-plugin

Add JUnit tests

Cael35 opened this issue · 7 comments

Cael35 commented

There is automated tests but not with JUnit.
The idea is to make JUnit tests that run PitMP on dhell and dnoo, using the plugin maven-plugin-testing-harness.
Then we can have a meaningfull "coverage". :-)

Cael35 commented

All automated tests files are located in the directory test_dir.
First, reproduce the same test suite using JUnit.
PIT uses maven-plugin-testing-harness, so have a look at it and maybe we could even use some classes.

pedrorijo91 commented

I may be interested in helping on this issue :)

nicolabertazzo commented

Hi @pedrorijo91,

your help is greatly appreciated.
I'll start working on the conversion of the tests to JUnit in the next week and I'll asign to you some tasks about this activity.

Do you agree?

  • 👍2
pedrorijo91 commented

cool! :)

Cael35 commented

Thanks for your help guys !
It would be great to first reproduce the tests executed by verify_pitmp.sh. It runs PitMP on several projects with 2 different configurations. All files can be found in the directory test_dir. Let me know if you have any questions.

  • 👍1
pedrorijo91 commented

hey @nicolabertazzo,

do we already have a plan to tackle this?

Cael35 commented

Once #34 will be merged, we can enhance the test suite.
Here are some ideas for the test cases :-)

  • Make at least one test for each property defined in the mojos ('run' for PitMP with Gregor and 'descartes' for PitMP with Descartes)
  • Verify all tests on projects dhell and dnoo
  • Automatically check the result of execution using XML result files (keep reference files validated by hand, and compare the execution file and the reference file)