RestComm/jdiameter

How to run the testsuite

Opened this issue · 6 comments

nikoskoutr commented

Hello, I am trying to run the testsuite but i get some errors. I am running it with mvn install and i am getting:

Results :

Failed tests: 
  AccSessionFTFlowTest.setUp:128 Setup failed: null
  AccSessionFTFlowTest.setUp:128 Setup failed: null
  CCASessionBasicFlowTest.testBasicFlow:157 java.lang.NullPointerException
  CCASessionFTFlowTest.testBasicFlow:189 java.lang.NullPointerException
  CxDxSessionBasicFlowMARTest.testMultimediaAuth:145 null
  CxDxSessionBasicFlowPPRTest.testRegistrationTermination:144 java.lang.NullPointerException
  CxDxSessionBasicFlowRTRTest.testRegistrationTermination:144 java.lang.NullPointerException
  CxDxSessionBasicFlowSARTest.testServerAssignment:144 java.lang.NullPointerException
  CxDxSessionBasicFlowUARTest.testUserAuthorization:144 java.lang.NullPointerException
  GxSessionBasicFlowTest.testBasicFlow:162 java.lang.NullPointerException
  GxSessionFTFlowTest.testBasicFlow:192 java.lang.NullPointerException
  RoSessionBasicFlowTest.testBasicFlow:156 java.lang.NullPointerException
  RoSessionFTFlowTest.testBasicFlow:185 java.lang.NullPointerException
  S13SessionBasicFlowTest.testMEIdentityCheck:142 java.lang.Exception: Did not receive ECR or answer already sent. Request: null
  ShSessionBasicFlowPNRTest.testPushNotification:144 java.lang.NullPointerException
  ShSessionBasicFlowPURTest.testProfileUpdate:144 java.lang.NullPointerException
  ShSessionBasicFlowUDRTest.testUserData:144 java.lang.NullPointerException
  SLgSessionImmediateDeferredFlowTest.testSLgImmediateAndDeferredBasicFlow:152 java.lang.Exception: Did not receive PLR or answer already sent. Request: null
  SLgSessionImmediateDeferredFlowTest.testSLgImmediateAndDeferredBasicFlow:152 java.lang.NullPointerException
Tests in error: 
  StackConnectMultiSCTPTest.testConnectUndefined:57->StackConnectMultiBaseTest.testConnectUndefined:107 » Internal
  ShSessionBasicFlowSNRTest.setUp:77 » IllegalDiameterState
  ShSessionBasicFlowTest.setUp:77 » IllegalDiameterState

Tests run: 151, Failures: 19, Errors: 3, Skipped: 0

My maven version is:

Apache Maven 3.5.0
Maven home: /usr/share/maven
Java version: 9.0.4, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-9-oracle
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.13.0-38-generic", arch: "amd64", family: "unix"

Am i doing something wrong?
Thank you in advance,
Nick

nikoskoutr commented

I would like to add that the number of failures and errors change on each run of the testsuite.

gsaslis commented

thanks for raising this @nikoskoutr !

@ammendonca any tips?

nikoskoutr commented

Are there any guidelines for running the testsuite?
What is the recommended java version / environment (what linux etc) / dependencies for running jdiameter ?
Maybe i am missing something.
Thank you for the response.

ammendonca commented

Hi @nikoskoutr,

I'm not sure what are the exact failures, I don't observe such failures often.

Some tests use different loopback addresses such as 127.0.0.2, please make sure those are available. Also, proper OS support for running SCTP tests is required, please make sure it's available too.

If the problem persists, please attach some logs to better understand the problems.

nikoskoutr commented

Hello @ammendonca ,
I have tested that 127.0.0.2 is open and i have installed the SCTP protol in my ubuntu machine with the command: sudo apt-get install libsctp-dev lksctp-tools. I am still getting errors though, i uploaded the logs to my drive since they are quite big and pastebin has a size limit. There are two versions of the file one with terminal colrs and one without, depending on where you want to inspect them.
Without Terminal Colors
With Terminal Colors
The machine i am using is:

Linux link 4.15.0-20-generic #21-Ubuntu x86_64 GNU/Linux

java version "1.8.0_171"
Java(TM) SE Runtime Environment (build 1.8.0_171-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.171-b11, mixed mode)

Apache Maven 3.5.2
Maven home: /usr/share/maven
Java version: 1.8.0_171, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-oracle/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.15.0-20-generic", arch: "amd64", family: "unix"

Thank you for your time,
Nick

nikoskoutr commented

For completion, I have also run the testsuite on multiple machines and linux distributions, with the same errors as results.