Skip to main content

TCK prerequisites

6 replies [Last post]
mlaporta
Offline
Joined: 2007-04-02

I try to run the testsuite for TCK.

D:\workspace.jslee3\mobicents>ant tests-slee-tck

every time I have different number of failed result.Never got a "No tests fails".Is there any particular environment I should use to run TCK
My actual configuration is:
Hardware
Pentium(R) 4 CPU 1.80GHz
512 MB of RAM

Software
Windows Xp PRO SP2
JDK-1.5.0_10-b3
mobicents-HEAD
jboss-3.2.8.SP1

Michele

Reply viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
eduardomartins
Offline
Joined: 2005-10-10

CreateActivityWhileStoppingTest needs a patch to succeed, it should fail always but passes sometimes because of timing issues. The patch will be provided soon along with other small fixes.

baranowb
Offline
Joined: 2006-01-09

Two tests will fail - due to:
- implementation change in methods - finger print for this is sttored somehwere in tck and it is outdated - jain should provide new tcks after releasing new implementation of API
- different JVM - it has different libraries, new methods in classes- again as above. :)

ivelin
Offline
Joined: 2003-07-13

the machine config looks ok. what results are you getting between runs and specifically which tests tend to alternate between fail and pass?

mlaporta
Offline
Joined: 2007-04-02

> the machine config looks ok. what results are you
> getting between runs and specifically which tests
> tend to alternate between fail and pass?

First time I run testsuite against cvs HEAD without any modification

Test results: passed: 452; failed: 5; error: 2

on reports/failed.html

JavaTest : Tests that failed
Tests are grouped by their final status message.
58 errors
tests/api/signaturetest/SleeSignatureTest.xml : SleeSignatureTest
tests/runtime/security/SecurityPermissionsTest.xml : SecurityPermissionsTest
tests/management/sleestate/CreateActivityWhileStoppingTest.xml : CreateActivityWhileStoppingTest
tests/javax/slee/usage/UsageNotification/Test4203Test.xml : Test4203Test
tests/profiles/events/ProfileEventsTest.xml : ProfileEventsTest

Second time I run testsuite against cvs HEAD without any modification

Test results: passed: 447; failed: 4; error: 8

on reports/failed.html

JavaTest : Tests that failed
Tests are grouped by their final status message.
58 errors
tests/api/signaturetest/SleeSignatureTest.xml : SleeSignatureTest
tests/runtime/security/SecurityPermissionsTest.xml : SecurityPermissionsTest
tests/management/sleestate/CreateActivityWhileStoppingTest.xml : CreateActivityWhileStoppingTest
tests/javax/slee/usage/UsageNotification/Test4203Test.xml : Test4203Test

Third time I run testsuite against cvs HEAD with ISSUE_173_patch.txt
Test results: passed: 452; failed: 4; error: 3
JavaTest : Tests that failed
Tests are grouped by their final status message.
58 errors

tests/api/signaturetest/SleeSignatureTest.xml : SleeSignatureTest
tests/runtime/security/SecurityPermissionsTest.xml : SecurityPermissionsTest
tests/management/sleestate/CreateActivityWhileStoppingTest.xml : CreateActivityWhileStoppingTest
tests/javax/slee/usage/UsageNotification/Test4203Test.xml : Test4203Test

ivelin
Offline
Joined: 2003-07-13

the picture looks familiar. We need to work on fixing the tests that fail due to timing issues. test4203test should not fail and neither should CreateActivityWhileStoppingTest.

It seems though that patch 173 does not have negative impact on the testsuite, so please go ahead and commit.

Thanks,

Ivelin

alexandrem
Offline
Joined: 2005-10-19

The Test4203 (UsageNotification) fails if you are using the slee.jar from SLEE 1.1 since the hashCode method used to pass the test has been changed:

[b]JAINSLEE 1.0 [14.10.5 - UsageNotification class]:[/b]
[i]The hashCode method.[/i]
This method returns the exclusive or’ed hash codes of the service, sbb, usageParameter-SetName, and usageParameterName attributes.

[b]JAINSLEE 1.1 [14.9.10 - UsageNotification class]:[/b]
[i]The hashCode method.[/i]
This method returns the exclusive or’ed hash codes of the usageParameterSetName (if non null) and usageParameterName attributes.

Alexandre Mendonça