Bug 1411

Summary:	Complete Unit Test Subset for DRM/GBM JOGL(EGL) and NEWT
Product:	[JogAmp] Jogl	Reporter:	Sven Gothel <sgothel>
Component:	embedded	Assignee:	Sven Gothel <sgothel>
Status:	RESOLVED FIXED
Severity:	major	CC:	xerxes
Priority:	P4
Version:	2.4.0
Hardware:	All
OS:	linux
Type:	FEATURE	SCM Refs:	b992423477ea1a76fb28946e28959a3feea97680 61eb1825663701fd50023328f6f3e8e8b24272b9 c5fabde01babfdd07c72347ff17ac0705b8c6c5a 5e38dc8cb69d9bec7ee3dc2b98d79c4abcf5e5f0 548553e189f8f9fa60d6c59da6bf0a4bd1bf7505
Workaround:	---
Bug Depends on:	1156, 1416
Bug Blocks:

Description Sven Gothel 2019-12-06 04:37:59 CET

For the new feature DRM/GBM Bug 1156 we need to perform a subset of all unit tests.
Maximum subset would be w/o AWT and w/o SWT.

Comment 1 Sven Gothel 2019-12-06 20:07:54 CET

jogl b992423477ea1a76fb28946e28959a3feea97680

Unit Test Subset for DRM/GBM JOGL(EGL) and NEWT
First step disables all AWT and SWT unit tests.

For clarity, unit test scripts with right property setup are provided
to define the subset.

Comment 2 Sven Gothel 2019-12-09 07:16:07 CET

61eb1825663701fd50023328f6f3e8e8b24272b9
DRM/GBM JOGL: Specify 'junit.run.console' unit test target.

(WIP)

I still walk through the results ..
But it looks much better now.

Comment 3 Sven Gothel 2019-12-09 07:41:09 CET

c5fabde01babfdd07c72347ff17ac0705b8c6c5a
Fix 'junit.run.console' unit test target, use it in respective (renamed) scripts.
    
    Added junit.run.console target in build.xml
    
    build-test.xml
    - Moves all results.test artifact moving from current directory into test-zip-archive target,
      reducing duplication.
    
    - junit.run.console: Added proper dependencies etc
    
    Renamed scripts to match junit.run.console:
      junit-linux-x86_64-headless.sh -> junit-linux-x86_64-console.sh
      junit-linux-armv6hf-headless.sh -> junit-linux-armv6hf-console.sh

Comment 4 Sven Gothel 2019-12-09 08:07:09 CET

5e38dc8cb69d9bec7ee3dc2b98d79c4abcf5e5f0
Fix 'junit.run.console' - three times a charm?
    
    - Proper handling if junit is disabled
    - Use proper class pattern, java.dir.junit already contains base folder ;-)

Comment 5 Sven Gothel 2019-12-09 09:00:07 CET

548553e189f8f9fa60d6c59da6bf0a4bd1bf7505

Fix 'junit.run.console' - fourth times
    
    the property 'generic.junit.run.newt.headless.include.pattern'
    to run target 'generic.junit.run.newt.headless' multiple times for different unit tests
    must be unset within the caller space of ant.
    
    also fixed other occasions (never really worked on multiple calls).

Comment 6 Sven Gothel 2019-12-09 09:06:42 CET

bash scripts/junit-linux-x86_64-console.sh

....

Results of ../build-x86_64//test/results

number of junit classes
    116    1044   34730

number of passed junit classes - failures
    104     936   31157

number of passed junit classes - errors
     97     873   28767

number of failed junit classes - failures
     12     108    3573

number of failed junit classes - errors
     19     171    5963

failed junit classes - failures
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableDelegateOnOffscrnCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableGLWindowOnOffscrnCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestNEWTCloseX11DisplayBug565
com.jogamp.opengl.test.junit.jogl.acore.TestSharedContextVBOES2NEWT2
com.jogamp.opengl.test.junit.jogl.acore.TestSharedContextVBOES2NEWT3
com.jogamp.opengl.test.junit.newt.TestDisplayLifecycle01NEWT
com.jogamp.opengl.test.junit.newt.TestDisplayLifecycle02NEWT
com.jogamp.opengl.test.junit.newt.TestGLWindows00NEWT
com.jogamp.opengl.test.junit.newt.TestGLWindows01NEWT
com.jogamp.opengl.test.junit.newt.TestWindows01NEWT
com.jogamp.opengl.test.junit.newt.TestWindows02NEWT
com.jogamp.opengl.test.junit.newt.mm.TestScreenMode01dNEWT

failed junit classes - errors
com.jogamp.opengl.test.junit.graph.TestTextRendererNEWTBugXXXX
com.jogamp.opengl.test.junit.jogl.acore.TestBug669RecursiveGLContext02NEWT
com.jogamp.opengl.test.junit.jogl.acore.TestFBOOffThreadSharedContextMix2DemosES2NEWT
com.jogamp.opengl.test.junit.jogl.acore.TestFBOOnThreadSharedContext1DemoES2NEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableDelegateOnOffscrnCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableFactoryES2OffscrnCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableFactoryGLnBitmapCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLAutoDrawableGLWindowOnOffscrnCapsNEWT
com.jogamp.opengl.test.junit.jogl.acore.TestGLProfile02NEWTNoARBCtx
com.jogamp.opengl.test.junit.jogl.acore.TestGLProfile03NEWTOffscreen
com.jogamp.opengl.test.junit.jogl.acore.TestGLProfile04NEWTOffscreenNoARBCtx
com.jogamp.opengl.test.junit.jogl.acore.TestGPUMemSec01NEWT
com.jogamp.opengl.test.junit.jogl.acore.TestSharedContextVBOES2NEWT5
com.jogamp.opengl.test.junit.jogl.caps.TestBug605FlippedImageNEWT
com.jogamp.opengl.test.junit.jogl.caps.TestMultisampleES1NEWT
com.jogamp.opengl.test.junit.jogl.caps.TestMultisampleES2NEWT
com.jogamp.opengl.test.junit.jogl.tile.TestRandomTiledRendering2GL2NEWT
com.jogamp.opengl.test.junit.jogl.tile.TestTiledRendering1GL2NEWT
com.jogamp.opengl.test.junit.jogl.util.TestImmModeSinkES2NEWT

Comment 7 Sven Gothel 2019-12-24 17:00:15 CET

Unit test results are mainly passing.

We accept these for now, may want to revisit and cherry pick certain 'failures' for special QA acceptance.