Difference between revisions of "Regression testing"

From KlayGE
Jump to: navigation, search
Line 384: Line 384:
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
−
! Sample !! NV Geforce GTX960 || AMD FirePro V3900 || Intel HD3000 || NV Geforce 650M OSX
+
! Sample !! NV Geforce GTX960 || AMD FirePro V3900 || Intel HD3000
 
|-
 
|-
−
! Last test !! 2015/5/28 !! 2014/12/17 !! 2014/12/14 !! 2015/1/9
+
! Last test !! 2015/5/28 !! 2014/12/17 !! 2014/12/14
 
|-
 
|-
−
| AreaLighting || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| AreaLighting || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| AtmosphericScattering || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| AtmosphericScattering || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| CascadedShadowMap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| CascadedShadowMap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| CausticsMap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{No}}Wrong results
+
| CausticsMap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| DeferredRendering || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| DeferredRendering || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| DetailedSurface || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| DetailedSurface || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| EnvLighting || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| EnvLighting || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| GlobalIllumination || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| GlobalIllumination || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| GPUParticleSystem || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| GPUParticleSystem || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| JudaTexViewer || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| JudaTexViewer || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| MotionBlurDoF || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| MotionBlurDoF || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| Ocean || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| Ocean || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| OrderIndependentTransparency || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| OrderIndependentTransparency || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| ParticleEditor || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| ParticleEditor || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| PostProcessing || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| PostProcessing || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| ProceduralTex || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| ProceduralTex || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| Reflection || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| Reflection || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| ScenePlayer || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| ScenePlayer || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| ShadowCubemap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| ShadowCubemap || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| SSSSS || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| SSSSS || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| SubSurface || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| SubSurface || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| Text || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
+
| Text || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|-
 
|-
−
| VideoTexture || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes (No DShow)
+
| VideoTexture || {{Yes}}Yes || {{Yes}}Yes || {{Yes}}Yes
 
|}
 
|}
  
Line 541: Line 541:
 
|-
 
|-
 
| VideoTexture || {{Yes}}Yes (No Dshow) || {{Yes}}Yes (No Dshow)
 
| VideoTexture || {{Yes}}Yes (No Dshow) || {{Yes}}Yes (No Dshow)
 +
|}
 +
 +
== Mac OSX ==
 +
 +
{| class="wikitable"
 +
|-
 +
! Sample !! NV Geforce 650M
 +
|-
 +
! Last test !! 2015/1/9
 +
|-
 +
| AreaLighting || {{Yes}}Yes
 +
|-
 +
| AtmosphericScattering || {{Yes}}Yes
 +
|-
 +
| CascadedShadowMap || {{Yes}}Yes
 +
|-
 +
| CausticsMap || {{No}}Wrong results
 +
|-
 +
| DeferredRendering || {{Yes}}Yes
 +
|-
 +
| DetailedSurface || {{Yes}}Yes
 +
|-
 +
| EnvLighting || {{Yes}}Yes
 +
|-
 +
| GlobalIllumination || {{Yes}}Yes
 +
|-
 +
| GPUParticleSystem || {{Yes}}Yes
 +
|-
 +
| JudaTexViewer || {{Yes}}Yes
 +
|-
 +
| MotionBlurDoF || {{Yes}}Yes
 +
|-
 +
| Ocean || {{Yes}}Yes
 +
|-
 +
| OrderIndependentTransparency || {{Yes}}Yes
 +
|-
 +
| ParticleEditor || {{Yes}}Yes
 +
|-
 +
| PostProcessing || {{Yes}}Yes
 +
|-
 +
| ProceduralTex || {{Yes}}Yes
 +
|-
 +
| Reflection || {{Yes}}Yes
 +
|-
 +
| ScenePlayer || {{Yes}}Yes
 +
|-
 +
| ShadowCubemap || {{Yes}}Yes
 +
|-
 +
| SSSSS || {{Yes}}Yes
 +
|-
 +
| SubSurface || {{Yes}}Yes
 +
|-
 +
| Text || {{Yes}}Yes
 +
|-
 +
| VideoTexture || {{Yes}}Yes (No DShow)
 
|}
 
|}
  

Revision as of 07:49, 11 June 2015

This is the regression testing results on KlayGE's development version.

Windows

D3D11 level 11.1

Sample NV Geforce GTX960
Last test 2015/5/28
AreaLighting Yes
AtmosphericScattering Yes
CascadedShadowMap Yes
CausticsMap Yes
DeferredRendering Yes
DetailedSurface Yes
EnvLighting Yes
GlobalIllumination Yes
GPUParticleSystem Yes
JudaTexViewer Yes
MotionBlurDoF Yes
Ocean Yes
OrderIndependentTransparency Yes
ParticleEditor Yes
PostProcessing Yes
ProceduralTex Yes
Reflection Yes
ScenePlayer Yes
ShadowCubemap Yes
SSSSS Yes
SubSurface Yes
Text Yes
VideoTexture Yes

D3D11 level 11.0

Sample NV Geforce GTX960 AMD FirePro V3900 NVS 4200M WinStore WP8.1 Emulator
Last test 2015/5/28 2014/12/17 2014/11/4 2014/11/4
AreaLighting Yes Yes Yes Yes (only on >=2G)
AtmosphericScattering Yes Yes Yes Yes
CascadedShadowMap Yes Yes Yes Yes
CausticsMap Yes Yes Yes Yes
DeferredRendering Yes Yes Yes Yes (only on >=2G)
DetailedSurface Yes Yes Yes Yes
EnvLighting Yes Yes Yes Yes
GlobalIllumination Yes Yes Yes Yes (only on >=2G)
GPUParticleSystem Yes Yes Yes Yes
JudaTexViewer Yes Yes Yes Yes
MotionBlurDoF Yes Yes Yes Yes with precision issue
Ocean Yes Yes Yes Yes (only on >=1G)
OrderIndependentTransparency Yes Yes Yes Yes
ParticleEditor Yes Yes Yes Yes
PostProcessing Yes Yes Yes Yes
ProceduralTex Yes Yes Yes Yes
Reflection Yes Yes Yes Yes
ScenePlayer Yes Yes Yes Yes (only on >=2G)
ShadowCubemap Yes Yes Yes Yes
SSSSS Yes Yes Yes Yes
SubSurface Yes Yes Yes Yes
Text Yes Yes Yes Yes
VideoTexture Yes Yes Yes (No Dshow) Yes (No Dshow)

D3D11 level 10.1

Sample NV Geforce GTX960 Intel HD3000
Last test 2015/5/28 2015/6/5
AreaLighting Yes Yes
AtmosphericScattering Yes Yes
CascadedShadowMap Yes Yes
CausticsMap Yes Yes
DeferredRendering Yes Yes
DetailedSurface Yes Yes
EnvLighting Yes Yes
GlobalIllumination Yes Yes
GPUParticleSystem Yes Yes
JudaTexViewer Yes Yes
MotionBlurDoF Yes Yes
Ocean Yes Yes
OrderIndependentTransparency Yes Yes
ParticleEditor Yes Yes
PostProcessing Yes Yes
ProceduralTex Yes Yes
Reflection Yes Yes
ScenePlayer Yes Yes
ShadowCubemap Yes Yes
SSSSS Yes Yes
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

D3D11 level 10.0

Sample NV Geforce GTX960 Intel HD3000
Last test 2015/5/28 2015/6/5
AreaLighting Yes Yes
AtmosphericScattering Yes Yes
CascadedShadowMap Yes Yes
CausticsMap Yes Yes
DeferredRendering Yes Yes
DetailedSurface Yes Yes
EnvLighting Yes Yes
GlobalIllumination Yes Yes
GPUParticleSystem Yes Yes
JudaTexViewer Yes Yes
MotionBlurDoF Yes Yes
Ocean Yes Yes
OrderIndependentTransparency Yes Yes
ParticleEditor Yes Yes
PostProcessing Yes Yes
ProceduralTex Yes Yes
Reflection Yes Yes
ScenePlayer Yes Yes
ShadowCubemap Yes Yes
SSSSS Yes Yes
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

D3D11 level 9.3

Sample NV Geforce GTX960 Intel HD3000
Last test 2015/5/28 2015/6/9
AreaLighting Yes Yes
AtmosphericScattering Yes Yes
CascadedShadowMap Yes Yes
CausticsMap No SM3 No SM3
DeferredRendering Yes Yes
DetailedSurface Yes Yes
EnvLighting Yes Yes
GlobalIllumination Yes Yes
GPUParticleSystem No SM3 No SM3
JudaTexViewer Yes Yes
MotionBlurDoF Yes Yes
Ocean No SM3 No SM3
OrderIndependentTransparency Yes Yes
ParticleEditor Yes Yes
PostProcessing Yes Yes
ProceduralTex Yes Yes
Reflection Yes Yes
ScenePlayer Yes Yes
ShadowCubemap Yes Yes
SSSSS Yes Yes
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

D3D11 level 9.2

Sample NV Geforce GTX960 Intel HD3000
Last test 2015/5/28 2015/6/6
AreaLighting Too many dependent texture look up Too many dependent texture look up
AtmosphericScattering Too many arithmetic instruction (510/64) Too many arithmetic instruction (510/64)
CascadedShadowMap Too many dependent texture look up Too many dependent texture look up
CausticsMap No SM3 No SM3
DeferredRendering Too many dependent texture look up Too many dependent texture look up
DetailedSurface Can't unroll shader Can't unroll shader
EnvLighting Yes Yes
GlobalIllumination Too many dependent texture look up Too many dependent texture look up
GPUParticleSystem No SM3 No SM3
JudaTexViewer Yes Yes
MotionBlurDoF Can't unroll shader Can't unroll shader
Ocean No SM3 No SM3
OrderIndependentTransparency No depth texture No depth texture
ParticleEditor Yes Yes
PostProcessing Too many dependent texture look up Too many dependent texture look up
ProceduralTex Too many dependent texture look up Too many dependent texture look up
Reflection Can't unroll shader Can't unroll shader
ScenePlayer Too many dependent texture look up Too many dependent texture look up
ShadowCubemap Yes Yes
SSSSS Too many dependent texture look up Too many dependent texture look up
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

D3D11 level 9.1

Sample NV Geforce GTX960 Intel HD3000
Last test 2015/5/28 2015/6/6
AreaLighting Too many dependent texture look up Too many dependent texture look up
AtmosphericScattering Too many arithmetic instruction (510/64) Too many arithmetic instruction (510/64)
CascadedShadowMap Too many dependent texture look up Too many dependent texture look up
CausticsMap No SM3 No SM3
DeferredRendering Too many dependent texture look up Too many dependent texture look up
DetailedSurface Can't unroll shader Can't unroll shader
EnvLighting Yes Yes
GlobalIllumination Too many dependent texture look up Too many dependent texture look up
GPUParticleSystem No SM3 No SM3
JudaTexViewer Yes Yes
MotionBlurDoF Can't unroll shader Can't unroll shader
Ocean No SM3 No SM3
OrderIndependentTransparency No depth texture No depth texture
ParticleEditor Yes Yes
PostProcessing Too many dependent texture look up Too many dependent texture look up
ProceduralTex Too many dependent texture look up Too many dependent texture look up
Reflection Can't unroll shader Can't unroll shader
ScenePlayer Too many dependent texture look up Too many dependent texture look up
ShadowCubemap Yes Yes
SSSSS Too many dependent texture look up Too many dependent texture look up
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

OpenGL

Sample NV Geforce GTX960 AMD FirePro V3900 Intel HD3000
Last test 2015/5/28 2014/12/17 2014/12/14
AreaLighting Yes Yes Yes
AtmosphericScattering Yes Yes Yes
CascadedShadowMap Yes Yes Yes
CausticsMap Yes Yes Yes
DeferredRendering Yes Yes Yes
DetailedSurface Yes Yes Yes
EnvLighting Yes Yes Yes
GlobalIllumination Yes Yes Yes
GPUParticleSystem Yes Yes Yes
JudaTexViewer Yes Yes Yes
MotionBlurDoF Yes Yes Yes
Ocean Yes Yes Yes
OrderIndependentTransparency Yes Yes Yes
ParticleEditor Yes Yes Yes
PostProcessing Yes Yes Yes
ProceduralTex Yes Yes Yes
Reflection Yes Yes Yes
ScenePlayer Yes Yes Yes
ShadowCubemap Yes Yes Yes
SSSSS Yes Yes Yes
SubSurface Yes Yes Yes
Text Yes Yes Yes
VideoTexture Yes Yes Yes

OpenGL ES

Sample ANGLE D3D9 on Intel HD 3000 ANGLE D3D11 on Intel HD 3000
Last test 2015/6/6 2015/6/6
AreaLighting Yes Yes
AtmosphericScattering Yes Yes
CascadedShadowMap Yes Yes
CausticsMap Yes Yes
DeferredRendering Yes Yes
DetailedSurface Yes Yes
EnvLighting Yes Yes
GlobalIllumination Yes Yes
GPUParticleSystem Yes Yes
JudaTexViewer Yes Yes
MotionBlurDoF Yes Yes
Ocean Yes Yes
OrderIndependentTransparency Yes Yes
ParticleEditor Yes Yes
PostProcessing Yes Yes
ProceduralTex Yes Yes
Reflection Yes Yes
ScenePlayer Yes Yes
ShadowCubemap Yes Yes
SSSSS Yes Yes
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes Yes

Android

Sample Google SDK emulator Asua TF700T
Last test 2014/12/11 2014/7/2
AreaLighting Yes N/A
AtmosphericScattering Yes Can't have "while" in shader
CascadedShadowMap Yes Wrong result
CausticsMap No SM3 Wrong skybox
DeferredRendering Yes Wrong result
DetailedSurface Too slow Too slow
EnvLighting Yes N/A
GlobalIllumination Yes Wrong result
GPUParticleSystem No SM3 Can't have "while" in shader
JudaTexViewer Too slow Too slow
MotionBlurDoF No python No python
Ocean No SM3 Time out
OrderIndependentTransparency Yes Time out
ParticleEditor Yes No particle
PostProcessing Yes No object
ProceduralTex Yes Yes
Reflection Yes Wrong result
ScenePlayer No python No python
ShadowCubemap Yes Crash
SSSSS No MRT Can't unroll shader
SubSurface Yes Yes
Text Yes Yes
VideoTexture Yes (No Dshow) Yes (No Dshow)

Mac OSX

Sample NV Geforce 650M
Last test 2015/1/9
AreaLighting Yes
AtmosphericScattering Yes
CascadedShadowMap Yes
CausticsMap Wrong results
DeferredRendering Yes
DetailedSurface Yes
EnvLighting Yes
GlobalIllumination Yes
GPUParticleSystem Yes
JudaTexViewer Yes
MotionBlurDoF Yes
Ocean Yes
OrderIndependentTransparency Yes
ParticleEditor Yes
PostProcessing Yes
ProceduralTex Yes
Reflection Yes
ScenePlayer Yes
ShadowCubemap Yes
SSSSS Yes
SubSurface Yes
Text Yes
VideoTexture Yes (No DShow)

iOS

Sample Apple emulator iPad2
Last test 2015/1/18 2015/1/18
AreaLighting Dead Incomplete FBO
AtmosphericScattering Yes Yes
CascadedShadowMap Dead Incomplete FBO
CausticsMap Yes No GL_ARB_standard_derivatives
DeferredRendering Dead Out of memory
DetailedSurface FXMLJIT failed No GL_ARB_standard_derivatives
EnvLighting Yes Yes
GlobalIllumination Dead Incomplete FBO
GPUParticleSystem No particle No GL_ARB_standard_derivatives
JudaTexViewer Yes Yes
MotionBlurDoF No python No python
Ocean FXMLJIT failed No GL_ARB_standard_derivatives
OrderIndependentTransparency Yes Yes
ParticleEditor Yes No particle
PostProcessing Dead Incomplete FBO
ProceduralTex Yes Yes
Reflection Dead No GL_ARB_shader_texture_lod
ScenePlayer No python No python
ShadowCubemap Yes Yes
SSSSS Black screen No MRT
SubSurface Dead Yes
Text Yes Yes
VideoTexture Yes (No Dshow) Yes (No Dshow)
Retrieved from "http://www.klayge.org/wiki/index.php?title=Regression_testing&oldid=2220"