glean and Piglit -- OpenGL driver testing

Saulius Krasuckas saulius2 at ar.fi.lt
Thu Sep 17 13:46:54 CDT 2009


Today I saw two similar projects related to OpenGL:

[1]:

> glean is a suite of tools for evaluating the quality of an OpenGL 
> implementation and diagnosing any problems that are discovered. glean 
> also has the ability to compare two OpenGL implementations and highlight 
> the differences between them.

It seems be having win32 port also.

[2]:

> Piglit is a collection of automated tests for OpenGL implementations.
> 
> The goal of Piglit is to help improve the quality of open source OpenGL 
> drivers by providing developers with a simple means to perform 
> regression tests.
> 
> Current status is that the framework is working (though rough at the 
> edges). It contains the Glean tests, some tests adapted from Mesa as 
> well as some specific regression tests for certain bugs. HTML summaries 
> can be generated (see below), including the ability to compare different 
> test runs.

Could these be of any use for our graphic guys -- Stefan and co.?


Then there is PerceptualDiff utility I found some time ago [3].  Guessed, 
could it also usefull for finding visual regressions of Wine?  Probably 
not, as it seems to be used for testing video codecs (but I may be wrong):

> PerceptualDiff is an image comparison utility that makes use of a 
> computational model of the human visual system to compare two images.
> 
> So why would I use a program to tell me if two images are similar if I 
> can tell the difference myself by eyeballing it?
> 
> Well the utility of this program really shines in the context of QA of 
> rendering algorithms.
> 
> During regression testing of a renderer, hundreds of images are 
> generated from an older version of the renderer and are compared with a 
> newer version of the renderer. This program drastically reduces the 
> number of false positives (failures that are not actually failures) 
> caused by differences in random number generation, OS or machine 
> architecture differences. Also, you do not want a human looking at 
> hundreds of images when you can get the computer to do it for you 
> nightly on a cron job.



[1] http://glean.sourceforge.net/whatis.html
[2] http://people.freedesktop.org/~nh/piglit/
[3] http://pdiff.sourceforge.net/



More information about the wine-devel mailing list