Sources of noise on test.winehq.org?

Rob Shearman robertshearman at gmail.com
Thu Apr 9 07:09:57 CDT 2009


2009/4/9 Dan Kegel <dank at kegel.com>:
> (This was last discussed in February, e.g.
> http://www.winehq.org/pipermail/wine-devel/2009-February/073060.html )
>
> The results on test.winehq.org seem more variable than one
> would expect, which makes it harder to gauge wine's progress.
>
> I can think of two sources of noise:
> 1) 32 and 64 bit results are mixed together
> 2) we don't have a stable stable (sic) of machines
> running the tests
>
> Removing these two sources of noise might be as simple as
> 1) omit 64 bit results, and

Not a bad idea, but I would suggest classifying these machines as a
different category (I would suggest "other" for the moment) rather
than omitting the results.

> 2) omit computers for which results are not
> consistently available throughout the time range
> being displayed
>
> Shouldn't be too hard for someone to whip together an
> alternate report that did that.  Wish I had the time to...

-- 
Rob Shearman



More information about the wine-devel mailing list