Sources of noise on test.winehq.org?
robertshearman at gmail.com
Thu Apr 9 07:09:57 CDT 2009
2009/4/9 Dan Kegel <dank at kegel.com>:
> (This was last discussed in February, e.g.
> http://www.winehq.org/pipermail/wine-devel/2009-February/073060.html )
> The results on test.winehq.org seem more variable than one
> would expect, which makes it harder to gauge wine's progress.
> I can think of two sources of noise:
> 1) 32 and 64 bit results are mixed together
> 2) we don't have a stable stable (sic) of machines
> running the tests
> Removing these two sources of noise might be as simple as
> 1) omit 64 bit results, and
Not a bad idea, but I would suggest classifying these machines as a
different category (I would suggest "other" for the moment) rather
than omitting the results.
> 2) omit computers for which results are not
> consistently available throughout the time range
> being displayed
> Shouldn't be too hard for someone to whip together an
> alternate report that did that. Wish I had the time to...
More information about the wine-devel