Is the test.winehq.org front page too pessimistic?

Scott Ritchie scott at open-vote.org
Wed Feb 11 17:46:56 CST 2009


James Hawkins wrote:
> On Wed, Feb 11, 2009 at 3:27 PM, Alexandre Julliard <julliard at winehq.org> wrote:
>> James Hawkins <truiken at gmail.com> writes:
>>
>>> We should leave the failing files percentage up (note the name change)
>>> and add a failing tests percentage next to it.  The failing tests
>>> percentage should be total_test_failures / total_tests_run.
>> That's not a useful number, many files run a lot of tests, of which a
>> huge majority always succeeds. Having a single failure among 10,000
>> tests means that the test failed, and it's something bad that should be
>> taken care of. Showing that as a 99.99% success would be very misleading.
>>
> 
> Ok you're right.  I wasn't thinking on that scale.  I assumed we had
> more than 0.01% failures.
> 

Why not just print absolute numbers for tests failed and passed?  Does a
percentage even serve any benefit here?

With absolute numbers we could see progress in both tests being fixed
and in tests being written.

Thanks,
Scott Ritchie



More information about the wine-devel mailing list