Is the test.winehq.org front page too pessimistic?
scott at open-vote.org
Wed Feb 11 17:46:56 CST 2009
James Hawkins wrote:
> On Wed, Feb 11, 2009 at 3:27 PM, Alexandre Julliard <julliard at winehq.org> wrote:
>> James Hawkins <truiken at gmail.com> writes:
>>> We should leave the failing files percentage up (note the name change)
>>> and add a failing tests percentage next to it. The failing tests
>>> percentage should be total_test_failures / total_tests_run.
>> That's not a useful number, many files run a lot of tests, of which a
>> huge majority always succeeds. Having a single failure among 10,000
>> tests means that the test failed, and it's something bad that should be
>> taken care of. Showing that as a 99.99% success would be very misleading.
> Ok you're right. I wasn't thinking on that scale. I assumed we had
> more than 0.01% failures.
Why not just print absolute numbers for tests failed and passed? Does a
percentage even serve any benefit here?
With absolute numbers we could see progress in both tests being fixed
and in tests being written.
More information about the wine-devel